-- Logs begin at Tue 2022-10-04 02:50:12 UTC, end at Tue 2022-10-04 03:47:13 UTC. -- Oct 04 03:14:59.505107 dv-cinder-849143-9-smb systemd[1]: Starting Devstack devstack@keystone.service... Oct 04 03:14:59.513061 dv-cinder-849143-9-smb devstack@keystone.service[81366]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 04 03:14:59.515047 dv-cinder-849143-9-smb devstack@keystone.service[81366]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 4 03:14:59 2022] *** Oct 04 03:14:59.515047 dv-cinder-849143-9-smb devstack@keystone.service[81366]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 04 03:14:59.515047 dv-cinder-849143-9-smb devstack@keystone.service[81366]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 04 03:14:59.515047 dv-cinder-849143-9-smb devstack@keystone.service[81366]: nodename: dv-cinder-849143-9-smb Oct 04 03:14:59.515047 dv-cinder-849143-9-smb devstack@keystone.service[81366]: machine: x86_64 Oct 04 03:14:59.515047 dv-cinder-849143-9-smb devstack@keystone.service[81366]: clock source: unix Oct 04 03:14:59.515047 dv-cinder-849143-9-smb devstack@keystone.service[81366]: pcre jit disabled Oct 04 03:14:59.515481 dv-cinder-849143-9-smb devstack@keystone.service[81366]: detected number of CPU cores: 4 Oct 04 03:14:59.515481 dv-cinder-849143-9-smb devstack@keystone.service[81366]: current working directory: / Oct 04 03:14:59.515481 dv-cinder-849143-9-smb devstack@keystone.service[81366]: detected binary path: /usr/bin/uwsgi-core Oct 04 03:14:59.515481 dv-cinder-849143-9-smb devstack@keystone.service[81366]: your processes number limit is 47680 Oct 04 03:14:59.515481 dv-cinder-849143-9-smb devstack@keystone.service[81366]: your memory page size is 4096 bytes Oct 04 03:14:59.515481 dv-cinder-849143-9-smb devstack@keystone.service[81366]: detected max file descriptor number: 2048 Oct 04 03:14:59.515481 dv-cinder-849143-9-smb devstack@keystone.service[81366]: lock engine: pthread robust mutexes Oct 04 03:14:59.515481 dv-cinder-849143-9-smb devstack@keystone.service[81366]: thunder lock: enabled Oct 04 03:14:59.515481 dv-cinder-849143-9-smb devstack@keystone.service[81366]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 04 03:14:59.515481 dv-cinder-849143-9-smb devstack@keystone.service[81366]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 04 03:14:59.556293 dv-cinder-849143-9-smb devstack@keystone.service[81366]: Python main interpreter initialized at 0x55c09d7739c0 Oct 04 03:14:59.556293 dv-cinder-849143-9-smb devstack@keystone.service[81366]: python threads support enabled Oct 04 03:14:59.556293 dv-cinder-849143-9-smb devstack@keystone.service[81366]: your server socket listen backlog is limited to 100 connections Oct 04 03:14:59.556293 dv-cinder-849143-9-smb devstack@keystone.service[81366]: your mercy for graceful operations on workers is 90 seconds Oct 04 03:14:59.556673 dv-cinder-849143-9-smb devstack@keystone.service[81366]: mapped 403077 bytes (393 KB) for 2 cores Oct 04 03:14:59.556760 dv-cinder-849143-9-smb devstack@keystone.service[81366]: *** Operational MODE: preforking *** Oct 04 03:14:59.557020 dv-cinder-849143-9-smb devstack@keystone.service[81366]: *** uWSGI is running in multiple interpreter mode *** Oct 04 03:14:59.557020 dv-cinder-849143-9-smb devstack@keystone.service[81366]: spawned uWSGI master process (pid: 81366) Oct 04 03:14:59.557225 dv-cinder-849143-9-smb systemd[1]: Started Devstack devstack@keystone.service. Oct 04 03:14:59.559919 dv-cinder-849143-9-smb devstack@keystone.service[81366]: spawned uWSGI worker 1 (pid: 81379, cores: 1) Oct 04 03:14:59.559919 dv-cinder-849143-9-smb devstack@keystone.service[81366]: spawned uWSGI worker 2 (pid: 81380, cores: 1) Oct 04 03:14:59.559919 dv-cinder-849143-9-smb devstack@keystone.service[81366]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 04 03:15:03.952831 dv-cinder-849143-9-smb devstack@keystone.service[81380]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 03:15:03.952831 dv-cinder-849143-9-smb devstack@keystone.service[81380]: from cryptography.utils import int_from_bytes Oct 04 03:15:03.953588 dv-cinder-849143-9-smb devstack@keystone.service[81380]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 03:15:03.953588 dv-cinder-849143-9-smb devstack@keystone.service[81380]: from cryptography.utils import int_from_bytes Oct 04 03:15:03.979439 dv-cinder-849143-9-smb devstack@keystone.service[81379]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 03:15:03.979439 dv-cinder-849143-9-smb devstack@keystone.service[81379]: from cryptography.utils import int_from_bytes Oct 04 03:15:03.980161 dv-cinder-849143-9-smb devstack@keystone.service[81379]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 03:15:03.980161 dv-cinder-849143-9-smb devstack@keystone.service[81379]: from cryptography.utils import int_from_bytes Oct 04 03:15:04.003700 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 03:15:04.003891 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 03:15:04.004085 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] command line args: [] {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 03:15:04.004356 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 03:15:04.004537 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ================================================================================ {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 03:15:04.004793 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] admin_token = **** {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.005041 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] config_dir = [] {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.005231 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.005413 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] config_source = [] {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.005597 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] debug = True {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.005795 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.006889 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.006889 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.006889 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.006889 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.007135 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] list_limit = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.007197 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] log_config_append = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.007360 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.007563 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] log_dir = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.007745 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] log_file = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.007985 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.008238 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.008484 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.008731 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.008908 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.009086 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.009331 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.009577 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.009814 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.010049 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.010347 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.010568 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.010834 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.011065 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.011355 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.011865 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.25/identity {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.012040 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] publish_errors = False {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.012279 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.012519 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.012690 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.012941 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.013178 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.013415 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] standard_threads = False {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.013649 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.013895 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.014074 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.014252 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] use_journal = False {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.014430 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] use_json = False {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.014605 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] use_stderr = False {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.014782 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] use_syslog = False {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.015017 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.015277 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.015540 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.015804 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.016046 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.016298 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.016539 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.016789 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.017026 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.017290 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.017522 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.017772 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.018008 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.018261 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.018497 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.018746 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.018993 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.019231 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.019496 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.019763 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.020009 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.020248 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.020502 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.020766 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.021021 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.021272 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.021505 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.021738 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.021969 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.022206 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.022455 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.022702 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.022933 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.023165 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.023412 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.032297 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.032297 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.032297 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.032297 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.032297 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.032297 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.032297 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.032297 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.032297 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.032810 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.032810 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.032810 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.032810 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.032810 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.032810 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.032810 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.032810 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.032810 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.033729 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.033788 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 03:15:04.033848 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.033942 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 03:15:04.034031 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.034098 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] command line args: [] {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 03:15:04.034166 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.034247 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 03:15:04.034247 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ================================================================================ {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 03:15:04.034751 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.034751 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.034908 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] admin_token = **** {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.035224 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.035290 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] config_dir = [] {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.035290 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.035591 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.035668 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] config_source = [] {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.035736 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.035800 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] debug = True {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.035858 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.035914 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.035993 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.036060 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.036060 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.036174 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.036236 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.036293 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.036293 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.036405 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.036405 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] list_limit = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.036512 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.036596 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] log_config_append = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.036656 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.036712 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.036908 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.036974 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] log_dir = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.036974 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] log_file = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.037072 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.037127 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.037223 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.037291 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.037349 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.037818 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.037906 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.038062 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.038146 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.038227 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.038227 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.038412 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.038540 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.038602 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.038717 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.038831 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.038891 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.038946 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.039001 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.039055 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.039110 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.039172 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.039229 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.039290 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.039352 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.039408 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.039642 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.040501 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.040642 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.040772 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.040772 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.040772 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.041139 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.25/identity {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.041139 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] publish_errors = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.041917 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.042052 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.042215 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.042345 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.042646 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.042799 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.042799 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.043309 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.043652 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.043912 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.044178 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] standard_threads = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.044178 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.044484 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.044656 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.044841 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.044991 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.045257 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.045406 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] use_journal = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.045406 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] use_json = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.045809 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.045994 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] use_stderr = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.046143 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.046578 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] use_syslog = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.046765 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.046963 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 03:15:04.047160 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.047343 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.047559 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.047726 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.047910 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.048079 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.048227 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.048409 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.048559 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.048812 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.048984 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.049389 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.049539 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.049724 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.049877 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.050381 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.050654 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.050904 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.051451 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.051916 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.052086 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] auth.external = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.052277 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.052500 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.052773 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.053127 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.053361 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.053526 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.053719 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.053719 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.054269 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] auth.password = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.054476 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.054661 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] auth.token = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.054970 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.055249 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.055412 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.055624 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.055892 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.056084 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.056313 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.056478 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.056672 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.056861 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.057092 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.058208 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.058361 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.058512 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.058723 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.058888 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] credential.caching = True {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.059022 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.059152 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.059289 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.059289 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.059550 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.059685 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.059921 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.060097 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.060316 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.060547 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.060682 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.060836 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.060966 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.061101 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.061256 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.061391 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.061683 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.061874 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.062036 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.062264 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.062460 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.062606 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.062606 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.062848 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.063048 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.063190 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.063329 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.063458 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.063610 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.063610 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.064058 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.064197 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.064339 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.064489 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.064651 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] federation.caching = True {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.064792 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.064922 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.065078 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.065216 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.065347 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.065643 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.065890 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.066108 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.066451 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.066658 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.066922 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.066922 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.067255 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.067398 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.067701 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.067898 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.068039 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.068169 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.068342 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.068471 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.068601 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.068739 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.068883 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.069012 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.069146 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] identity.caching = True {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.069275 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.069275 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.069620 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.069850 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.070054 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.070185 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.070313 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.070447 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.070607 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.070748 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.071131 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.071269 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.071400 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.071809 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.071946 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.072086 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.072222 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.072367 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.072498 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.072644 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.072840 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.072991 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.073147 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.073332 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.073537 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.073671 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.073919 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.074101 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.074244 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.074389 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.074389 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.074633 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.074763 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.075256 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.075398 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.075874 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.076009 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.076139 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.076139 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.076925 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.076925 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.077219 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.077588 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.077758 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.077988 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.078293 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.078434 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.078574 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.078711 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.078850 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.078981 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.079110 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.079239 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.079376 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.079525 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.079525 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.079796 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.079927 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.080057 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.080194 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.080324 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.080452 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.080579 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.080707 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.080846 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.080989 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.081076 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.081138 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.081200 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.081266 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.081333 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.081510 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.081581 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.081772 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.081914 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.081985 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.082119 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.082196 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.082266 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.082335 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.082409 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.082479 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.082556 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.082628 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.082628 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.082628 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.082809 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.082878 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.082955 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.083026 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.083096 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.083172 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.083242 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.083312 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.083462 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.083555 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.083621 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.083691 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] auth.external = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.083760 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.083829 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.083909 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.083981 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.084051 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.084121 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.084190 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.084259 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] auth.password = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.084335 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.user = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.084406 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] auth.token = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.084475 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.084551 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.084551 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.084673 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.084751 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.084822 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.084891 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.084959 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.085028 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.085097 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.085173 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.085245 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.085314 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.085314 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] credential.caching = True {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.085444 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.085444 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.085578 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.085649 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.085718 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.085718 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.085843 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.085920 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.085998 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.086076 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.086152 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.086227 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.086303 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.086373 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.086450 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.086520 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.086589 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.086658 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.086727 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.086796 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.086873 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.086873 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.086999 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.087068 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.087137 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.087205 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.087286 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.087358 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.087427 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.087577 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.087653 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.087723 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.087804 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] federation.caching = True {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.087882 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.087953 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.088023 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.088091 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.088160 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.088160 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.088324 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.088413 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.088487 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.088556 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.088625 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.088703 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.088774 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.088844 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.088912 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.088982 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.089058 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.089129 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.089205 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.089275 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.089343 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.089412 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.089488 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.089559 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.089627 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] identity.caching = True {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.089695 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] resource.caching = True {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.089764 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.089832 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.089908 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.089979 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.090047 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.090116 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.090184 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.090252 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.090328 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.090398 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.090466 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.090466 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.090588 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.090656 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.090775 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.090854 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.090924 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.090993 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.091062 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.091130 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.091207 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] role.caching = True {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.091279 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.091348 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] role.driver = sql {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.091417 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.091498 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.091570 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.091651 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.091724 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.091832 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.091910 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.091980 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.092049 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.092126 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.092197 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.092266 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.092336 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.092401 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.092470 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.092546 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.092617 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.092686 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.092754 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.092823 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.092891 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.092974 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.093051 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.093051 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.093177 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.093246 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.093315 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.093391 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.093462 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.093537 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.093537 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.093662 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.093731 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.093807 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.093878 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.093947 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.094016 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.094084 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.094152 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.094228 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.094298 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.094367 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.094441 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.094511 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.094588 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.094658 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.094728 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.094796 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.094864 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.094932 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.095007 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.095078 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.095146 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.095214 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.095283 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.095351 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.095427 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.095532 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.095606 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.095675 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.095745 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.095814 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.095895 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.095967 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.096037 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.096106 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.096175 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.096243 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.096319 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.096391 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] token.caching = True {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.096460 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.096528 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.096596 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.096665 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.096741 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.user = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.096812 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.096881 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.096950 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.097018 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.097087 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.097087 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.097288 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.097359 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.097359 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.097484 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.097553 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.097629 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.097700 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.097769 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.097837 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.097906 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.097974 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.098049 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.098120 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.098189 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.098189 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.098315 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.098315 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.098452 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.098452 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.098580 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.098650 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.098718 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.098792 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.098862 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] database.connection = **** {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.098939 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.099010 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.099079 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.099147 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.099216 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.099284 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.099360 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.099431 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.099515 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.099586 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.099655 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.099724 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.099804 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.099876 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.099945 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.100013 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.100090 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.100160 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.100237 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.100312 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.100381 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.100450 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.100519 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.100587 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.100587 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.100721 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.100790 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.100860 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.100928 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.100996 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.101073 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.101144 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.101212 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.101280 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.101348 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.101416 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.101495 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81380) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 03:15:04.101567 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.101567 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.101567 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.101567 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.101567 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] resource.caching = True {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.101567 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.101567 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.101567 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.101567 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.102072 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.102072 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.102072 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.102072 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.102072 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.102072 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] role.caching = True {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.102072 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] role.driver = sql {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.102072 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.102072 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.102552 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.102552 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.102552 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.102552 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.102552 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.102552 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.102552 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.102552 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.102552 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.103028 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.103028 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.103028 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.103028 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.103262 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.103388 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.103668 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.104438 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.104851 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.105281 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.105552 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.105812 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.106060 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.106300 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.106538 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.106775 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.107031 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.107326 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.107572 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.107819 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.108062 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.108299 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.108540 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] token.caching = True {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.108781 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.109031 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.109273 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.109529 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.109779 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.110021 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.110269 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.110516 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.110766 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.111004 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.111247 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.111498 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.111752 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.112035 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.112270 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.112519 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.112786 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.113049 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] database.connection = **** {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.113296 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.113546 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.113787 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.114036 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.114275 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.114514 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.114751 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.114990 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.115235 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.115472 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.115739 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.115977 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.116225 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.116462 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.116707 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.116938 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.117179 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.117416 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 03:15:04.117586 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 03:15:04.125630 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 03:15:04.125895 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 03:15:04.126094 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 03:15:04.134464 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 03:15:04.143510 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 03:15:04.143750 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 03:15:04.143982 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 03:15:04.153173 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 03:15:04.163986 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 03:15:04.164221 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 03:15:04.171658 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 03:15:04.171895 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 03:15:04.218459 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 03:15:04.219955 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 03:15:04.267305 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 03:15:04.267566 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 03:15:04.268462 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 03:15:04.268700 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 03:15:04.423465 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 03:15:04.423722 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 03:15:04.423950 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 03:15:04.424175 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 03:15:04.424257 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 03:15:04.424398 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 03:15:04.424481 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 03:15:04.424616 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 03:15:04.424697 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 03:15:04.424858 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 03:15:04.425079 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 03:15:04.425297 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 03:15:04.447732 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 03:15:04.447971 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 03:15:04.448056 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 03:15:04.448245 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 03:15:04.448387 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 03:15:04.448535 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 03:15:04.448616 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 03:15:04.448759 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 03:15:04.448839 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 03:15:04.448975 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 03:15:04.449056 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 03:15:04.449191 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 03:15:04.449270 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 03:15:04.449443 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 03:15:04.460382 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 03:15:04.460687 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 03:15:04.473477 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 03:15:04.473677 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 03:15:04.473790 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 03:15:04.473913 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 03:15:04.473998 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 03:15:04.474141 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 03:15:04.474225 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 03:15:04.474372 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 03:15:04.474493 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 03:15:04.474585 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 03:15:04.474662 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 03:15:04.474775 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81380) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 03:15:04.474858 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 03:15:04.474987 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81379) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 03:15:04.492002 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.492127 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.492211 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 04 03:15:04.492286 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 04 03:15:04.492543 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.492628 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.492744 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 04 03:15:04.492829 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 04 03:15:04.493021 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.493105 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.493284 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.493376 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.493544 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.493627 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.493798 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.493880 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.503669 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.503779 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.503953 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.504038 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.504226 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.504310 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.504509 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.504594 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.511543 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81380) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 03:15:04.511867 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81379) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 03:15:04.514422 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81380) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 03:15:04.514707 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.514790 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81379) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 03:15:04.514994 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.515077 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.515282 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.515365 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.515590 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.515675 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.515856 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.515939 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.516129 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.516223 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.516397 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.516481 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.516668 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.516748 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.516938 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.517019 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.517204 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.517285 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.517475 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.540276 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.540800 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.541785 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81380) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 03:15:04.542073 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.542593 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81379) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 03:15:04.542881 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.546715 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81380) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 03:15:04.547001 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.547284 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.547539 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81379) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 03:15:04.547825 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.548105 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.553599 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81380) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 03:15:04.553884 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.554374 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81379) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 03:15:04.554662 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.560132 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81380) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 03:15:04.560428 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.560713 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.560997 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.561080 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81379) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 03:15:04.561276 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.561368 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.561552 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.561634 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.561825 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.561908 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.562096 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.562179 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.562441 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.562713 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.562980 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.577846 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.578132 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.579055 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.579337 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.581980 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81380) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 03:15:04.583169 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81379) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 03:15:04.585232 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.585528 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.586394 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.586692 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.590256 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81380) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 03:15:04.591872 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81379) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 03:15:04.593375 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81380) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 03:15:04.594981 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81379) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 03:15:04.596593 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.596896 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.597183 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.597480 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.597768 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.598050 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.598215 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.598520 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.598808 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.599111 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.599394 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.599702 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.613709 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81380) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 03:15:04.613998 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.614267 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.614528 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.615842 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81379) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 03:15:04.616133 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.616403 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.616668 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.621900 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.623433 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.624339 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.624982 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.625259 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.625872 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.627407 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.627710 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.627957 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81380) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 03:15:04.628243 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.628536 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.628829 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.629214 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.630354 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81379) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 03:15:04.630640 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.630926 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.631211 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.631648 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.640918 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81380) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 03:15:04.641210 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.641494 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.641783 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.642167 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.642448 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.642726 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.643751 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81379) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 03:15:04.644040 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.644324 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.644607 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.644989 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.645271 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.645550 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.658060 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81380) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 03:15:04.660973 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81380) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 03:15:04.661182 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81379) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 03:15:04.663989 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.664079 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81379) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 03:15:04.665415 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.666940 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81380) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 03:15:04.667205 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.667287 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.667716 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.668719 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.670357 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81379) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 03:15:04.670641 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.671036 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.674032 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.675481 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81380) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 03:15:04.677355 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.678354 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.678751 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.678831 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81379) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 03:15:04.679037 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.679315 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.681650 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.682564 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.683066 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.683370 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.687657 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81380) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 03:15:04.687950 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.688230 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.691165 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81379) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 03:15:04.691459 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.691767 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.695158 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81380) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 03:15:04.695442 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.695743 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.696275 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.696559 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.696830 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.697099 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.697374 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.697712 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.698504 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.698866 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.699138 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.699407 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.699702 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81380) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.699796 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81379) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 03:15:04.700009 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.700289 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.700563 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.700835 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.701105 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.701388 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.701664 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.701951 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.702218 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.702496 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.702766 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.703029 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.703297 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81379) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 03:15:04.733758 dv-cinder-849143-9-smb devstack@keystone.service[81380]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55c09d7739c0 pid: 81380 (default app) Oct 04 03:15:04.737015 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd377e1-0c2d-4af7-9a91-2e97f5ab3151 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:04.737305 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd377e1-0c2d-4af7-9a91-2e97f5ab3151 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:04.737582 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd377e1-0c2d-4af7-9a91-2e97f5ab3151 None None] PATH_INFO: `/v3` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:04.737677 dv-cinder-849143-9-smb devstack@keystone.service[81379]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55c09d7739c0 pid: 81379 (default app) Oct 04 03:15:04.741723 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1/1] 10.222.0.25 () {50 vars in 791 bytes} [Tue Oct 4 03:15:04 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:11.485924 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58b87f-ae67-40f8-bf81-61e76fb15633 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:11.486451 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58b87f-ae67-40f8-bf81-61e76fb15633 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:11.486451 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58b87f-ae67-40f8-bf81-61e76fb15633 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:11.490715 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1/2] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:15:11 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 03:15:11.496433 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc03dc8-93ff-4afa-a4bd-24d957943979 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:11.497013 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc03dc8-93ff-4afa-a4bd-24d957943979 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:11.497112 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc03dc8-93ff-4afa-a4bd-24d957943979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:11.567667 dv-cinder-849143-9-smb devstack@keystone.service[81380]: INFO dbcounter [None req-afc03dc8-93ff-4afa-a4bd-24d957943979 None None] Registered counter for database keystone Oct 04 03:15:11.586467 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG oslo_db.sqlalchemy.engines [None req-afc03dc8-93ff-4afa-a4bd-24d957943979 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81380) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 03:15:11.592601 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writer thread running {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 03:15:11.771595 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG passlib.handlers.bcrypt [None req-afc03dc8-93ff-4afa-a4bd-24d957943979 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81380) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 04 03:15:11.771930 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG passlib.handlers.bcrypt [None req-afc03dc8-93ff-4afa-a4bd-24d957943979 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81380) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 04 03:15:11.830710 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-afc03dc8-93ff-4afa-a4bd-24d957943979 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:15:11.832355 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-afc03dc8-93ff-4afa-a4bd-24d957943979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:15:11.960978 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 2/3] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:15:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 465 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 04 03:15:12.265623 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac58b87f-ae67-40f8-bf81-61e76fb15633 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:12.335193 dv-cinder-849143-9-smb devstack@keystone.service[81379]: INFO dbcounter [None req-ac58b87f-ae67-40f8-bf81-61e76fb15633 None None] Registered counter for database keystone Oct 04 03:15:12.356867 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG oslo_db.sqlalchemy.engines [None req-ac58b87f-ae67-40f8-bf81-61e76fb15633 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81379) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 03:15:12.363088 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writer thread running {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 03:15:12.482498 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac58b87f-ae67-40f8-bf81-61e76fb15633 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:12.486825 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f11f1b1-cd96-40bd-8bc7-8e510af5c3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:12.487446 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f11f1b1-cd96-40bd-8bc7-8e510af5c3e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:12.487762 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f11f1b1-cd96-40bd-8bc7-8e510af5c3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:12.488042 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f11f1b1-cd96-40bd-8bc7-8e510af5c3e4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:12.496337 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f11f1b1-cd96-40bd-8bc7-8e510af5c3e4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:12.548702 dv-cinder-849143-9-smb devstack@keystone.service[81379]: WARNING keystone.common.rbac_enforcer.enforcer [None req-8f11f1b1-cd96-40bd-8bc7-8e510af5c3e4 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 04 03:15:12.548997 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f11f1b1-cd96-40bd-8bc7-8e510af5c3e4 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:12.558520 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 2/4] 10.222.0.25 () {58 vars in 1324 bytes} [Tue Oct 4 03:15:12 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 04 03:15:12.564457 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc03dc8-93ff-4afa-a4bd-24d957943979 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:12.581912 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc03dc8-93ff-4afa-a4bd-24d957943979 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:12.586340 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf40254-968b-465e-935f-2f7168fc05f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:12.587438 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf40254-968b-465e-935f-2f7168fc05f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:12.587752 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf40254-968b-465e-935f-2f7168fc05f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:12.588672 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf40254-968b-465e-935f-2f7168fc05f6 admin admin] PATH_INFO: `/v3/projects/1f0f8d5c867d4d0e8de6fcf13db59693` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:12.590274 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf40254-968b-465e-935f-2f7168fc05f6 admin admin] RBAC: Authorizing `identity:get_project(project_id=1f0f8d5c867d4d0e8de6fcf13db59693)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:12.643464 dv-cinder-849143-9-smb devstack@keystone.service[81380]: WARNING keystone.common.rbac_enforcer.enforcer [None req-bdf40254-968b-465e-935f-2f7168fc05f6 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 04 03:15:12.643844 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf40254-968b-465e-935f-2f7168fc05f6 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:12.648449 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 3/5] 10.222.0.25 () {56 vars in 1207 bytes} [Tue Oct 4 03:15:12 2022] GET /identity/v3/projects/1f0f8d5c867d4d0e8de6fcf13db59693 => generated 344 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:14.751033 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce352559-5153-4bfc-97a0-4460d1c23d3e None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:14.751606 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce352559-5153-4bfc-97a0-4460d1c23d3e None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:14.751606 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce352559-5153-4bfc-97a0-4460d1c23d3e None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:14.755749 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 3/6] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:15:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 03:15:14.761197 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4716f1-22eb-4139-81d7-4358dce72ae9 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:14.761626 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4716f1-22eb-4139-81d7-4358dce72ae9 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:14.761745 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4716f1-22eb-4139-81d7-4358dce72ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:14.781817 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-5b4716f1-22eb-4139-81d7-4358dce72ae9 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:15:14.783340 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-5b4716f1-22eb-4139-81d7-4358dce72ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:15:14.791699 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 4/7] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:15:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 04 03:15:15.062992 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce352559-5153-4bfc-97a0-4460d1c23d3e None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:15.075442 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce352559-5153-4bfc-97a0-4460d1c23d3e None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:15.079729 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b996b5-9400-4678-acd5-2d789a9806b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:15.080325 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b996b5-9400-4678-acd5-2d789a9806b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:15.080612 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b996b5-9400-4678-acd5-2d789a9806b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:15.080892 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b996b5-9400-4678-acd5-2d789a9806b3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:15.089038 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b996b5-9400-4678-acd5-2d789a9806b3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:15.090807 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b996b5-9400-4678-acd5-2d789a9806b3 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:15.099373 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 4/8] 10.222.0.25 () {58 vars in 1324 bytes} [Tue Oct 4 03:15:15 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 03:15:15.105066 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4716f1-22eb-4139-81d7-4358dce72ae9 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:15.113933 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4716f1-22eb-4139-81d7-4358dce72ae9 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:15.118245 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74d04ba-f3b6-4b77-a202-59d7b51d1ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:15.118854 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74d04ba-f3b6-4b77-a202-59d7b51d1ac5 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:15.119253 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74d04ba-f3b6-4b77-a202-59d7b51d1ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:15.119655 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74d04ba-f3b6-4b77-a202-59d7b51d1ac5 admin admin] PATH_INFO: `/v3/users/7c1281e81e9c4e3da30715cc2f1b3156` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:15.120960 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74d04ba-f3b6-4b77-a202-59d7b51d1ac5 admin admin] RBAC: Authorizing `identity:get_user(user_id=7c1281e81e9c4e3da30715cc2f1b3156)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:15.122755 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74d04ba-f3b6-4b77-a202-59d7b51d1ac5 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:15.124278 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 5/9] 10.222.0.25 () {56 vars in 1198 bytes} [Tue Oct 4 03:15:15 2022] GET /identity/v3/users/7c1281e81e9c4e3da30715cc2f1b3156 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:17.327937 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b8c85-e1cc-4734-8ab5-a1df8258e5d2 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:17.328481 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b8c85-e1cc-4734-8ab5-a1df8258e5d2 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:17.328481 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b8c85-e1cc-4734-8ab5-a1df8258e5d2 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:17.329799 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 5/10] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:15:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:15:17.335065 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4a28e-15b7-4c26-a4a0-b4e29b4a3241 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:17.335454 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4a28e-15b7-4c26-a4a0-b4e29b4a3241 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:17.335763 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4a28e-15b7-4c26-a4a0-b4e29b4a3241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:17.354663 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-19b4a28e-15b7-4c26-a4a0-b4e29b4a3241 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:15:17.355267 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb63e7a8-ccd3-4a76-9cc1-09f2fef79390 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:17.355579 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb63e7a8-ccd3-4a76-9cc1-09f2fef79390 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:17.355853 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb63e7a8-ccd3-4a76-9cc1-09f2fef79390 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:17.355958 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-19b4a28e-15b7-4c26-a4a0-b4e29b4a3241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:15:17.357151 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 6/11] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:15:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 03:15:17.362078 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86b7b5-0fb4-48c7-9515-1ff472398a7a None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:17.362365 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86b7b5-0fb4-48c7-9515-1ff472398a7a None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:17.362642 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86b7b5-0fb4-48c7-9515-1ff472398a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:17.404844 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG passlib.handlers.bcrypt [None req-ea86b7b5-0fb4-48c7-9515-1ff472398a7a None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81379) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 04 03:15:17.405238 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG passlib.handlers.bcrypt [None req-ea86b7b5-0fb4-48c7-9515-1ff472398a7a None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81379) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 04 03:15:17.437049 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 6/12] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:15:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 03:15:17.455943 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-ea86b7b5-0fb4-48c7-9515-1ff472398a7a None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:15:17.457537 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-ea86b7b5-0fb4-48c7-9515-1ff472398a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:15:17.558856 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 7/13] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:15:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 03:15:17.703098 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b4a28e-15b7-4c26-a4a0-b4e29b4a3241 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:17.729442 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:17.809118 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b4a28e-15b7-4c26-a4a0-b4e29b4a3241 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:17.830956 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea86b7b5-0fb4-48c7-9515-1ff472398a7a None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:17.842733 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4e9252-ec46-42d4-9ecb-7b6a9d0a070c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:17.843383 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e9252-ec46-42d4-9ecb-7b6a9d0a070c None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:17.843679 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e9252-ec46-42d4-9ecb-7b6a9d0a070c None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:17.843954 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e9252-ec46-42d4-9ecb-7b6a9d0a070c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:17.856242 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4e9252-ec46-42d4-9ecb-7b6a9d0a070c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:15:17.865055 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-0c4e9252-ec46-42d4-9ecb-7b6a9d0a070c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 03:15:17.865055 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:15:17.865055 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:15:17.865055 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:15:17.865055 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:15:17.865055 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:15:17.865055 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:15:17.865055 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:15:17.865055 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:15:17.865055 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:15:17.865055 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:15:17.865055 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:15:17.865055 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:15:17.865055 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:15:17.865055 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:15:17.865055 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:15:17.866121 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:15:17.866121 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:15:17.866121 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:15:17.866121 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:15:17.866121 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:15:17.866121 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:15:17.866121 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:15:17.866121 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:15:17.866121 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:15:17.866121 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:15:17.866121 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:15:17.866121 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:15:17.866121 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:15:17.866121 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:15:17.866121 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:15:17.866121 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:15:17.866953 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:15:17.866953 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:15:17.866953 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:15:17.866953 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:15:17.866953 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:15:17.866953 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:15:17.866953 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:15:17.866953 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:15:17.866953 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:15:17.866953 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:15:17.866953 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 03:15:17.866953 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:15:17.866953 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 7/14] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 4 03:15:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:15:17.873219 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4e9252-ec46-42d4-9ecb-7b6a9d0a070c None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:17.935003 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea86b7b5-0fb4-48c7-9515-1ff472398a7a None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:17.937263 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:17.954822 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:17.973824 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4e9252-ec46-42d4-9ecb-7b6a9d0a070c None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:17.973979 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460073fa-4f3c-4a6d-9712-2194bc69255d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:17.974687 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460073fa-4f3c-4a6d-9712-2194bc69255d None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:17.974975 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460073fa-4f3c-4a6d-9712-2194bc69255d None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:17.975256 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460073fa-4f3c-4a6d-9712-2194bc69255d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:18.007409 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63019282-8d7f-4b36-a52a-f5d218fd86ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:18.008029 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63019282-8d7f-4b36-a52a-f5d218fd86ab None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:18.008312 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63019282-8d7f-4b36-a52a-f5d218fd86ab None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:18.008584 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63019282-8d7f-4b36-a52a-f5d218fd86ab None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:18.009246 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63019282-8d7f-4b36-a52a-f5d218fd86ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:15:18.009644 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63019282-8d7f-4b36-a52a-f5d218fd86ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:18.011060 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63019282-8d7f-4b36-a52a-f5d218fd86ab None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:18.022469 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 8/15] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 03:15:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:15:18.028981 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63019282-8d7f-4b36-a52a-f5d218fd86ab None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:18.043401 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460073fa-4f3c-4a6d-9712-2194bc69255d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:18.044959 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460073fa-4f3c-4a6d-9712-2194bc69255d None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:18.127468 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63019282-8d7f-4b36-a52a-f5d218fd86ab None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:18.141162 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 8/16] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 03:15:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 04 03:15:18.146777 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460073fa-4f3c-4a6d-9712-2194bc69255d None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:18.149479 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:18.162241 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e99b67-bd40-4304-919e-9cc0cacd1bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:18.162893 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e99b67-bd40-4304-919e-9cc0cacd1bde None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:18.163172 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e99b67-bd40-4304-919e-9cc0cacd1bde None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:18.163446 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e99b67-bd40-4304-919e-9cc0cacd1bde None admin] PATH_INFO: `/v3/users/7c1281e81e9c4e3da30715cc2f1b3156` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:18.164599 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e99b67-bd40-4304-919e-9cc0cacd1bde None admin] RBAC: Authorizing `identity:get_user(user_id=7c1281e81e9c4e3da30715cc2f1b3156)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:18.166112 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e99b67-bd40-4304-919e-9cc0cacd1bde None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:18.167673 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 9/17] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 03:15:18 2022] GET /identity/v3/users/7c1281e81e9c4e3da30715cc2f1b3156 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:15:18.172953 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e99b67-bd40-4304-919e-9cc0cacd1bde None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:18.187871 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:18.248625 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460073fa-4f3c-4a6d-9712-2194bc69255d None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:18.272411 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e99b67-bd40-4304-919e-9cc0cacd1bde None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:18.281530 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a3fd6c-3de3-494c-a838-b59d6b3662f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:18.282380 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a3fd6c-3de3-494c-a838-b59d6b3662f0 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:18.282665 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a3fd6c-3de3-494c-a838-b59d6b3662f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:18.282942 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a3fd6c-3de3-494c-a838-b59d6b3662f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:18.301414 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a3fd6c-3de3-494c-a838-b59d6b3662f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:18.302865 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a3fd6c-3de3-494c-a838-b59d6b3662f0 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:18.304892 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699da752-5ccf-42be-99e7-9deb00ae4ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:18.305514 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699da752-5ccf-42be-99e7-9deb00ae4ba4 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:18.305789 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699da752-5ccf-42be-99e7-9deb00ae4ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:18.306061 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699da752-5ccf-42be-99e7-9deb00ae4ba4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:18.307926 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699da752-5ccf-42be-99e7-9deb00ae4ba4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:18.309356 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699da752-5ccf-42be-99e7-9deb00ae4ba4 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:18.310886 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 10/18] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:15:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:15:18.316613 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699da752-5ccf-42be-99e7-9deb00ae4ba4 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:18.321372 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-68a3fd6c-3de3-494c-a838-b59d6b3662f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:15:18.321372 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:15:18.321372 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:15:18.321372 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:15:18.321372 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:15:18.321372 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:15:18.321372 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:15:18.321372 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:15:18.321372 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:15:18.321372 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:15:18.321372 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:15:18.321372 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:15:18.321372 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 03:15:18.321372 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 03:15:18.321372 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 03:15:18.321372 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 03:15:18.322272 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:15:18.322272 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:15:18.322272 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:15:18.322272 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:15:18.322272 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:15:18.322272 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:15:18.322272 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:15:18.322272 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:15:18.322272 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:15:18.322272 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:15:18.322272 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:15:18.322272 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:15:18.322272 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:15:18.322272 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:15:18.322272 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:15:18.322272 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:15:18.322272 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 03:15:18.323244 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 03:15:18.323244 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:15:18.323244 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:15:18.323244 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 9/19] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:15:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 03:15:18.328203 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a3fd6c-3de3-494c-a838-b59d6b3662f0 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:18.383682 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:18.395775 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:18.414966 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699da752-5ccf-42be-99e7-9deb00ae4ba4 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:18.430833 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a3fd6c-3de3-494c-a838-b59d6b3662f0 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:18.448953 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87acb931-8420-4e4b-9de4-2b87e153b1e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:18.449487 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87acb931-8420-4e4b-9de4-2b87e153b1e8 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:18.449766 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87acb931-8420-4e4b-9de4-2b87e153b1e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:18.450038 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87acb931-8420-4e4b-9de4-2b87e153b1e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:18.450752 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87acb931-8420-4e4b-9de4-2b87e153b1e8 None admin] RBAC: Adding query filter params (role.id=fe9379cda35c4ff78576fe48b60bea3c, scope.domain.id=default, user.id=7c1281e81e9c4e3da30715cc2f1b3156) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:15:18.451057 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87acb931-8420-4e4b-9de4-2b87e153b1e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:18.452518 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87acb931-8420-4e4b-9de4-2b87e153b1e8 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:18.458876 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 11/20] 10.222.0.25 () {56 vars in 1322 bytes} [Tue Oct 4 03:15:18 2022] GET /identity/v3/role_assignments?user.id=7c1281e81e9c4e3da30715cc2f1b3156&scope.domain.id=default&role.id=fe9379cda35c4ff78576fe48b60bea3c => generated 233 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:15:18.466945 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c80b5d-7255-4b32-b07f-9c5431b94a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:18.467594 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c80b5d-7255-4b32-b07f-9c5431b94a1b None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:18.467881 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c80b5d-7255-4b32-b07f-9c5431b94a1b None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:18.468156 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c80b5d-7255-4b32-b07f-9c5431b94a1b None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:18.468826 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c80b5d-7255-4b32-b07f-9c5431b94a1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:15:18.469132 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c80b5d-7255-4b32-b07f-9c5431b94a1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:18.470556 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c80b5d-7255-4b32-b07f-9c5431b94a1b None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:18.490237 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 10/21] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 03:15:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:15:21.016696 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9438b121-348f-4ef9-baf4-5c5bd16d2a0d None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:21.017741 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9438b121-348f-4ef9-baf4-5c5bd16d2a0d None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:21.018229 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9438b121-348f-4ef9-baf4-5c5bd16d2a0d None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:21.020263 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 12/22] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:15:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:15:21.027954 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147dd0fb-f3bb-48ae-a14a-cd9047fbe54c None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:21.028872 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147dd0fb-f3bb-48ae-a14a-cd9047fbe54c None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:21.029451 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147dd0fb-f3bb-48ae-a14a-cd9047fbe54c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:21.057305 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-147dd0fb-f3bb-48ae-a14a-cd9047fbe54c None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:15:21.058933 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-147dd0fb-f3bb-48ae-a14a-cd9047fbe54c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:15:21.148324 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 11/23] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:15:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 03:15:21.221395 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed1158-66cc-4a4d-89a4-efca251d8cd9 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:21.222033 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed1158-66cc-4a4d-89a4-efca251d8cd9 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:21.222510 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed1158-66cc-4a4d-89a4-efca251d8cd9 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:21.224507 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 13/24] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:15:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:15:21.240210 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456849f-ccea-4c48-8bd1-f86fa54efcf0 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:21.240824 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456849f-ccea-4c48-8bd1-f86fa54efcf0 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:21.241324 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456849f-ccea-4c48-8bd1-f86fa54efcf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:21.265372 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-2456849f-ccea-4c48-8bd1-f86fa54efcf0 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:15:21.266943 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-2456849f-ccea-4c48-8bd1-f86fa54efcf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:15:21.268949 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c78bdb-4ef0-4b78-983a-32b783a7cae6 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:21.269438 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c78bdb-4ef0-4b78-983a-32b783a7cae6 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:21.269928 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c78bdb-4ef0-4b78-983a-32b783a7cae6 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:21.271447 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 14/25] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:15:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 03:15:21.276767 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ad2af-cd19-4e25-89cb-33439efbf7fb None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:21.277341 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ad2af-cd19-4e25-89cb-33439efbf7fb None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:21.277818 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ad2af-cd19-4e25-89cb-33439efbf7fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:21.297208 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-d71ad2af-cd19-4e25-89cb-33439efbf7fb None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:15:21.298787 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-d71ad2af-cd19-4e25-89cb-33439efbf7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:15:21.351899 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:21.404921 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 12/26] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:15:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 03:15:21.414935 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 15/27] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:15:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 03:15:21.439606 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36907b-b754-4ba5-b552-2656ac35f4ab None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:21.440257 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36907b-b754-4ba5-b552-2656ac35f4ab None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:21.440747 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36907b-b754-4ba5-b552-2656ac35f4ab None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:21.442299 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 13/28] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:15:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:15:21.448458 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e7b1c-66ca-4fe8-8a2e-f9cbddc342af None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:21.448970 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e7b1c-66ca-4fe8-8a2e-f9cbddc342af None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:21.449468 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e7b1c-66ca-4fe8-8a2e-f9cbddc342af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:21.472195 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-5d8e7b1c-66ca-4fe8-8a2e-f9cbddc342af None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:15:21.473710 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-5d8e7b1c-66ca-4fe8-8a2e-f9cbddc342af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:15:21.567979 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 16/29] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:15:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 03:15:21.657235 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e36907b-b754-4ba5-b552-2656ac35f4ab None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:21.772575 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8e7b1c-66ca-4fe8-8a2e-f9cbddc342af None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:21.781681 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:21.784191 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e36907b-b754-4ba5-b552-2656ac35f4ab None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:21.834527 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cff4457-f72d-4ff5-9778-1cded32c2e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:21.835397 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff4457-f72d-4ff5-9778-1cded32c2e28 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:21.840291 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff4457-f72d-4ff5-9778-1cded32c2e28 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:21.840891 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff4457-f72d-4ff5-9778-1cded32c2e28 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:21.853649 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cff4457-f72d-4ff5-9778-1cded32c2e28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:15:21.863605 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-3cff4457-f72d-4ff5-9778-1cded32c2e28 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 03:15:21.863605 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:15:21.863605 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:15:21.863605 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:15:21.863605 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:15:21.863605 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:15:21.863605 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:15:21.863605 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:15:21.863605 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:15:21.863605 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:15:21.863605 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:15:21.863605 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:15:21.863605 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:15:21.863605 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:15:21.863605 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:15:21.863605 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:15:21.864486 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:15:21.864486 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:15:21.864486 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:15:21.864486 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:15:21.864486 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:15:21.864486 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:15:21.864486 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:15:21.864486 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:15:21.864486 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:15:21.864486 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:15:21.864486 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:15:21.864486 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:15:21.864486 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:15:21.864486 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:15:21.864486 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:15:21.864486 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:15:21.865242 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:15:21.865242 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:15:21.865242 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:15:21.865242 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:15:21.865242 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:15:21.865242 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:15:21.865242 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:15:21.865242 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:15:21.865242 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:15:21.865242 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:15:21.865242 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 03:15:21.865242 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:15:21.865242 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 14/30] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 4 03:15:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:15:21.865242 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cff4457-f72d-4ff5-9778-1cded32c2e28 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:21.944914 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:21.999476 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8e7b1c-66ca-4fe8-8a2e-f9cbddc342af None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:22.023118 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cff4457-f72d-4ff5-9778-1cded32c2e28 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:22.066092 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfe65b3-20fc-49ff-9041-0b634482523c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:22.068019 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe65b3-20fc-49ff-9041-0b634482523c None admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:22.068681 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe65b3-20fc-49ff-9041-0b634482523c None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:22.069656 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe65b3-20fc-49ff-9041-0b634482523c None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:22.070348 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfe65b3-20fc-49ff-9041-0b634482523c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:22.072583 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfe65b3-20fc-49ff-9041-0b634482523c None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:22.075711 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ee721a-5f1b-4334-8545-4f2a4a0ca5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:22.076845 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ee721a-5f1b-4334-8545-4f2a4a0ca5dc None admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:22.077384 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ee721a-5f1b-4334-8545-4f2a4a0ca5dc None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:22.077881 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ee721a-5f1b-4334-8545-4f2a4a0ca5dc None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:22.078810 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ee721a-5f1b-4334-8545-4f2a4a0ca5dc None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:22.081965 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ee721a-5f1b-4334-8545-4f2a4a0ca5dc None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:22.211604 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 17/31] 10.222.0.25 () {60 vars in 1131 bytes} [Tue Oct 4 03:15:21 2022] POST /identity/v3/roles => generated 219 bytes in 440 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:15:22.213459 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ee721a-5f1b-4334-8545-4f2a4a0ca5dc None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:22.213762 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 15/32] 10.222.0.25 () {60 vars in 1131 bytes} [Tue Oct 4 03:15:21 2022] POST /identity/v3/roles => generated 225 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:15:22.214836 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfe65b3-20fc-49ff-9041-0b634482523c None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:22.364135 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:22.387607 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:22.395262 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfe65b3-20fc-49ff-9041-0b634482523c None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:22.443393 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d391a-62e4-4dd4-a63d-49abd79a204a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:22.444620 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d391a-62e4-4dd4-a63d-49abd79a204a None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:22.445126 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d391a-62e4-4dd4-a63d-49abd79a204a None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:22.446031 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d391a-62e4-4dd4-a63d-49abd79a204a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:22.461797 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ee721a-5f1b-4334-8545-4f2a4a0ca5dc None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:22.469608 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379d391a-62e4-4dd4-a63d-49abd79a204a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:22.471515 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379d391a-62e4-4dd4-a63d-49abd79a204a None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:22.490782 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-379d391a-62e4-4dd4-a63d-49abd79a204a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:15:22.490782 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:15:22.490782 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:15:22.490782 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:15:22.490782 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:15:22.490782 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:15:22.490782 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:15:22.490782 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:15:22.490782 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:15:22.490782 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:15:22.490782 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:15:22.490782 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:15:22.490782 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 03:15:22.490782 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 03:15:22.490782 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 03:15:22.490782 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 03:15:22.491829 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:15:22.491829 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:15:22.491829 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:15:22.491829 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:15:22.491829 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:15:22.491829 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:15:22.491829 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:15:22.491829 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:15:22.491829 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:15:22.491829 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:15:22.491829 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:15:22.491829 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:15:22.491829 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:15:22.491829 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:15:22.491829 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:15:22.491829 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:15:22.491829 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 03:15:22.492621 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 03:15:22.492621 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:15:22.492621 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:15:22.494874 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 16/33] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:15:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:15:22.503771 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d391a-62e4-4dd4-a63d-49abd79a204a None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:22.530360 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707e02fe-df9b-48f9-b276-1621a0abf7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:22.531336 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e02fe-df9b-48f9-b276-1621a0abf7ab None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:22.531867 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e02fe-df9b-48f9-b276-1621a0abf7ab None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:22.532379 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e02fe-df9b-48f9-b276-1621a0abf7ab None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:22.533273 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707e02fe-df9b-48f9-b276-1621a0abf7ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:15:22.533781 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707e02fe-df9b-48f9-b276-1621a0abf7ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:22.535549 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707e02fe-df9b-48f9-b276-1621a0abf7ab None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:22.550414 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 18/34] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 03:15:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:22.556840 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707e02fe-df9b-48f9-b276-1621a0abf7ab None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:22.652695 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d391a-62e4-4dd4-a63d-49abd79a204a None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:22.703893 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707e02fe-df9b-48f9-b276-1621a0abf7ab None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:22.704441 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26e5416-7ba3-4a2a-b23d-c22f4fdae519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:22.705309 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e5416-7ba3-4a2a-b23d-c22f4fdae519 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:22.705786 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e5416-7ba3-4a2a-b23d-c22f4fdae519 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:22.706273 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e5416-7ba3-4a2a-b23d-c22f4fdae519 None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:22.707118 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26e5416-7ba3-4a2a-b23d-c22f4fdae519 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:15:22.707658 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26e5416-7ba3-4a2a-b23d-c22f4fdae519 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:22.709258 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26e5416-7ba3-4a2a-b23d-c22f4fdae519 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:22.724754 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 17/35] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 03:15:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:22.731677 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26e5416-7ba3-4a2a-b23d-c22f4fdae519 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:22.734928 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:22.747208 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b0e89f-d7ac-4bfd-b29b-bcb30f59e770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:22.747881 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b0e89f-d7ac-4bfd-b29b-bcb30f59e770 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:22.748167 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b0e89f-d7ac-4bfd-b29b-bcb30f59e770 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:22.748449 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b0e89f-d7ac-4bfd-b29b-bcb30f59e770 None admin] PATH_INFO: `/v3/users/7c1281e81e9c4e3da30715cc2f1b3156` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:22.749642 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:22.751078 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b0e89f-d7ac-4bfd-b29b-bcb30f59e770 None admin] RBAC: Authorizing `identity:get_user(user_id=7c1281e81e9c4e3da30715cc2f1b3156)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:22.753475 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b0e89f-d7ac-4bfd-b29b-bcb30f59e770 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:22.758169 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 19/36] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 03:15:22 2022] GET /identity/v3/users/7c1281e81e9c4e3da30715cc2f1b3156 => generated 247 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:22.761811 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b0e89f-d7ac-4bfd-b29b-bcb30f59e770 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:22.886644 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26e5416-7ba3-4a2a-b23d-c22f4fdae519 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:22.899212 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b0e89f-d7ac-4bfd-b29b-bcb30f59e770 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:22.939828 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a903d3-2623-49c2-b3d2-b53a44fcde5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:22.940466 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a903d3-2623-49c2-b3d2-b53a44fcde5b None admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:22.940738 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a903d3-2623-49c2-b3d2-b53a44fcde5b None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:22.941017 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a903d3-2623-49c2-b3d2-b53a44fcde5b None admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:22.942110 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a903d3-2623-49c2-b3d2-b53a44fcde5b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:22.944263 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a903d3-2623-49c2-b3d2-b53a44fcde5b None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:22.948481 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07adf7c1-2ebb-4a4e-80c3-13d4384a194b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:22.949436 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07adf7c1-2ebb-4a4e-80c3-13d4384a194b None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:22.950189 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07adf7c1-2ebb-4a4e-80c3-13d4384a194b None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:22.951132 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07adf7c1-2ebb-4a4e-80c3-13d4384a194b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:22.952759 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07adf7c1-2ebb-4a4e-80c3-13d4384a194b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:22.954432 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07adf7c1-2ebb-4a4e-80c3-13d4384a194b None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:22.961955 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 20/37] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:15:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:15:22.963222 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07adf7c1-2ebb-4a4e-80c3-13d4384a194b None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:22.984259 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 18/38] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Oct 4 03:15:22 2022] POST /identity/v3/projects => generated 301 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:15:22.985507 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62689a1e-2d47-46b0-9674-2f89353e69b6 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:22.985802 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62689a1e-2d47-46b0-9674-2f89353e69b6 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:22.986084 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62689a1e-2d47-46b0-9674-2f89353e69b6 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:22.987357 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 19/39] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:15:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:15:22.988460 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9473f46e-bed3-4800-8cf2-107a0a69dde8 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:22.988751 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9473f46e-bed3-4800-8cf2-107a0a69dde8 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:22.989027 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9473f46e-bed3-4800-8cf2-107a0a69dde8 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:22.990539 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 20/40] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:15:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:15:22.993375 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21209c3a-a915-4fe4-947c-f76c20828642 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:22.993706 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21209c3a-a915-4fe4-947c-f76c20828642 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:22.994538 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21209c3a-a915-4fe4-947c-f76c20828642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:23.014796 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-21209c3a-a915-4fe4-947c-f76c20828642 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:15:23.016442 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-21209c3a-a915-4fe4-947c-f76c20828642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:15:23.047924 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:23.080744 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:23.094984 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 21/41] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:15:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 03:15:23.096874 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa44eaa-c727-4fa6-880f-80606c78ce1f None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:23.097455 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa44eaa-c727-4fa6-880f-80606c78ce1f None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:23.097970 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa44eaa-c727-4fa6-880f-80606c78ce1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:23.119405 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-5aa44eaa-c727-4fa6-880f-80606c78ce1f None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:15:23.121087 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-5aa44eaa-c727-4fa6-880f-80606c78ce1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:15:23.205653 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 22/42] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:15:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 03:15:23.216018 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07adf7c1-2ebb-4a4e-80c3-13d4384a194b None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:23.254014 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4b0d75-6a03-405f-9205-d84990d12853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:23.254598 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b0d75-6a03-405f-9205-d84990d12853 None admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:23.254883 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b0d75-6a03-405f-9205-d84990d12853 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:23.255161 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b0d75-6a03-405f-9205-d84990d12853 None admin] PATH_INFO: `/v3/domains/default/users/7c1281e81e9c4e3da30715cc2f1b3156/roles/fe9379cda35c4ff78576fe48b60bea3c` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:23.257244 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4b0d75-6a03-405f-9205-d84990d12853 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=7c1281e81e9c4e3da30715cc2f1b3156, role_id=fe9379cda35c4ff78576fe48b60bea3c)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:23.258793 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4b0d75-6a03-405f-9205-d84990d12853 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:23.276772 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 21/43] 10.222.0.25 () {58 vars in 1361 bytes} [Tue Oct 4 03:15:22 2022] PUT /identity/v3/domains/default/users/7c1281e81e9c4e3da30715cc2f1b3156/roles/fe9379cda35c4ff78576fe48b60bea3c => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 03:15:23.364163 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa44eaa-c727-4fa6-880f-80606c78ce1f None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:23.474161 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa44eaa-c727-4fa6-880f-80606c78ce1f None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:23.486221 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4b0d75-6a03-405f-9205-d84990d12853 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:23.497547 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:23.517524 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c38b5e-7a61-40c9-b29c-a0c2d6bae276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:23.518078 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c38b5e-7a61-40c9-b29c-a0c2d6bae276 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:23.518359 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c38b5e-7a61-40c9-b29c-a0c2d6bae276 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:23.518633 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c38b5e-7a61-40c9-b29c-a0c2d6bae276 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:23.520506 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c38b5e-7a61-40c9-b29c-a0c2d6bae276 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:23.522286 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c38b5e-7a61-40c9-b29c-a0c2d6bae276 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:23.524408 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 23/44] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:15:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:23.530143 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c38b5e-7a61-40c9-b29c-a0c2d6bae276 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:23.595016 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4b0d75-6a03-405f-9205-d84990d12853 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:23.618480 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:23.631683 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ba03d4-460c-4d8c-bd81-999ffe50244a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:23.632302 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba03d4-460c-4d8c-bd81-999ffe50244a None admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:23.632589 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba03d4-460c-4d8c-bd81-999ffe50244a None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:23.632882 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba03d4-460c-4d8c-bd81-999ffe50244a None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:23.633557 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ba03d4-460c-4d8c-bd81-999ffe50244a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:23.636072 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ba03d4-460c-4d8c-bd81-999ffe50244a None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:23.648971 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c38b5e-7a61-40c9-b29c-a0c2d6bae276 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:23.652388 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 22/45] 10.222.0.25 () {60 vars in 1131 bytes} [Tue Oct 4 03:15:23 2022] POST /identity/v3/roles => generated 223 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 03:15:23.689614 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830632df-a217-492c-baea-75cfb606c8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:23.690326 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830632df-a217-492c-baea-75cfb606c8e0 None admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:23.690681 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830632df-a217-492c-baea-75cfb606c8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:23.691022 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830632df-a217-492c-baea-75cfb606c8e0 None admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:23.691825 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830632df-a217-492c-baea-75cfb606c8e0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:23.693372 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830632df-a217-492c-baea-75cfb606c8e0 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:23.723259 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 24/46] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Oct 4 03:15:23 2022] POST /identity/v3/projects => generated 312 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:15:25.464303 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503b3cc-7210-406c-9283-fb8aaf22dbbc None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:25.464842 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503b3cc-7210-406c-9283-fb8aaf22dbbc None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:25.464842 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503b3cc-7210-406c-9283-fb8aaf22dbbc None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:25.466198 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 23/47] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:15:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:15:25.471579 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c9175-3632-498d-972e-38ec1f8cea79 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:25.471986 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c9175-3632-498d-972e-38ec1f8cea79 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:25.472144 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c9175-3632-498d-972e-38ec1f8cea79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:25.497658 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-763c9175-3632-498d-972e-38ec1f8cea79 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:15:25.498895 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-763c9175-3632-498d-972e-38ec1f8cea79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:15:25.534395 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:25.569139 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 25/48] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:15:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 03:15:25.852553 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1503b3cc-7210-406c-9283-fb8aaf22dbbc None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:25.877380 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a605a12d-d64e-4583-a20c-cb6825d7cb7e None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:25.877670 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a605a12d-d64e-4583-a20c-cb6825d7cb7e None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:25.877947 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a605a12d-d64e-4583-a20c-cb6825d7cb7e None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:25.879423 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 26/49] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:15:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 03:15:25.883983 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f51ec63-dbec-4225-be34-38524a735668 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:25.884321 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f51ec63-dbec-4225-be34-38524a735668 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:25.884756 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f51ec63-dbec-4225-be34-38524a735668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:25.961773 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1503b3cc-7210-406c-9283-fb8aaf22dbbc None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:25.999622 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2af35b-f112-4295-a227-493ebb7d8935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:26.000261 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2af35b-f112-4295-a227-493ebb7d8935 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:26.000546 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2af35b-f112-4295-a227-493ebb7d8935 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:26.000826 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2af35b-f112-4295-a227-493ebb7d8935 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:26.008727 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-6f51ec63-dbec-4225-be34-38524a735668 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:15:26.009987 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-6f51ec63-dbec-4225-be34-38524a735668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:15:26.011437 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2af35b-f112-4295-a227-493ebb7d8935 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:15:26.016308 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-4f2af35b-f112-4295-a227-493ebb7d8935 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 03:15:26.016308 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:15:26.016308 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:15:26.016308 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:15:26.016308 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:15:26.016308 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:15:26.016308 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:15:26.016308 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:15:26.016308 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:15:26.016308 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:15:26.016308 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:15:26.016308 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:15:26.016308 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:15:26.016308 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:15:26.016308 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:15:26.016308 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:15:26.017250 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:15:26.017250 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:15:26.017250 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:15:26.017250 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:15:26.017250 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:15:26.017250 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:15:26.017250 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:15:26.017250 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:15:26.017250 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:15:26.017250 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:15:26.017250 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:15:26.017250 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:15:26.017250 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:15:26.017250 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:15:26.017250 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:15:26.017250 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:15:26.018031 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:15:26.018031 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:15:26.018031 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:15:26.018031 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:15:26.018031 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:15:26.018031 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:15:26.018031 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:15:26.018031 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:15:26.018031 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:15:26.018031 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:15:26.018031 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 03:15:26.018031 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:15:26.018031 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 24/50] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 4 03:15:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:15:26.025017 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2af35b-f112-4295-a227-493ebb7d8935 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:26.069282 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:26.080319 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 27/51] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:15:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 03:15:26.126888 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2af35b-f112-4295-a227-493ebb7d8935 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:26.160808 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5eef6e-3b80-49ff-903e-b35b7760ca6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:26.161405 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5eef6e-3b80-49ff-903e-b35b7760ca6a None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:26.161686 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5eef6e-3b80-49ff-903e-b35b7760ca6a None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:26.161961 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5eef6e-3b80-49ff-903e-b35b7760ca6a None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:26.162618 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5eef6e-3b80-49ff-903e-b35b7760ca6a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:15:26.162922 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5eef6e-3b80-49ff-903e-b35b7760ca6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:26.164324 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5eef6e-3b80-49ff-903e-b35b7760ca6a None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:26.172676 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 25/52] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 03:15:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:15:26.178330 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f51ec63-dbec-4225-be34-38524a735668 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:26.274415 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:26.277869 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f51ec63-dbec-4225-be34-38524a735668 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:26.311087 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e952b39e-2a2b-45c3-a1e3-35a57a1c8ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:26.311756 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e952b39e-2a2b-45c3-a1e3-35a57a1c8ab4 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:26.312042 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e952b39e-2a2b-45c3-a1e3-35a57a1c8ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:26.312322 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e952b39e-2a2b-45c3-a1e3-35a57a1c8ab4 None admin] PATH_INFO: `/v3/users/7c1281e81e9c4e3da30715cc2f1b3156` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:26.313667 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e952b39e-2a2b-45c3-a1e3-35a57a1c8ab4 None admin] RBAC: Authorizing `identity:get_user(user_id=7c1281e81e9c4e3da30715cc2f1b3156)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:26.315106 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e952b39e-2a2b-45c3-a1e3-35a57a1c8ab4 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:26.316703 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 28/53] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 03:15:26 2022] GET /identity/v3/users/7c1281e81e9c4e3da30715cc2f1b3156 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:26.323323 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5eef6e-3b80-49ff-903e-b35b7760ca6a None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:26.353244 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e952b39e-2a2b-45c3-a1e3-35a57a1c8ab4 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:26.421776 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5eef6e-3b80-49ff-903e-b35b7760ca6a None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:26.423959 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:26.456023 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c59ea5-d696-4408-9ce4-138af212126a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:26.456385 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e952b39e-2a2b-45c3-a1e3-35a57a1c8ab4 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:26.456652 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c59ea5-d696-4408-9ce4-138af212126a None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:26.456935 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c59ea5-d696-4408-9ce4-138af212126a None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:26.457212 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c59ea5-d696-4408-9ce4-138af212126a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:26.458326 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c59ea5-d696-4408-9ce4-138af212126a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:26.459794 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c59ea5-d696-4408-9ce4-138af212126a None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:26.461519 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 26/54] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:15:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:26.467236 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c59ea5-d696-4408-9ce4-138af212126a None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:26.490118 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd28f32d-9832-4477-91ad-28998740011c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:26.490740 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd28f32d-9832-4477-91ad-28998740011c None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:26.491018 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd28f32d-9832-4477-91ad-28998740011c None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:26.491291 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd28f32d-9832-4477-91ad-28998740011c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:26.492437 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd28f32d-9832-4477-91ad-28998740011c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:26.494371 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd28f32d-9832-4477-91ad-28998740011c None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:26.496087 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 29/55] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:15:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:15:26.501494 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd28f32d-9832-4477-91ad-28998740011c None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:26.536536 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:26.566742 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c59ea5-d696-4408-9ce4-138af212126a None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:26.600903 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f516cb-ddf8-459e-a9d3-f9356db992ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:26.601508 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f516cb-ddf8-459e-a9d3-f9356db992ae None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:26.601796 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f516cb-ddf8-459e-a9d3-f9356db992ae None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:26.601986 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd28f32d-9832-4477-91ad-28998740011c None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:26.602074 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f516cb-ddf8-459e-a9d3-f9356db992ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:26.602786 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f516cb-ddf8-459e-a9d3-f9356db992ae None admin] RBAC: Adding query filter params (role.id=fe9379cda35c4ff78576fe48b60bea3c, scope.domain.id=default, user.id=7c1281e81e9c4e3da30715cc2f1b3156) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:15:26.603759 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f516cb-ddf8-459e-a9d3-f9356db992ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:26.605400 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f516cb-ddf8-459e-a9d3-f9356db992ae None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:26.611215 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 27/56] 10.222.0.25 () {56 vars in 1322 bytes} [Tue Oct 4 03:15:26 2022] GET /identity/v3/role_assignments?user.id=7c1281e81e9c4e3da30715cc2f1b3156&scope.domain.id=default&role.id=fe9379cda35c4ff78576fe48b60bea3c => generated 530 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:15:26.640061 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce1eaf1-b23f-4513-ac03-d10131833d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:26.640707 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce1eaf1-b23f-4513-ac03-d10131833d54 None admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:26.640993 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce1eaf1-b23f-4513-ac03-d10131833d54 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:26.641276 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce1eaf1-b23f-4513-ac03-d10131833d54 None admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:26.641952 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce1eaf1-b23f-4513-ac03-d10131833d54 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:26.643432 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce1eaf1-b23f-4513-ac03-d10131833d54 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:26.673228 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 30/57] 10.222.0.25 () {60 vars in 1140 bytes} [Tue Oct 4 03:15:26 2022] POST /identity/v3/projects => generated 298 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 03:15:28.838110 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ffb829-f873-4e70-a5a9-29e8221ae5f9 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:28.838615 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ffb829-f873-4e70-a5a9-29e8221ae5f9 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:28.838698 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ffb829-f873-4e70-a5a9-29e8221ae5f9 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:28.840051 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 28/58] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:15:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:15:28.845110 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f7511-495a-4cfb-996c-e10e5baeac29 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:28.845540 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f7511-495a-4cfb-996c-e10e5baeac29 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:28.845670 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f7511-495a-4cfb-996c-e10e5baeac29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:28.863946 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-ae9f7511-495a-4cfb-996c-e10e5baeac29 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:15:28.865120 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-ae9f7511-495a-4cfb-996c-e10e5baeac29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:15:28.928965 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 31/59] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:15:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 03:15:29.207205 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ffb829-f873-4e70-a5a9-29e8221ae5f9 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:29.247636 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:29.317596 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ffb829-f873-4e70-a5a9-29e8221ae5f9 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:29.351226 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7332a18-c936-46be-a02a-11ebf8817170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:29.351875 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7332a18-c936-46be-a02a-11ebf8817170 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:29.352159 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7332a18-c936-46be-a02a-11ebf8817170 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:29.352437 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7332a18-c936-46be-a02a-11ebf8817170 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:29.354042 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7332a18-c936-46be-a02a-11ebf8817170 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:29.355883 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7332a18-c936-46be-a02a-11ebf8817170 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:29.357446 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 29/60] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:15:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:29.363006 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9f7511-495a-4cfb-996c-e10e5baeac29 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:29.381177 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:29.461142 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9f7511-495a-4cfb-996c-e10e5baeac29 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:29.493288 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1755773d-dc57-4770-a212-7467ac53b764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:29.494670 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755773d-dc57-4770-a212-7467ac53b764 None admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:29.494959 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755773d-dc57-4770-a212-7467ac53b764 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:29.495239 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755773d-dc57-4770-a212-7467ac53b764 None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:29.495928 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1755773d-dc57-4770-a212-7467ac53b764 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:29.497359 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1755773d-dc57-4770-a212-7467ac53b764 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:29.524211 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 32/61] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Oct 4 03:15:29 2022] POST /identity/v3/users => generated 275 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:15:32.842299 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308e649-959e-47e9-8c07-486dcf785c14 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:32.843287 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308e649-959e-47e9-8c07-486dcf785c14 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:32.843811 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308e649-959e-47e9-8c07-486dcf785c14 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:32.845905 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 30/62] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:15:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:15:32.851240 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad319a-f217-49fb-b014-05967f5e94e0 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:32.851710 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad319a-f217-49fb-b014-05967f5e94e0 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:32.851830 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad319a-f217-49fb-b014-05967f5e94e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:32.881336 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-8bad319a-f217-49fb-b014-05967f5e94e0 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:15:32.882831 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-8bad319a-f217-49fb-b014-05967f5e94e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:15:32.951245 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6415c356-ccf5-4bc1-81cc-3d739bee4068 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:32.951860 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6415c356-ccf5-4bc1-81cc-3d739bee4068 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:32.952331 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6415c356-ccf5-4bc1-81cc-3d739bee4068 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:32.954095 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 31/63] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:15:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:15:32.959433 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c53bba-3aa6-4d12-a7a6-a279fcdd4d8a None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:32.959986 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c53bba-3aa6-4d12-a7a6-a279fcdd4d8a None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:32.960456 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c53bba-3aa6-4d12-a7a6-a279fcdd4d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:32.981800 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 33/64] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:15:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 03:15:32.992844 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-e8c53bba-3aa6-4d12-a7a6-a279fcdd4d8a None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:15:32.995386 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-e8c53bba-3aa6-4d12-a7a6-a279fcdd4d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:15:33.090181 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 32/65] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:15:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 03:15:33.120268 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a18418-8662-415c-b3ca-6a25390bab92 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:33.120559 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a18418-8662-415c-b3ca-6a25390bab92 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:33.120837 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a18418-8662-415c-b3ca-6a25390bab92 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:33.122193 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 34/66] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:15:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:15:33.127655 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9c9d3d-064a-4056-bd22-2c3ab3181ea7 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:33.127949 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9c9d3d-064a-4056-bd22-2c3ab3181ea7 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:33.128231 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9c9d3d-064a-4056-bd22-2c3ab3181ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:33.154112 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-6d9c9d3d-064a-4056-bd22-2c3ab3181ea7 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:15:33.155312 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-6d9c9d3d-064a-4056-bd22-2c3ab3181ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:15:33.192032 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:33.245711 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 33/67] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:15:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 03:15:33.401882 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a18418-8662-415c-b3ca-6a25390bab92 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:33.406494 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:33.410445 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95a08e-48ff-4bae-b8b4-0928257e2270 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:33.411001 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95a08e-48ff-4bae-b8b4-0928257e2270 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:33.411525 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95a08e-48ff-4bae-b8b4-0928257e2270 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:33.413064 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 34/68] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:15:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:15:33.414031 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa95a08e-48ff-4bae-b8b4-0928257e2270 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:33.532319 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a18418-8662-415c-b3ca-6a25390bab92 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:33.535379 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa95a08e-48ff-4bae-b8b4-0928257e2270 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:33.571964 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f50eb22-dd04-4383-86d4-9af76b602252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:33.573097 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f50eb22-dd04-4383-86d4-9af76b602252 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:33.573464 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28296743-4c3a-4e50-9472-a8e7f9478250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:33.573597 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f50eb22-dd04-4383-86d4-9af76b602252 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:33.573789 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f50eb22-dd04-4383-86d4-9af76b602252 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:33.574693 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28296743-4c3a-4e50-9472-a8e7f9478250 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:33.575179 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28296743-4c3a-4e50-9472-a8e7f9478250 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:33.575662 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28296743-4c3a-4e50-9472-a8e7f9478250 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:33.585950 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f50eb22-dd04-4383-86d4-9af76b602252 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:15:33.586938 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28296743-4c3a-4e50-9472-a8e7f9478250 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:15:33.591325 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-7f50eb22-dd04-4383-86d4-9af76b602252 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 03:15:33.591325 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:15:33.591325 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:15:33.591325 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:15:33.591325 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:15:33.591325 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:15:33.591325 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:15:33.591325 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:15:33.591325 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:15:33.591325 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:15:33.591325 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:15:33.591325 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:15:33.591325 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:15:33.591325 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:15:33.591325 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:15:33.591325 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:15:33.592197 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:15:33.592197 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:15:33.592197 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:15:33.592197 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:15:33.592197 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:15:33.592197 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:15:33.592197 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:15:33.592197 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:15:33.592197 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:15:33.592197 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:15:33.592197 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:15:33.592197 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:15:33.592197 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:15:33.592197 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:15:33.592197 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:15:33.592197 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:15:33.592933 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:15:33.592933 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:15:33.592933 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:15:33.592933 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:15:33.592933 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:15:33.592933 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:15:33.592933 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:15:33.592933 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:15:33.592933 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:15:33.592933 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:15:33.592933 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 03:15:33.592933 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:15:33.593509 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-28296743-4c3a-4e50-9472-a8e7f9478250 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 03:15:33.593509 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:15:33.593509 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:15:33.593509 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:15:33.593509 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:15:33.593509 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:15:33.593509 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:15:33.593509 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:15:33.593509 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:15:33.593509 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:15:33.593509 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:15:33.593509 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:15:33.593509 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:15:33.593509 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:15:33.593509 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:15:33.593509 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:15:33.594230 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:15:33.594230 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:15:33.594230 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:15:33.594230 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:15:33.594230 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:15:33.594230 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:15:33.594230 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:15:33.594230 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:15:33.594230 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:15:33.594230 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:15:33.594230 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:15:33.594230 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:15:33.594230 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:15:33.594230 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:15:33.594230 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:15:33.594230 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:15:33.594966 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:15:33.594966 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:15:33.594966 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:15:33.594966 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:15:33.594966 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:15:33.594966 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:15:33.594966 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:15:33.594966 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:15:33.594966 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:15:33.594966 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:15:33.594966 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 03:15:33.594966 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:15:33.596653 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 35/69] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 4 03:15:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:15:33.596821 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 35/70] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 03:15:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:15:33.596821 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28296743-4c3a-4e50-9472-a8e7f9478250 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:33.601536 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f090f243-4769-4a69-a647-3be972ee4a28 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:33.601536 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f090f243-4769-4a69-a647-3be972ee4a28 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:33.601536 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f090f243-4769-4a69-a647-3be972ee4a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:33.619147 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-f090f243-4769-4a69-a647-3be972ee4a28 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:15:33.620698 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-f090f243-4769-4a69-a647-3be972ee4a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:15:33.620830 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:33.683207 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:33.691874 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 36/71] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:15:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 03:15:33.692683 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f090f243-4769-4a69-a647-3be972ee4a28 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:33.697377 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28296743-4c3a-4e50-9472-a8e7f9478250 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:33.731621 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f628b45-0ca4-4293-a0f8-6a2862aa6b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:33.732252 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f628b45-0ca4-4293-a0f8-6a2862aa6b97 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:33.732537 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f628b45-0ca4-4293-a0f8-6a2862aa6b97 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:33.732815 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f628b45-0ca4-4293-a0f8-6a2862aa6b97 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:33.744703 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f628b45-0ca4-4293-a0f8-6a2862aa6b97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:15:33.749927 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-3f628b45-0ca4-4293-a0f8-6a2862aa6b97 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 03:15:33.749927 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:15:33.749927 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:15:33.749927 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:15:33.749927 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:15:33.749927 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:15:33.749927 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:15:33.749927 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:15:33.749927 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:15:33.749927 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:15:33.749927 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:15:33.749927 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:15:33.749927 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:15:33.749927 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:15:33.749927 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:15:33.749927 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:15:33.750735 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:15:33.750735 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:15:33.750735 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:15:33.750735 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:15:33.750735 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:15:33.750735 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:15:33.750735 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:15:33.750735 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:15:33.750735 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:15:33.750735 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:15:33.750735 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:15:33.750735 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:15:33.750735 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:15:33.750735 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:15:33.750735 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:15:33.750735 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:15:33.751659 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:15:33.751659 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:15:33.751659 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:15:33.751659 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:15:33.751659 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:15:33.751659 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:15:33.751659 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:15:33.751659 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:15:33.751659 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:15:33.751659 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:15:33.751659 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 03:15:33.751659 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:15:33.752740 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 36/72] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Oct 4 03:15:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:15:33.753488 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f628b45-0ca4-4293-a0f8-6a2862aa6b97 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:33.802122 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f090f243-4769-4a69-a647-3be972ee4a28 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:33.839973 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916c8063-d57e-4df0-bcc7-cb01f709304f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:33.840746 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c8063-d57e-4df0-bcc7-cb01f709304f None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:33.841036 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c8063-d57e-4df0-bcc7-cb01f709304f None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:33.841314 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c8063-d57e-4df0-bcc7-cb01f709304f None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:33.841980 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916c8063-d57e-4df0-bcc7-cb01f709304f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:15:33.842286 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916c8063-d57e-4df0-bcc7-cb01f709304f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:33.842876 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:33.844473 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916c8063-d57e-4df0-bcc7-cb01f709304f None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:33.857742 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 37/73] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 03:15:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:33.858712 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de715c-f20a-4d2a-abc3-3ba2ffa7d189 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:33.859003 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de715c-f20a-4d2a-abc3-3ba2ffa7d189 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:33.859281 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de715c-f20a-4d2a-abc3-3ba2ffa7d189 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:33.860666 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 38/74] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:15:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:15:33.861206 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3de715c-f20a-4d2a-abc3-3ba2ffa7d189 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:33.864248 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f628b45-0ca4-4293-a0f8-6a2862aa6b97 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:33.900725 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58151b82-bc1f-473c-9c5d-072d1d5f8a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:33.901383 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58151b82-bc1f-473c-9c5d-072d1d5f8a36 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:33.901676 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58151b82-bc1f-473c-9c5d-072d1d5f8a36 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:33.901957 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58151b82-bc1f-473c-9c5d-072d1d5f8a36 None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:33.902629 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58151b82-bc1f-473c-9c5d-072d1d5f8a36 None admin] RBAC: Adding query filter params (name=member) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:15:33.902937 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58151b82-bc1f-473c-9c5d-072d1d5f8a36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:33.904374 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58151b82-bc1f-473c-9c5d-072d1d5f8a36 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:33.912545 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 37/75] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Oct 4 03:15:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:33.916500 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58151b82-bc1f-473c-9c5d-072d1d5f8a36 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:33.928663 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:33.978175 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3de715c-f20a-4d2a-abc3-3ba2ffa7d189 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:34.014020 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0335cd-4fc0-4bf6-9978-ede81dfa9983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:34.014629 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0335cd-4fc0-4bf6-9978-ede81dfa9983 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:34.014915 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0335cd-4fc0-4bf6-9978-ede81dfa9983 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:34.015202 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0335cd-4fc0-4bf6-9978-ede81dfa9983 None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:34.015908 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0335cd-4fc0-4bf6-9978-ede81dfa9983 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:15:34.016222 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0335cd-4fc0-4bf6-9978-ede81dfa9983 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:34.017618 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0335cd-4fc0-4bf6-9978-ede81dfa9983 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:34.020944 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58151b82-bc1f-473c-9c5d-072d1d5f8a36 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:34.025650 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 39/76] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 03:15:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:34.026802 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ef4cf-896c-4081-b57b-cf3f7abf5287 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:34.027089 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ef4cf-896c-4081-b57b-cf3f7abf5287 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:34.027364 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ef4cf-896c-4081-b57b-cf3f7abf5287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:34.045011 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-427ef4cf-896c-4081-b57b-cf3f7abf5287 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:15:34.046213 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-427ef4cf-896c-4081-b57b-cf3f7abf5287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:15:34.057880 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476b7fd4-7848-422a-ac7b-07ee5bc0cff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:34.058453 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b7fd4-7848-422a-ac7b-07ee5bc0cff7 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:34.058738 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b7fd4-7848-422a-ac7b-07ee5bc0cff7 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:34.059017 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b7fd4-7848-422a-ac7b-07ee5bc0cff7 None admin] PATH_INFO: `/v3/users/7c1281e81e9c4e3da30715cc2f1b3156` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:34.060193 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476b7fd4-7848-422a-ac7b-07ee5bc0cff7 None admin] RBAC: Authorizing `identity:get_user(user_id=7c1281e81e9c4e3da30715cc2f1b3156)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:34.061653 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476b7fd4-7848-422a-ac7b-07ee5bc0cff7 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:34.063239 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 38/77] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 03:15:33 2022] GET /identity/v3/users/7c1281e81e9c4e3da30715cc2f1b3156 => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:34.064041 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476b7fd4-7848-422a-ac7b-07ee5bc0cff7 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:34.079854 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:34.112191 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 40/78] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:15:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 03:15:34.113029 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427ef4cf-896c-4081-b57b-cf3f7abf5287 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:34.160872 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:34.183708 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476b7fd4-7848-422a-ac7b-07ee5bc0cff7 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:34.213808 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427ef4cf-896c-4081-b57b-cf3f7abf5287 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:34.218288 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e790661e-1065-497a-9536-c5e4dd7ca096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:34.218920 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e790661e-1065-497a-9536-c5e4dd7ca096 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:34.219209 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e790661e-1065-497a-9536-c5e4dd7ca096 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:34.219500 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e790661e-1065-497a-9536-c5e4dd7ca096 None admin] PATH_INFO: `/v3/users/b72c77a1143648e58bef98b7bb2677d1` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:34.234710 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e790661e-1065-497a-9536-c5e4dd7ca096 None admin] RBAC: Authorizing `identity:get_user(user_id=b72c77a1143648e58bef98b7bb2677d1)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:34.236219 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e790661e-1065-497a-9536-c5e4dd7ca096 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:34.242482 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 39/79] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 03:15:34 2022] GET /identity/v3/users/b72c77a1143648e58bef98b7bb2677d1 => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:34.242482 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e790661e-1065-497a-9536-c5e4dd7ca096 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:34.253200 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b699abd5-655c-4ab3-a31a-893d44831e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:34.253830 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b699abd5-655c-4ab3-a31a-893d44831e97 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:34.254113 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b699abd5-655c-4ab3-a31a-893d44831e97 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:34.254386 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b699abd5-655c-4ab3-a31a-893d44831e97 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:34.255474 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b699abd5-655c-4ab3-a31a-893d44831e97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:34.256941 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b699abd5-655c-4ab3-a31a-893d44831e97 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:34.258486 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 41/80] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:15:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:34.260589 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b699abd5-655c-4ab3-a31a-893d44831e97 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:34.311815 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:34.344875 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e790661e-1065-497a-9536-c5e4dd7ca096 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:34.366446 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b699abd5-655c-4ab3-a31a-893d44831e97 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:34.386921 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b31acb8-4dae-4ccc-9fea-b419bf99e11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:34.387657 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31acb8-4dae-4ccc-9fea-b419bf99e11d None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:34.388000 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31acb8-4dae-4ccc-9fea-b419bf99e11d None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:34.388130 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:34.388278 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31acb8-4dae-4ccc-9fea-b419bf99e11d None admin] PATH_INFO: `/v3/users/b72c77a1143648e58bef98b7bb2677d1` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:34.389605 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b31acb8-4dae-4ccc-9fea-b419bf99e11d None admin] RBAC: Authorizing `identity:get_user(user_id=b72c77a1143648e58bef98b7bb2677d1)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:34.391056 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b31acb8-4dae-4ccc-9fea-b419bf99e11d None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:34.392889 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 40/81] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 03:15:34 2022] GET /identity/v3/users/b72c77a1143648e58bef98b7bb2677d1 => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:34.393705 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b31acb8-4dae-4ccc-9fea-b419bf99e11d None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:34.409230 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1585eb02-3368-418b-b4c5-42f68634732e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:34.409960 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585eb02-3368-418b-b4c5-42f68634732e None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:34.410306 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585eb02-3368-418b-b4c5-42f68634732e None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:34.410650 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585eb02-3368-418b-b4c5-42f68634732e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:34.479034 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1585eb02-3368-418b-b4c5-42f68634732e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:34.480521 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1585eb02-3368-418b-b4c5-42f68634732e None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:34.494047 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b31acb8-4dae-4ccc-9fea-b419bf99e11d None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:34.527562 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21007baa-6112-4719-861c-3132899ad78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:34.528167 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21007baa-6112-4719-861c-3132899ad78f None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:34.528453 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21007baa-6112-4719-861c-3132899ad78f None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:34.528742 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21007baa-6112-4719-861c-3132899ad78f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:34.538745 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:34.580369 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 42/82] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 03:15:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 03:15:34.581195 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1585eb02-3368-418b-b4c5-42f68634732e None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:34.597174 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21007baa-6112-4719-861c-3132899ad78f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:34.598623 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21007baa-6112-4719-861c-3132899ad78f None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:34.599182 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:34.683917 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1585eb02-3368-418b-b4c5-42f68634732e None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:34.699604 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 41/83] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 03:15:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 03:15:34.700446 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21007baa-6112-4719-861c-3132899ad78f None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:34.717713 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c01592f-ecf1-494e-b0fd-4c0b54ac478f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:34.718316 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c01592f-ecf1-494e-b0fd-4c0b54ac478f None admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:34.718597 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c01592f-ecf1-494e-b0fd-4c0b54ac478f None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:34.718873 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c01592f-ecf1-494e-b0fd-4c0b54ac478f None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:34.719540 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c01592f-ecf1-494e-b0fd-4c0b54ac478f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:34.721055 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c01592f-ecf1-494e-b0fd-4c0b54ac478f None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:34.746512 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:34.746706 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 43/84] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Oct 4 03:15:34 2022] POST /identity/v3/users => generated 289 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:15:34.746706 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c01592f-ecf1-494e-b0fd-4c0b54ac478f None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:34.821033 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21007baa-6112-4719-861c-3132899ad78f None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:34.829691 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:34.858594 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddf119f-63a3-4fc1-b8f0-59d697e26137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:34.859246 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf119f-63a3-4fc1-b8f0-59d697e26137 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:34.859562 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf119f-63a3-4fc1-b8f0-59d697e26137 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:34.859842 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf119f-63a3-4fc1-b8f0-59d697e26137 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:34.868523 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c01592f-ecf1-494e-b0fd-4c0b54ac478f None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:34.871181 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddf119f-63a3-4fc1-b8f0-59d697e26137 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:15:34.876229 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-9ddf119f-63a3-4fc1-b8f0-59d697e26137 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 03:15:34.876229 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:15:34.876229 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:15:34.876229 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:15:34.876229 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:15:34.876229 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:15:34.876229 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:15:34.876229 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:15:34.876229 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:15:34.876229 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:15:34.876229 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:15:34.876229 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:15:34.876229 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:15:34.876229 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:15:34.876229 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:15:34.876229 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:15:34.877332 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:15:34.877332 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:15:34.877332 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:15:34.877332 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:15:34.877332 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:15:34.877332 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:15:34.877332 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:15:34.877332 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:15:34.877332 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:15:34.877332 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:15:34.877332 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:15:34.877332 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:15:34.877332 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:15:34.877332 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:15:34.877332 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:15:34.877332 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:15:34.878165 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:15:34.878165 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:15:34.878165 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:15:34.878165 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:15:34.878165 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:15:34.878165 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:15:34.878165 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:15:34.878165 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:15:34.878165 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:15:34.878165 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:15:34.878165 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 03:15:34.878165 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:15:34.878165 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 42/85] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 03:15:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:15:34.879021 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddf119f-63a3-4fc1-b8f0-59d697e26137 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:34.914306 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df0d6d-e1b2-47b5-8877-8a4b746d5117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:34.914930 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df0d6d-e1b2-47b5-8877-8a4b746d5117 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:34.915896 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df0d6d-e1b2-47b5-8877-8a4b746d5117 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:34.916179 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df0d6d-e1b2-47b5-8877-8a4b746d5117 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:34.987952 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:34.992840 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddf119f-63a3-4fc1-b8f0-59d697e26137 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:35.003002 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83df0d6d-e1b2-47b5-8877-8a4b746d5117 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:35.004523 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83df0d6d-e1b2-47b5-8877-8a4b746d5117 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:35.033211 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487fbc7-fd9c-4d7b-9f5e-aee0e2cdb841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:35.034110 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487fbc7-fd9c-4d7b-9f5e-aee0e2cdb841 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:35.034393 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487fbc7-fd9c-4d7b-9f5e-aee0e2cdb841 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:35.034667 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487fbc7-fd9c-4d7b-9f5e-aee0e2cdb841 None admin] PATH_INFO: `/v3/projects/a7dc4038bbe8418c9837b329ac4d2754` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:35.036028 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b487fbc7-fd9c-4d7b-9f5e-aee0e2cdb841 None admin] RBAC: Authorizing `identity:get_project(project_id=a7dc4038bbe8418c9837b329ac4d2754)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:35.038430 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b487fbc7-fd9c-4d7b-9f5e-aee0e2cdb841 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:35.041378 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 43/86] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 03:15:34 2022] GET /identity/v3/projects/a7dc4038bbe8418c9837b329ac4d2754 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:35.042648 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487fbc7-fd9c-4d7b-9f5e-aee0e2cdb841 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:35.108164 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:35.146122 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 44/87] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 03:15:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 03:15:35.147193 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df0d6d-e1b2-47b5-8877-8a4b746d5117 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:35.163759 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487fbc7-fd9c-4d7b-9f5e-aee0e2cdb841 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:35.200045 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9613c54-3e24-4384-8eee-f8ca24497492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:35.200683 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9613c54-3e24-4384-8eee-f8ca24497492 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:35.200970 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9613c54-3e24-4384-8eee-f8ca24497492 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:35.201249 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9613c54-3e24-4384-8eee-f8ca24497492 None admin] PATH_INFO: `/v3/projects/a7dc4038bbe8418c9837b329ac4d2754` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:35.202423 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9613c54-3e24-4384-8eee-f8ca24497492 None admin] RBAC: Authorizing `identity:get_project(project_id=a7dc4038bbe8418c9837b329ac4d2754)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:35.203986 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9613c54-3e24-4384-8eee-f8ca24497492 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:35.205885 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 44/88] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 03:15:35 2022] GET /identity/v3/projects/a7dc4038bbe8418c9837b329ac4d2754 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:35.206492 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9613c54-3e24-4384-8eee-f8ca24497492 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:35.254392 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:35.274965 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df0d6d-e1b2-47b5-8877-8a4b746d5117 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:35.316596 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058e8a3d-4bd4-44f6-b27f-7ed0f168c405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:35.317795 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e8a3d-4bd4-44f6-b27f-7ed0f168c405 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:35.318297 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e8a3d-4bd4-44f6-b27f-7ed0f168c405 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:35.319198 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e8a3d-4bd4-44f6-b27f-7ed0f168c405 None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:35.320579 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058e8a3d-4bd4-44f6-b27f-7ed0f168c405 None admin] RBAC: Adding query filter params (name=member) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:15:35.321176 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058e8a3d-4bd4-44f6-b27f-7ed0f168c405 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:35.322877 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058e8a3d-4bd4-44f6-b27f-7ed0f168c405 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:35.325140 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9613c54-3e24-4384-8eee-f8ca24497492 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:35.333381 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 45/89] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Oct 4 03:15:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:35.334620 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058e8a3d-4bd4-44f6-b27f-7ed0f168c405 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:35.363403 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3257c7c8-759a-4fbf-91ae-501b1a3d8da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:35.364146 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3257c7c8-759a-4fbf-91ae-501b1a3d8da3 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:35.364439 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3257c7c8-759a-4fbf-91ae-501b1a3d8da3 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:35.364718 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3257c7c8-759a-4fbf-91ae-501b1a3d8da3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:35.365456 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3257c7c8-759a-4fbf-91ae-501b1a3d8da3 None admin] RBAC: Adding query filter params (role.id=fe9379cda35c4ff78576fe48b60bea3c, scope.project.id=a7dc4038bbe8418c9837b329ac4d2754, user.id=7c1281e81e9c4e3da30715cc2f1b3156) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:15:35.365770 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3257c7c8-759a-4fbf-91ae-501b1a3d8da3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:35.367242 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3257c7c8-759a-4fbf-91ae-501b1a3d8da3 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:35.374036 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 45/90] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 03:15:35 2022] GET /identity/v3/role_assignments?user.id=7c1281e81e9c4e3da30715cc2f1b3156&scope.project.id=a7dc4038bbe8418c9837b329ac4d2754&role.id=fe9379cda35c4ff78576fe48b60bea3c => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:35.380102 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3257c7c8-759a-4fbf-91ae-501b1a3d8da3 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:35.387959 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:35.455206 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058e8a3d-4bd4-44f6-b27f-7ed0f168c405 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:35.493789 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db145c39-77e4-49c9-b982-d2702f1b1199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:35.494928 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db145c39-77e4-49c9-b982-d2702f1b1199 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:35.496206 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db145c39-77e4-49c9-b982-d2702f1b1199 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:35.496846 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db145c39-77e4-49c9-b982-d2702f1b1199 None admin] PATH_INFO: `/v3/projects/a7dc4038bbe8418c9837b329ac4d2754` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:35.498343 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db145c39-77e4-49c9-b982-d2702f1b1199 None admin] RBAC: Authorizing `identity:get_project(project_id=a7dc4038bbe8418c9837b329ac4d2754)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:35.500300 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db145c39-77e4-49c9-b982-d2702f1b1199 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:35.502388 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 46/91] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 03:15:35 2022] GET /identity/v3/projects/a7dc4038bbe8418c9837b329ac4d2754 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:35.503457 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db145c39-77e4-49c9-b982-d2702f1b1199 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:35.580668 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:35.585904 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3257c7c8-759a-4fbf-91ae-501b1a3d8da3 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:35.624493 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db145c39-77e4-49c9-b982-d2702f1b1199 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:35.666523 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379dbb9e-8fc2-4ffd-b44b-42cda8c5077f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:35.667671 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379dbb9e-8fc2-4ffd-b44b-42cda8c5077f None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:35.668173 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379dbb9e-8fc2-4ffd-b44b-42cda8c5077f None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:35.668714 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379dbb9e-8fc2-4ffd-b44b-42cda8c5077f None admin] PATH_INFO: `/v3/users/b72c77a1143648e58bef98b7bb2677d1` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:35.670180 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379dbb9e-8fc2-4ffd-b44b-42cda8c5077f None admin] RBAC: Authorizing `identity:get_user(user_id=b72c77a1143648e58bef98b7bb2677d1)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:35.672105 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379dbb9e-8fc2-4ffd-b44b-42cda8c5077f None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:35.674134 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 47/92] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 03:15:35 2022] GET /identity/v3/users/b72c77a1143648e58bef98b7bb2677d1 => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:35.675054 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26ada50-dd12-4675-bae7-29da431cf164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:35.675462 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379dbb9e-8fc2-4ffd-b44b-42cda8c5077f None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:35.675677 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ada50-dd12-4675-bae7-29da431cf164 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:35.675968 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ada50-dd12-4675-bae7-29da431cf164 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:35.676252 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ada50-dd12-4675-bae7-29da431cf164 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:35.677000 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26ada50-dd12-4675-bae7-29da431cf164 None admin] RBAC: Adding query filter params (role.id=04d0e4575a28440eb4349b4a6565e8b8, scope.project.id=a7dc4038bbe8418c9837b329ac4d2754, user.id=b72c77a1143648e58bef98b7bb2677d1) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:15:35.677305 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26ada50-dd12-4675-bae7-29da431cf164 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:35.678830 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26ada50-dd12-4675-bae7-29da431cf164 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:35.699526 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 46/93] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 03:15:35 2022] GET /identity/v3/role_assignments?user.id=b72c77a1143648e58bef98b7bb2677d1&scope.project.id=a7dc4038bbe8418c9837b329ac4d2754&role.id=04d0e4575a28440eb4349b4a6565e8b8 => generated 259 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:35.699526 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26ada50-dd12-4675-bae7-29da431cf164 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:35.707610 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:35.881948 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26ada50-dd12-4675-bae7-29da431cf164 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:35.885013 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379dbb9e-8fc2-4ffd-b44b-42cda8c5077f None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:35.918727 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c634d6bd-0141-4bef-b1d0-260bf9952214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:35.919348 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c634d6bd-0141-4bef-b1d0-260bf9952214 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:35.919669 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c634d6bd-0141-4bef-b1d0-260bf9952214 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:35.919952 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c634d6bd-0141-4bef-b1d0-260bf9952214 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:35.966304 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:35.968871 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c337357-8feb-47b2-8d4f-ec8b08dd9ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:35.969556 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c337357-8feb-47b2-8d4f-ec8b08dd9ec9 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:35.969852 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c337357-8feb-47b2-8d4f-ec8b08dd9ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:35.970129 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c337357-8feb-47b2-8d4f-ec8b08dd9ec9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:35.970877 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c337357-8feb-47b2-8d4f-ec8b08dd9ec9 None admin] RBAC: Adding query filter params (role.id=f2332a9a00b74fe0846d7211dd3850cb, scope.project.id=a7dc4038bbe8418c9837b329ac4d2754, user.id=b72c77a1143648e58bef98b7bb2677d1) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:15:35.971187 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c337357-8feb-47b2-8d4f-ec8b08dd9ec9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:35.972679 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c337357-8feb-47b2-8d4f-ec8b08dd9ec9 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:35.996601 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c634d6bd-0141-4bef-b1d0-260bf9952214 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:35.997007 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 48/94] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 03:15:35 2022] GET /identity/v3/role_assignments?user.id=b72c77a1143648e58bef98b7bb2677d1&scope.project.id=a7dc4038bbe8418c9837b329ac4d2754&role.id=f2332a9a00b74fe0846d7211dd3850cb => generated 259 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:35.998114 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c634d6bd-0141-4bef-b1d0-260bf9952214 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:36.111446 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 47/95] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 03:15:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 03:15:36.117226 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c337357-8feb-47b2-8d4f-ec8b08dd9ec9 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:36.155924 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:36.231068 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c337357-8feb-47b2-8d4f-ec8b08dd9ec9 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:36.267957 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82e7bc1-201e-4103-8bb4-25dcd04a08f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:36.268710 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82e7bc1-201e-4103-8bb4-25dcd04a08f3 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:36.268967 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82e7bc1-201e-4103-8bb4-25dcd04a08f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:36.269252 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82e7bc1-201e-4103-8bb4-25dcd04a08f3 None admin] PATH_INFO: `/v3/projects/f7e1658c45e44adf92c8f5d873786cdc` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:36.270527 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82e7bc1-201e-4103-8bb4-25dcd04a08f3 None admin] RBAC: Authorizing `identity:get_project(project_id=f7e1658c45e44adf92c8f5d873786cdc)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:36.272151 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82e7bc1-201e-4103-8bb4-25dcd04a08f3 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:36.274061 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 49/96] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 03:15:36 2022] GET /identity/v3/projects/f7e1658c45e44adf92c8f5d873786cdc => generated 312 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:36.280036 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c634d6bd-0141-4bef-b1d0-260bf9952214 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:36.356169 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:36.389056 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c634d6bd-0141-4bef-b1d0-260bf9952214 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:36.425128 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edfe8cb-1466-4cf0-9b54-ece27926d419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:36.425740 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edfe8cb-1466-4cf0-9b54-ece27926d419 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:36.426028 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edfe8cb-1466-4cf0-9b54-ece27926d419 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:36.426304 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edfe8cb-1466-4cf0-9b54-ece27926d419 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:36.427032 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edfe8cb-1466-4cf0-9b54-ece27926d419 None admin] RBAC: Adding query filter params (role.id=04d0e4575a28440eb4349b4a6565e8b8, scope.project.id=f7e1658c45e44adf92c8f5d873786cdc, user.id=b72c77a1143648e58bef98b7bb2677d1) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:15:36.427345 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edfe8cb-1466-4cf0-9b54-ece27926d419 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:36.428836 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edfe8cb-1466-4cf0-9b54-ece27926d419 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:36.434915 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 48/97] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 03:15:36 2022] GET /identity/v3/role_assignments?user.id=b72c77a1143648e58bef98b7bb2677d1&scope.project.id=f7e1658c45e44adf92c8f5d873786cdc&role.id=04d0e4575a28440eb4349b4a6565e8b8 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:37.314815 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba39218-d45e-468d-b2d1-c2a6816e4f80 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:37.315326 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba39218-d45e-468d-b2d1-c2a6816e4f80 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:37.315429 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba39218-d45e-468d-b2d1-c2a6816e4f80 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:37.316814 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 50/98] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:15:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:15:37.326153 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aebb56-9a7e-4186-b4ed-4c46655a2fdb None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:37.326607 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aebb56-9a7e-4186-b4ed-4c46655a2fdb None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:37.326788 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aebb56-9a7e-4186-b4ed-4c46655a2fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:37.349964 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-e2aebb56-9a7e-4186-b4ed-4c46655a2fdb None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:15:37.351189 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-e2aebb56-9a7e-4186-b4ed-4c46655a2fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:15:37.440768 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 49/99] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:15:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 03:15:37.819122 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1338b201-0f38-4c26-84bc-be9bbf513322 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:37.819857 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1338b201-0f38-4c26-84bc-be9bbf513322 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:37.820604 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1338b201-0f38-4c26-84bc-be9bbf513322 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:37.823245 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 51/100] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:15:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:15:37.828366 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d870a39-b14b-4310-b7d3-51c36c5b542b None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:37.828881 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d870a39-b14b-4310-b7d3-51c36c5b542b None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:37.829375 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d870a39-b14b-4310-b7d3-51c36c5b542b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:37.851406 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-4d870a39-b14b-4310-b7d3-51c36c5b542b None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:15:37.853596 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-4d870a39-b14b-4310-b7d3-51c36c5b542b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:15:37.925931 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:37.943873 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 50/101] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:15:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 03:15:38.025762 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1338b201-0f38-4c26-84bc-be9bbf513322 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:38.168154 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1338b201-0f38-4c26-84bc-be9bbf513322 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:38.169761 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:38.210609 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f87c0b2-ca5b-4398-9da9-6d004eb3d96b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:38.211165 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87c0b2-ca5b-4398-9da9-6d004eb3d96b None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:38.211449 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87c0b2-ca5b-4398-9da9-6d004eb3d96b None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:38.212324 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87c0b2-ca5b-4398-9da9-6d004eb3d96b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:38.225923 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f87c0b2-ca5b-4398-9da9-6d004eb3d96b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:15:38.231250 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-5f87c0b2-ca5b-4398-9da9-6d004eb3d96b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 03:15:38.231250 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:15:38.231250 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:15:38.231250 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:15:38.231250 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:15:38.231250 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:15:38.231250 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:15:38.231250 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:15:38.231250 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:15:38.231250 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:15:38.231250 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:15:38.231250 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:15:38.231250 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:15:38.231250 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:15:38.231250 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:15:38.231250 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:15:38.232113 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:15:38.232113 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:15:38.232113 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:15:38.232113 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:15:38.232113 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:15:38.232113 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:15:38.232113 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:15:38.232113 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:15:38.232113 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:15:38.232113 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:15:38.232113 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:15:38.232113 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:15:38.232113 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:15:38.232113 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:15:38.232113 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:15:38.232113 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:15:38.232853 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:15:38.232853 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:15:38.232853 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:15:38.232853 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:15:38.232853 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:15:38.232853 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:15:38.232853 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:15:38.232853 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:15:38.232853 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:15:38.232853 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:15:38.232853 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 03:15:38.232853 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:15:38.232853 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 52/102] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 03:15:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:15:38.238461 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d870a39-b14b-4310-b7d3-51c36c5b542b None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:38.367978 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d870a39-b14b-4310-b7d3-51c36c5b542b None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:38.419168 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235c8d33-4cad-4211-a930-b6c3d2407178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:38.419804 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c8d33-4cad-4211-a930-b6c3d2407178 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:38.420089 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c8d33-4cad-4211-a930-b6c3d2407178 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:38.420363 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c8d33-4cad-4211-a930-b6c3d2407178 None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:38.421028 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235c8d33-4cad-4211-a930-b6c3d2407178 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:15:38.421336 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235c8d33-4cad-4211-a930-b6c3d2407178 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:38.422763 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235c8d33-4cad-4211-a930-b6c3d2407178 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:38.432096 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 51/103] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Oct 4 03:15:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:38.437550 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f87c0b2-ca5b-4398-9da9-6d004eb3d96b None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:38.468478 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235c8d33-4cad-4211-a930-b6c3d2407178 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:38.530061 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:38.623789 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f87c0b2-ca5b-4398-9da9-6d004eb3d96b None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:38.627091 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235c8d33-4cad-4211-a930-b6c3d2407178 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:38.705013 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb715b0-e84e-48e3-996c-0aa410f94017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:38.706047 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb715b0-e84e-48e3-996c-0aa410f94017 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:38.706475 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb715b0-e84e-48e3-996c-0aa410f94017 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:38.706891 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb715b0-e84e-48e3-996c-0aa410f94017 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:38.708323 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb715b0-e84e-48e3-996c-0aa410f94017 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:38.710277 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb715b0-e84e-48e3-996c-0aa410f94017 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:38.712836 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 52/104] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:15:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:38.717930 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb715b0-e84e-48e3-996c-0aa410f94017 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:38.726490 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da418923-8053-4ec5-b07e-820854351e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:38.727247 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da418923-8053-4ec5-b07e-820854351e52 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:38.728197 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da418923-8053-4ec5-b07e-820854351e52 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:38.728685 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da418923-8053-4ec5-b07e-820854351e52 None admin] PATH_INFO: `/v3/users/ccd0afd0141443b58b40b271b1b6f0a1` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:38.772248 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da418923-8053-4ec5-b07e-820854351e52 None admin] RBAC: Authorizing `identity:get_user(user_id=ccd0afd0141443b58b40b271b1b6f0a1)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:38.773881 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da418923-8053-4ec5-b07e-820854351e52 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:38.776761 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 53/105] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 03:15:38 2022] GET /identity/v3/users/ccd0afd0141443b58b40b271b1b6f0a1 => generated 289 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:38.782081 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da418923-8053-4ec5-b07e-820854351e52 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:38.838781 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:38.927958 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb715b0-e84e-48e3-996c-0aa410f94017 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:38.970570 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:38.996366 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3215c577-8e01-4bf2-82a2-bae16af6a619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:38.997321 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215c577-8e01-4bf2-82a2-bae16af6a619 None admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:38.997804 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215c577-8e01-4bf2-82a2-bae16af6a619 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:38.998838 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215c577-8e01-4bf2-82a2-bae16af6a619 None admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:38.999782 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3215c577-8e01-4bf2-82a2-bae16af6a619 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:39.001445 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3215c577-8e01-4bf2-82a2-bae16af6a619 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:39.019666 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da418923-8053-4ec5-b07e-820854351e52 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:39.054306 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 53/106] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Oct 4 03:15:38 2022] POST /identity/v3/projects => generated 302 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:15:39.079095 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f208a841-0f43-4446-8dfc-eb30c01eb4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:39.079764 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f208a841-0f43-4446-8dfc-eb30c01eb4ce None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:39.080061 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f208a841-0f43-4446-8dfc-eb30c01eb4ce None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:39.080344 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f208a841-0f43-4446-8dfc-eb30c01eb4ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:39.135940 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a8b37-73e1-4ab6-9cf0-af4ad585f7aa None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:39.136267 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a8b37-73e1-4ab6-9cf0-af4ad585f7aa None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:39.136500 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a8b37-73e1-4ab6-9cf0-af4ad585f7aa None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:39.137847 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 54/107] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:15:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 03:15:39.143793 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0db50b-0446-4d83-8232-6359b460705e None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:39.144111 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0db50b-0446-4d83-8232-6359b460705e None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:39.144355 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0db50b-0446-4d83-8232-6359b460705e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:39.166807 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-8f0db50b-0446-4d83-8232-6359b460705e None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:15:39.168330 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-8f0db50b-0446-4d83-8232-6359b460705e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:15:39.197385 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f208a841-0f43-4446-8dfc-eb30c01eb4ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:39.198884 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f208a841-0f43-4446-8dfc-eb30c01eb4ce None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:39.240856 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:39.344492 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 55/108] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:15:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 03:15:39.346039 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae3331-2d8d-42d6-b925-f57da9790145 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:39.346331 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae3331-2d8d-42d6-b925-f57da9790145 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:39.346611 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae3331-2d8d-42d6-b925-f57da9790145 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:39.349547 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 56/109] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:15:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:15:39.358688 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a15dc9-8dc9-4faa-bce7-d9e2360a4265 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:39.358975 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a15dc9-8dc9-4faa-bce7-d9e2360a4265 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:39.359271 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a15dc9-8dc9-4faa-bce7-d9e2360a4265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:39.387479 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-52a15dc9-8dc9-4faa-bce7-d9e2360a4265 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:15:39.390240 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-52a15dc9-8dc9-4faa-bce7-d9e2360a4265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:15:39.419703 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 54/110] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 03:15:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 638 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 03:15:39.429675 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f208a841-0f43-4446-8dfc-eb30c01eb4ce None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:39.504372 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 57/111] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:15:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 03:15:39.511543 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40750574-f35b-4234-8dd5-d8b50900f275 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:39.512059 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40750574-f35b-4234-8dd5-d8b50900f275 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:39.512578 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40750574-f35b-4234-8dd5-d8b50900f275 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:39.514216 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 58/112] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:15:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:15:39.521905 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da70b6d-1869-42e8-a859-4979040b55a3 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:39.522655 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da70b6d-1869-42e8-a859-4979040b55a3 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:39.523275 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da70b6d-1869-42e8-a859-4979040b55a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:39.558874 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-7da70b6d-1869-42e8-a859-4979040b55a3 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:15:39.561444 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-7da70b6d-1869-42e8-a859-4979040b55a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:15:39.583596 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f208a841-0f43-4446-8dfc-eb30c01eb4ce None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:39.613538 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:39.630953 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:39.665275 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0291a65-8206-4dba-bae6-ce0f3dfede99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:39.665921 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0291a65-8206-4dba-bae6-ce0f3dfede99 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:39.666205 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0291a65-8206-4dba-bae6-ce0f3dfede99 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:39.666542 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0291a65-8206-4dba-bae6-ce0f3dfede99 None admin] PATH_INFO: `/v3/projects/a7dc4038bbe8418c9837b329ac4d2754` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:39.667999 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0291a65-8206-4dba-bae6-ce0f3dfede99 None admin] RBAC: Authorizing `identity:get_project(project_id=a7dc4038bbe8418c9837b329ac4d2754)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:39.669584 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0291a65-8206-4dba-bae6-ce0f3dfede99 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:39.673239 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 55/113] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 03:15:39 2022] GET /identity/v3/projects/a7dc4038bbe8418c9837b329ac4d2754 => generated 298 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:15:39.674839 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871dfa71-0dc2-4904-9ff5-21de1abd0924 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:39.675351 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871dfa71-0dc2-4904-9ff5-21de1abd0924 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:39.675849 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871dfa71-0dc2-4904-9ff5-21de1abd0924 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:39.677347 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 56/114] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:15:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:15:39.678373 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871dfa71-0dc2-4904-9ff5-21de1abd0924 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:39.686516 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 59/115] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:15:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 03:15:39.688017 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c783e0-8a46-47d5-bcdf-57c2495943a5 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:39.688455 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c783e0-8a46-47d5-bcdf-57c2495943a5 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:39.688899 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c783e0-8a46-47d5-bcdf-57c2495943a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:39.717471 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-90c783e0-8a46-47d5-bcdf-57c2495943a5 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:15:39.718881 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-90c783e0-8a46-47d5-bcdf-57c2495943a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:15:39.793761 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 60/116] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:15:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 03:15:39.794853 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c783e0-8a46-47d5-bcdf-57c2495943a5 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:39.896363 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:39.901973 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871dfa71-0dc2-4904-9ff5-21de1abd0924 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:39.904116 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c783e0-8a46-47d5-bcdf-57c2495943a5 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:39.942411 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58e0409-9fb9-4752-b2ef-b40e9f78653f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:39.943277 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e0409-9fb9-4752-b2ef-b40e9f78653f None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:39.943775 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e0409-9fb9-4752-b2ef-b40e9f78653f None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:39.944357 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e0409-9fb9-4752-b2ef-b40e9f78653f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:39.945679 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1b4ab-a443-44d1-ace5-d90874dad601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:39.946365 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1b4ab-a443-44d1-ace5-d90874dad601 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:39.946667 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1b4ab-a443-44d1-ace5-d90874dad601 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:39.946962 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1b4ab-a443-44d1-ace5-d90874dad601 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:39.948508 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d1b4ab-a443-44d1-ace5-d90874dad601 None admin] RBAC: Adding query filter params (role.id=8513937b0b5c4d0099cb3732beb89fd4, scope.project.id=a7dc4038bbe8418c9837b329ac4d2754, user.id=ccd0afd0141443b58b40b271b1b6f0a1) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:15:39.948873 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d1b4ab-a443-44d1-ace5-d90874dad601 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:39.950386 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d1b4ab-a443-44d1-ace5-d90874dad601 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:39.956619 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58e0409-9fb9-4752-b2ef-b40e9f78653f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:15:39.957317 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 57/117] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 03:15:39 2022] GET /identity/v3/role_assignments?user.id=ccd0afd0141443b58b40b271b1b6f0a1&scope.project.id=a7dc4038bbe8418c9837b329ac4d2754&role.id=8513937b0b5c4d0099cb3732beb89fd4 => generated 259 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:39.962432 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-d58e0409-9fb9-4752-b2ef-b40e9f78653f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 03:15:39.962432 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:15:39.962432 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:15:39.962432 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:15:39.962432 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:15:39.962432 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:15:39.962432 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:15:39.962432 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:15:39.962432 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:15:39.962432 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:15:39.962432 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:15:39.962432 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:15:39.962432 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:15:39.962432 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:15:39.962432 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:15:39.962432 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:15:39.963414 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:15:39.963414 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:15:39.963414 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:15:39.963414 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:15:39.963414 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:15:39.963414 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:15:39.963414 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:15:39.963414 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:15:39.963414 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:15:39.963414 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:15:39.963414 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:15:39.963414 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:15:39.963414 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:15:39.963414 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:15:39.963414 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:15:39.963414 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:15:39.964272 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:15:39.964272 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:15:39.964272 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:15:39.964272 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:15:39.964272 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:15:39.964272 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:15:39.964272 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:15:39.964272 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:15:39.964272 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:15:39.964272 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:15:39.964272 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 03:15:39.964272 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:15:39.964838 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1b4ab-a443-44d1-ace5-d90874dad601 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:39.966276 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 61/118] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 4 03:15:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:15:39.976531 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58e0409-9fb9-4752-b2ef-b40e9f78653f None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:40.064431 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:40.138252 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1b4ab-a443-44d1-ace5-d90874dad601 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:40.168647 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58e0409-9fb9-4752-b2ef-b40e9f78653f None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:40.176983 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a4a777-e8eb-485d-b3ee-caa15f64f791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:40.178010 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4a777-e8eb-485d-b3ee-caa15f64f791 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:40.178496 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4a777-e8eb-485d-b3ee-caa15f64f791 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:40.178968 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4a777-e8eb-485d-b3ee-caa15f64f791 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:40.191445 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a4a777-e8eb-485d-b3ee-caa15f64f791 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:15:40.198375 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-b1a4a777-e8eb-485d-b3ee-caa15f64f791 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 03:15:40.198375 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:15:40.198375 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:15:40.198375 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:15:40.198375 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:15:40.198375 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:15:40.198375 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:15:40.198375 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:15:40.198375 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:15:40.198375 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:15:40.198375 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:15:40.198375 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:15:40.198375 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:15:40.198375 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:15:40.198375 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:15:40.198375 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:15:40.199287 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:15:40.199287 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:15:40.199287 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:15:40.199287 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:15:40.199287 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:15:40.199287 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:15:40.199287 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:15:40.199287 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:15:40.199287 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:15:40.199287 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:15:40.199287 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:15:40.199287 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:15:40.199287 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:15:40.199287 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:15:40.199287 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:15:40.199287 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:15:40.200411 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:15:40.200411 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:15:40.200411 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:15:40.200411 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:15:40.200411 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:15:40.200411 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:15:40.200411 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:15:40.200411 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:15:40.200411 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:15:40.200411 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:15:40.200411 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 03:15:40.200411 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:15:40.202547 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 58/119] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 03:15:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:15:40.203641 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a4a777-e8eb-485d-b3ee-caa15f64f791 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:40.214793 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efe3612-3dc9-4f8f-beb3-36125daafa87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:40.215414 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe3612-3dc9-4f8f-beb3-36125daafa87 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:40.215726 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe3612-3dc9-4f8f-beb3-36125daafa87 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:40.216004 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe3612-3dc9-4f8f-beb3-36125daafa87 None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:40.216676 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efe3612-3dc9-4f8f-beb3-36125daafa87 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:15:40.216981 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efe3612-3dc9-4f8f-beb3-36125daafa87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:40.218377 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efe3612-3dc9-4f8f-beb3-36125daafa87 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:40.228576 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 62/120] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 03:15:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:40.229152 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efe3612-3dc9-4f8f-beb3-36125daafa87 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:40.245100 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:40.325661 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a4a777-e8eb-485d-b3ee-caa15f64f791 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:40.336166 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efe3612-3dc9-4f8f-beb3-36125daafa87 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:40.341293 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:40.367770 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05278e29-cfa4-4fe1-853b-3b115b52455f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:40.368432 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05278e29-cfa4-4fe1-853b-3b115b52455f None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:40.368716 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05278e29-cfa4-4fe1-853b-3b115b52455f None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:40.369069 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05278e29-cfa4-4fe1-853b-3b115b52455f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:40.380787 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fb6860-2e70-4790-8b6d-6a5b515c3eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:40.381647 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05278e29-cfa4-4fe1-853b-3b115b52455f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:15:40.381932 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb6860-2e70-4790-8b6d-6a5b515c3eb7 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:40.382348 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb6860-2e70-4790-8b6d-6a5b515c3eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:40.382757 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb6860-2e70-4790-8b6d-6a5b515c3eb7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:40.387964 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-05278e29-cfa4-4fe1-853b-3b115b52455f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 03:15:40.387964 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:15:40.387964 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:15:40.387964 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:15:40.387964 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:15:40.387964 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:15:40.387964 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:15:40.387964 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:15:40.387964 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:15:40.387964 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:15:40.387964 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:15:40.387964 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:15:40.387964 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:15:40.387964 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:15:40.387964 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:15:40.387964 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:15:40.388822 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:15:40.388822 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:15:40.388822 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:15:40.388822 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:15:40.388822 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:15:40.388822 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:15:40.388822 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:15:40.388822 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:15:40.388822 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:15:40.388822 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:15:40.388822 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:15:40.388822 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:15:40.388822 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:15:40.388822 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:15:40.388822 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:15:40.388822 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:15:40.389827 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:15:40.389827 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:15:40.389827 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:15:40.389827 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:15:40.389827 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:15:40.389827 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:15:40.389827 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:15:40.389827 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:15:40.389827 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:15:40.389827 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:15:40.389827 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 03:15:40.389827 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:15:40.389827 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 59/121] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 03:15:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:15:40.390689 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05278e29-cfa4-4fe1-853b-3b115b52455f None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:40.398503 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fb6860-2e70-4790-8b6d-6a5b515c3eb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:15:40.410818 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-24fb6860-2e70-4790-8b6d-6a5b515c3eb7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 03:15:40.410818 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:15:40.410818 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:15:40.410818 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:15:40.410818 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:15:40.410818 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:15:40.410818 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:15:40.410818 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:15:40.410818 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:15:40.410818 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:15:40.410818 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:15:40.410818 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:15:40.410818 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:15:40.410818 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:15:40.410818 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:15:40.410818 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:15:40.411834 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:15:40.411834 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:15:40.411834 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:15:40.411834 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:15:40.411834 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:15:40.411834 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:15:40.411834 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:15:40.411834 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:15:40.411834 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:15:40.411834 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:15:40.411834 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:15:40.411834 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:15:40.411834 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:15:40.411834 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:15:40.411834 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:15:40.411834 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:15:40.412587 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:15:40.412587 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:15:40.412587 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:15:40.412587 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:15:40.412587 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:15:40.412587 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:15:40.412587 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:15:40.412587 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:15:40.412587 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:15:40.412587 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:15:40.412587 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 03:15:40.412587 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:15:40.415750 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 63/122] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Oct 4 03:15:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:15:40.417249 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fb6860-2e70-4790-8b6d-6a5b515c3eb7 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:40.510911 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05278e29-cfa4-4fe1-853b-3b115b52455f None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:40.513133 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:40.553887 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fb6860-2e70-4790-8b6d-6a5b515c3eb7 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:40.554239 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3a55bf-e920-4cd4-8ac8-6bd46db3caca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:40.555060 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a55bf-e920-4cd4-8ac8-6bd46db3caca None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:40.556365 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a55bf-e920-4cd4-8ac8-6bd46db3caca None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:40.557865 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a55bf-e920-4cd4-8ac8-6bd46db3caca None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:40.558692 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3a55bf-e920-4cd4-8ac8-6bd46db3caca None admin] RBAC: Adding query filter params (name=member) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:15:40.559140 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3a55bf-e920-4cd4-8ac8-6bd46db3caca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:40.560701 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3a55bf-e920-4cd4-8ac8-6bd46db3caca None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:40.571907 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 60/123] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Oct 4 03:15:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:40.573768 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3a55bf-e920-4cd4-8ac8-6bd46db3caca None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:40.597792 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9899b9d4-9c13-4dfc-9290-47142ace6e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:40.598740 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899b9d4-9c13-4dfc-9290-47142ace6e46 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:40.599192 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899b9d4-9c13-4dfc-9290-47142ace6e46 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:40.599646 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899b9d4-9c13-4dfc-9290-47142ace6e46 None admin] PATH_INFO: `/v3/users/7c1281e81e9c4e3da30715cc2f1b3156` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:40.601061 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9899b9d4-9c13-4dfc-9290-47142ace6e46 None admin] RBAC: Authorizing `identity:get_user(user_id=7c1281e81e9c4e3da30715cc2f1b3156)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:40.602811 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9899b9d4-9c13-4dfc-9290-47142ace6e46 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:40.604798 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 64/124] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 03:15:40 2022] GET /identity/v3/users/7c1281e81e9c4e3da30715cc2f1b3156 => generated 247 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:40.605963 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9899b9d4-9c13-4dfc-9290-47142ace6e46 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:40.617800 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:40.688340 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3a55bf-e920-4cd4-8ac8-6bd46db3caca None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:40.731892 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fbb6b4-9805-49cf-99fe-83b0f985aac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:40.732756 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fbb6b4-9805-49cf-99fe-83b0f985aac5 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:40.732883 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fbb6b4-9805-49cf-99fe-83b0f985aac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:40.733052 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fbb6b4-9805-49cf-99fe-83b0f985aac5 None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:40.733716 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fbb6b4-9805-49cf-99fe-83b0f985aac5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:15:40.734022 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fbb6b4-9805-49cf-99fe-83b0f985aac5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:40.735383 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fbb6b4-9805-49cf-99fe-83b0f985aac5 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:40.740414 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9899b9d4-9c13-4dfc-9290-47142ace6e46 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:40.752005 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 61/125] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Oct 4 03:15:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:40.753862 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fbb6b4-9805-49cf-99fe-83b0f985aac5 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:40.784175 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8327ff-616f-4349-88fa-c91e6c2c7ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:40.784959 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8327ff-616f-4349-88fa-c91e6c2c7ace None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:40.785244 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8327ff-616f-4349-88fa-c91e6c2c7ace None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:40.785940 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8327ff-616f-4349-88fa-c91e6c2c7ace None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:40.786895 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8327ff-616f-4349-88fa-c91e6c2c7ace None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:15:40.787204 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8327ff-616f-4349-88fa-c91e6c2c7ace None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:40.789291 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8327ff-616f-4349-88fa-c91e6c2c7ace None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:40.801628 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 65/126] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 03:15:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:40.802477 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8327ff-616f-4349-88fa-c91e6c2c7ace None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:40.810388 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:40.874605 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:40.882418 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fbb6b4-9805-49cf-99fe-83b0f985aac5 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:40.922455 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a95172c-6ab2-48b0-824a-633ffa383674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:40.923083 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a95172c-6ab2-48b0-824a-633ffa383674 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:40.923365 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a95172c-6ab2-48b0-824a-633ffa383674 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:40.923706 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a95172c-6ab2-48b0-824a-633ffa383674 None admin] PATH_INFO: `/v3/users/b72c77a1143648e58bef98b7bb2677d1` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:40.925333 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a95172c-6ab2-48b0-824a-633ffa383674 None admin] RBAC: Authorizing `identity:get_user(user_id=b72c77a1143648e58bef98b7bb2677d1)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:40.927148 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a95172c-6ab2-48b0-824a-633ffa383674 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:40.929047 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 62/127] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 03:15:40 2022] GET /identity/v3/users/b72c77a1143648e58bef98b7bb2677d1 => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:40.929919 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a95172c-6ab2-48b0-824a-633ffa383674 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:40.949491 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8327ff-616f-4349-88fa-c91e6c2c7ace None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:40.991663 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceef9e2-d884-451d-8e80-b6ce66a60689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:40.992675 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceef9e2-d884-451d-8e80-b6ce66a60689 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:40.993256 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceef9e2-d884-451d-8e80-b6ce66a60689 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:40.994010 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceef9e2-d884-451d-8e80-b6ce66a60689 None admin] PATH_INFO: `/v3/projects/a7dc4038bbe8418c9837b329ac4d2754` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:40.995411 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceef9e2-d884-451d-8e80-b6ce66a60689 None admin] RBAC: Authorizing `identity:get_project(project_id=a7dc4038bbe8418c9837b329ac4d2754)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:40.997187 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceef9e2-d884-451d-8e80-b6ce66a60689 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:40.999172 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 66/128] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 03:15:40 2022] GET /identity/v3/projects/a7dc4038bbe8418c9837b329ac4d2754 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:41.000225 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceef9e2-d884-451d-8e80-b6ce66a60689 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:41.047590 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a95172c-6ab2-48b0-824a-633ffa383674 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:41.075132 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:41.085784 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfda43b-2cef-4a8d-b908-93a6d373b588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:41.086524 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfda43b-2cef-4a8d-b908-93a6d373b588 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:41.087517 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfda43b-2cef-4a8d-b908-93a6d373b588 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:41.087791 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfda43b-2cef-4a8d-b908-93a6d373b588 None admin] PATH_INFO: `/v3/users/b72c77a1143648e58bef98b7bb2677d1` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:41.088933 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfda43b-2cef-4a8d-b908-93a6d373b588 None admin] RBAC: Authorizing `identity:get_user(user_id=b72c77a1143648e58bef98b7bb2677d1)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:41.090423 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfda43b-2cef-4a8d-b908-93a6d373b588 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:41.092155 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 63/129] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 03:15:40 2022] GET /identity/v3/users/b72c77a1143648e58bef98b7bb2677d1 => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:41.096618 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfda43b-2cef-4a8d-b908-93a6d373b588 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:41.115401 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceef9e2-d884-451d-8e80-b6ce66a60689 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:41.127030 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:41.159592 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90df48fc-7965-468e-b5d4-63abf045c55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:41.160684 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df48fc-7965-468e-b5d4-63abf045c55a None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:41.161138 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df48fc-7965-468e-b5d4-63abf045c55a None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:41.161677 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df48fc-7965-468e-b5d4-63abf045c55a None admin] PATH_INFO: `/v3/users/b72c77a1143648e58bef98b7bb2677d1` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:41.163539 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90df48fc-7965-468e-b5d4-63abf045c55a None admin] RBAC: Authorizing `identity:get_user(user_id=b72c77a1143648e58bef98b7bb2677d1)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:41.165311 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90df48fc-7965-468e-b5d4-63abf045c55a None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:41.167561 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 67/130] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 03:15:40 2022] GET /identity/v3/users/b72c77a1143648e58bef98b7bb2677d1 => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:41.168510 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90df48fc-7965-468e-b5d4-63abf045c55a None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:41.225826 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfda43b-2cef-4a8d-b908-93a6d373b588 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:41.267075 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cba63f-7bac-446e-874b-f08683977f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:41.267998 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cba63f-7bac-446e-874b-f08683977f6b None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:41.268498 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cba63f-7bac-446e-874b-f08683977f6b None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:41.269008 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cba63f-7bac-446e-874b-f08683977f6b None admin] PATH_INFO: `/v3/projects/f7e1658c45e44adf92c8f5d873786cdc` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:41.270319 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cba63f-7bac-446e-874b-f08683977f6b None admin] RBAC: Authorizing `identity:get_project(project_id=f7e1658c45e44adf92c8f5d873786cdc)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:41.272007 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cba63f-7bac-446e-874b-f08683977f6b None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:41.273819 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 64/131] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 03:15:41 2022] GET /identity/v3/projects/f7e1658c45e44adf92c8f5d873786cdc => generated 312 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:41.279876 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cba63f-7bac-446e-874b-f08683977f6b None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:41.295537 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90df48fc-7965-468e-b5d4-63abf045c55a None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:41.345673 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d5bf07-5ab0-47b8-a2ee-df6df1746bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:41.346343 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5bf07-5ab0-47b8-a2ee-df6df1746bb1 None admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:41.346629 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5bf07-5ab0-47b8-a2ee-df6df1746bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:41.346907 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5bf07-5ab0-47b8-a2ee-df6df1746bb1 None admin] PATH_INFO: `/v3/projects/a7dc4038bbe8418c9837b329ac4d2754/users/7c1281e81e9c4e3da30715cc2f1b3156/roles/fe9379cda35c4ff78576fe48b60bea3c` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:41.349492 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d5bf07-5ab0-47b8-a2ee-df6df1746bb1 None admin] RBAC: Authorizing `identity:create_grant(project_id=a7dc4038bbe8418c9837b329ac4d2754, user_id=7c1281e81e9c4e3da30715cc2f1b3156, role_id=fe9379cda35c4ff78576fe48b60bea3c)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:41.351805 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d5bf07-5ab0-47b8-a2ee-df6df1746bb1 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:41.364260 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:41.373889 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 68/132] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Oct 4 03:15:41 2022] PUT /identity/v3/projects/a7dc4038bbe8418c9837b329ac4d2754/users/7c1281e81e9c4e3da30715cc2f1b3156/roles/fe9379cda35c4ff78576fe48b60bea3c => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:15:41.376696 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d5bf07-5ab0-47b8-a2ee-df6df1746bb1 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:41.397931 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:41.402283 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cba63f-7bac-446e-874b-f08683977f6b None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:41.441668 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f0a140-47c7-4b46-8069-d8c0db5fa9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:41.442661 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f0a140-47c7-4b46-8069-d8c0db5fa9e5 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:41.443147 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f0a140-47c7-4b46-8069-d8c0db5fa9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:41.443735 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f0a140-47c7-4b46-8069-d8c0db5fa9e5 None admin] PATH_INFO: `/v3/projects/a7dc4038bbe8418c9837b329ac4d2754` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:41.445085 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f0a140-47c7-4b46-8069-d8c0db5fa9e5 None admin] RBAC: Authorizing `identity:get_project(project_id=a7dc4038bbe8418c9837b329ac4d2754)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:41.447880 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f0a140-47c7-4b46-8069-d8c0db5fa9e5 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:41.449940 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 65/133] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 03:15:41 2022] GET /identity/v3/projects/a7dc4038bbe8418c9837b329ac4d2754 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:41.451072 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f0a140-47c7-4b46-8069-d8c0db5fa9e5 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:41.529056 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d5bf07-5ab0-47b8-a2ee-df6df1746bb1 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:41.607588 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44910423-6dae-4445-b4a9-175f74038377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:41.608174 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44910423-6dae-4445-b4a9-175f74038377 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:41.608458 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44910423-6dae-4445-b4a9-175f74038377 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:41.608729 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44910423-6dae-4445-b4a9-175f74038377 None admin] PATH_INFO: `/v3/projects/a7dc4038bbe8418c9837b329ac4d2754` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:41.610104 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44910423-6dae-4445-b4a9-175f74038377 None admin] RBAC: Authorizing `identity:get_project(project_id=a7dc4038bbe8418c9837b329ac4d2754)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:41.611605 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44910423-6dae-4445-b4a9-175f74038377 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:41.613275 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 69/134] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 03:15:41 2022] GET /identity/v3/projects/a7dc4038bbe8418c9837b329ac4d2754 => generated 298 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:41.615128 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44910423-6dae-4445-b4a9-175f74038377 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:41.664047 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f0a140-47c7-4b46-8069-d8c0db5fa9e5 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:41.714731 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aafa90d-f682-47ac-93b3-99c20aad02e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:41.715846 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aafa90d-f682-47ac-93b3-99c20aad02e0 None admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:41.716326 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aafa90d-f682-47ac-93b3-99c20aad02e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:41.716894 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aafa90d-f682-47ac-93b3-99c20aad02e0 None admin] PATH_INFO: `/v3/projects/f7e1658c45e44adf92c8f5d873786cdc/users/b72c77a1143648e58bef98b7bb2677d1/roles/04d0e4575a28440eb4349b4a6565e8b8` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:41.719684 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aafa90d-f682-47ac-93b3-99c20aad02e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=f7e1658c45e44adf92c8f5d873786cdc, user_id=b72c77a1143648e58bef98b7bb2677d1, role_id=04d0e4575a28440eb4349b4a6565e8b8)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:41.721115 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:41.721899 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aafa90d-f682-47ac-93b3-99c20aad02e0 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:41.743274 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 66/135] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Oct 4 03:15:41 2022] PUT /identity/v3/projects/f7e1658c45e44adf92c8f5d873786cdc/users/b72c77a1143648e58bef98b7bb2677d1/roles/04d0e4575a28440eb4349b4a6565e8b8 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:15:41.753346 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aafa90d-f682-47ac-93b3-99c20aad02e0 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:41.767553 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44910423-6dae-4445-b4a9-175f74038377 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:41.803443 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db805087-2329-4746-aa40-9c3c1d06cb24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:41.804441 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:41.804672 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db805087-2329-4746-aa40-9c3c1d06cb24 None admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:41.805134 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db805087-2329-4746-aa40-9c3c1d06cb24 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:41.807045 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db805087-2329-4746-aa40-9c3c1d06cb24 None admin] PATH_INFO: `/v3/projects/a7dc4038bbe8418c9837b329ac4d2754/users/b72c77a1143648e58bef98b7bb2677d1/roles/04d0e4575a28440eb4349b4a6565e8b8` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:41.809763 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db805087-2329-4746-aa40-9c3c1d06cb24 None admin] RBAC: Authorizing `identity:create_grant(project_id=a7dc4038bbe8418c9837b329ac4d2754, user_id=b72c77a1143648e58bef98b7bb2677d1, role_id=04d0e4575a28440eb4349b4a6565e8b8)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:41.811647 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db805087-2329-4746-aa40-9c3c1d06cb24 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:41.845597 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 70/136] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Oct 4 03:15:41 2022] PUT /identity/v3/projects/a7dc4038bbe8418c9837b329ac4d2754/users/b72c77a1143648e58bef98b7bb2677d1/roles/04d0e4575a28440eb4349b4a6565e8b8 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:15:41.926939 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aafa90d-f682-47ac-93b3-99c20aad02e0 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:41.970834 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b304da-cd58-468e-b1fc-dff2642adf2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:41.971516 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b304da-cd58-468e-b1fc-dff2642adf2e None admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:41.971870 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b304da-cd58-468e-b1fc-dff2642adf2e None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:41.972154 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b304da-cd58-468e-b1fc-dff2642adf2e None admin] PATH_INFO: `/v3/projects/a7dc4038bbe8418c9837b329ac4d2754/users/b72c77a1143648e58bef98b7bb2677d1/roles/f2332a9a00b74fe0846d7211dd3850cb` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:41.974378 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b304da-cd58-468e-b1fc-dff2642adf2e None admin] RBAC: Authorizing `identity:create_grant(project_id=a7dc4038bbe8418c9837b329ac4d2754, user_id=b72c77a1143648e58bef98b7bb2677d1, role_id=f2332a9a00b74fe0846d7211dd3850cb)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:41.975879 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b304da-cd58-468e-b1fc-dff2642adf2e None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:41.991661 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 67/137] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Oct 4 03:15:41 2022] PUT /identity/v3/projects/a7dc4038bbe8418c9837b329ac4d2754/users/b72c77a1143648e58bef98b7bb2677d1/roles/f2332a9a00b74fe0846d7211dd3850cb => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:15:42.010866 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e5215-9c65-4010-a5ab-6af6327ca49b None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:42.011201 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e5215-9c65-4010-a5ab-6af6327ca49b None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:42.011431 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e5215-9c65-4010-a5ab-6af6327ca49b None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:42.012929 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 71/138] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:15:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:15:42.018993 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e4e74f-1c4b-46ad-8115-e2fed1f4b87d None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:42.019283 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e4e74f-1c4b-46ad-8115-e2fed1f4b87d None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:42.019593 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e4e74f-1c4b-46ad-8115-e2fed1f4b87d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:42.041313 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-38e4e74f-1c4b-46ad-8115-e2fed1f4b87d None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:15:42.042698 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-38e4e74f-1c4b-46ad-8115-e2fed1f4b87d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:15:42.125911 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 68/139] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:15:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 03:15:42.413089 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e5215-9c65-4010-a5ab-6af6327ca49b None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:42.558844 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e5215-9c65-4010-a5ab-6af6327ca49b None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:42.593946 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef720555-9846-4738-a0c0-3f04d9cebe72 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:42.594230 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef720555-9846-4738-a0c0-3f04d9cebe72 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:42.594508 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef720555-9846-4738-a0c0-3f04d9cebe72 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:42.596012 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 69/140] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:15:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 03:15:42.597870 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:42.601019 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da853851-dafd-4203-bed6-de39a29806c5 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:42.601306 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da853851-dafd-4203-bed6-de39a29806c5 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:42.601863 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da853851-dafd-4203-bed6-de39a29806c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:42.624310 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19483c73-a1f7-4926-9ccd-aa645dd641fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:42.624951 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19483c73-a1f7-4926-9ccd-aa645dd641fe None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:42.625233 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19483c73-a1f7-4926-9ccd-aa645dd641fe None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:42.625510 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19483c73-a1f7-4926-9ccd-aa645dd641fe None admin] PATH_INFO: `/v3/domains/default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:42.629780 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19483c73-a1f7-4926-9ccd-aa645dd641fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:42.632937 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19483c73-a1f7-4926-9ccd-aa645dd641fe None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:42.633069 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-da853851-dafd-4203-bed6-de39a29806c5 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:15:42.633142 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 72/141] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:15:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:42.634003 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-da853851-dafd-4203-bed6-de39a29806c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:15:42.643532 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19483c73-a1f7-4926-9ccd-aa645dd641fe None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:42.663912 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:42.741257 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 70/142] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:15:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 03:15:42.835233 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19483c73-a1f7-4926-9ccd-aa645dd641fe None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:42.875941 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d30865-d024-455e-b12a-7a1ab78bf8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:42.876553 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d30865-d024-455e-b12a-7a1ab78bf8ec None admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:42.876834 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d30865-d024-455e-b12a-7a1ab78bf8ec None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:42.877106 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d30865-d024-455e-b12a-7a1ab78bf8ec None admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:42.877751 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d30865-d024-455e-b12a-7a1ab78bf8ec None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:42.879192 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d30865-d024-455e-b12a-7a1ab78bf8ec None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:42.923203 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 73/143] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Oct 4 03:15:42 2022] POST /identity/v3/users => generated 283 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:15:43.161520 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da853851-dafd-4203-bed6-de39a29806c5 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:43.301599 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da853851-dafd-4203-bed6-de39a29806c5 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:43.350087 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99a74d3-0694-4a8c-a8a3-715908651e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:43.350725 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a74d3-0694-4a8c-a8a3-715908651e68 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:43.351012 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a74d3-0694-4a8c-a8a3-715908651e68 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:43.351289 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a74d3-0694-4a8c-a8a3-715908651e68 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:43.367147 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99a74d3-0694-4a8c-a8a3-715908651e68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:15:43.372675 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-b99a74d3-0694-4a8c-a8a3-715908651e68 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 03:15:43.372675 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:15:43.372675 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:15:43.372675 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:15:43.372675 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:15:43.372675 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:15:43.372675 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:15:43.372675 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:15:43.372675 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:15:43.372675 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:15:43.372675 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:15:43.372675 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:15:43.372675 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:15:43.372675 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:15:43.372675 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:15:43.372675 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:15:43.373511 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:15:43.373511 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:15:43.373511 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:15:43.373511 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:15:43.373511 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:15:43.373511 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:15:43.373511 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:15:43.373511 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:15:43.373511 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:15:43.373511 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:15:43.373511 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:15:43.373511 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:15:43.373511 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:15:43.373511 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:15:43.373511 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:15:43.373511 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:15:43.374339 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:15:43.374339 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:15:43.374339 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:15:43.374339 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:15:43.374339 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:15:43.374339 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:15:43.374339 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:15:43.374339 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:15:43.374339 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:15:43.374339 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:15:43.374339 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 03:15:43.374339 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:15:43.374339 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 71/144] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 03:15:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:15:43.379764 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d30865-d024-455e-b12a-7a1ab78bf8ec None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:43.437595 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:43.494588 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d30865-d024-455e-b12a-7a1ab78bf8ec None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:43.533313 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fbda27-c81b-41f3-ac2e-3099e1c52b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:43.533932 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fbda27-c81b-41f3-ac2e-3099e1c52b7b None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:43.534213 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fbda27-c81b-41f3-ac2e-3099e1c52b7b None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:43.534487 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fbda27-c81b-41f3-ac2e-3099e1c52b7b None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:43.535160 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fbda27-c81b-41f3-ac2e-3099e1c52b7b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:15:43.535462 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fbda27-c81b-41f3-ac2e-3099e1c52b7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:43.536878 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fbda27-c81b-41f3-ac2e-3099e1c52b7b None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:43.546449 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 74/145] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Oct 4 03:15:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:43.551979 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99a74d3-0694-4a8c-a8a3-715908651e68 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:43.564715 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:43.677232 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99a74d3-0694-4a8c-a8a3-715908651e68 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:43.714863 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9380cc-b826-4a39-966a-0bb93bfa6b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:43.715865 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9380cc-b826-4a39-966a-0bb93bfa6b33 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:43.716365 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9380cc-b826-4a39-966a-0bb93bfa6b33 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:43.716832 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9380cc-b826-4a39-966a-0bb93bfa6b33 None admin] PATH_INFO: `/v3/users/ccd0afd0141443b58b40b271b1b6f0a1` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:43.718178 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9380cc-b826-4a39-966a-0bb93bfa6b33 None admin] RBAC: Authorizing `identity:get_user(user_id=ccd0afd0141443b58b40b271b1b6f0a1)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:43.719842 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9380cc-b826-4a39-966a-0bb93bfa6b33 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:43.721605 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 72/146] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 03:15:43 2022] GET /identity/v3/users/ccd0afd0141443b58b40b271b1b6f0a1 => generated 289 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:43.727372 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fbda27-c81b-41f3-ac2e-3099e1c52b7b None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:43.865697 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fbda27-c81b-41f3-ac2e-3099e1c52b7b None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:43.879656 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:43.906543 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6830d660-c624-43d7-977d-0f56d5e11efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:43.907182 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6830d660-c624-43d7-977d-0f56d5e11efc None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:43.907461 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6830d660-c624-43d7-977d-0f56d5e11efc None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:43.907760 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6830d660-c624-43d7-977d-0f56d5e11efc None admin] PATH_INFO: `/v3/projects/a7dc4038bbe8418c9837b329ac4d2754` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:43.908906 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6830d660-c624-43d7-977d-0f56d5e11efc None admin] RBAC: Authorizing `identity:get_project(project_id=a7dc4038bbe8418c9837b329ac4d2754)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:43.910338 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6830d660-c624-43d7-977d-0f56d5e11efc None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:43.911991 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 75/147] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 03:15:43 2022] GET /identity/v3/projects/a7dc4038bbe8418c9837b329ac4d2754 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:43.918681 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9380cc-b826-4a39-966a-0bb93bfa6b33 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:44.015089 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:44.040364 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9380cc-b826-4a39-966a-0bb93bfa6b33 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:44.078803 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b5fe3a-dfbb-4461-b6ff-d9dc29657d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:44.079648 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5fe3a-dfbb-4461-b6ff-d9dc29657d7c None admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:44.079932 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5fe3a-dfbb-4461-b6ff-d9dc29657d7c None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:44.080205 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5fe3a-dfbb-4461-b6ff-d9dc29657d7c None admin] PATH_INFO: `/v3/projects/a7dc4038bbe8418c9837b329ac4d2754/users/ccd0afd0141443b58b40b271b1b6f0a1/roles/8513937b0b5c4d0099cb3732beb89fd4` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:44.082165 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b5fe3a-dfbb-4461-b6ff-d9dc29657d7c None admin] RBAC: Authorizing `identity:create_grant(project_id=a7dc4038bbe8418c9837b329ac4d2754, user_id=ccd0afd0141443b58b40b271b1b6f0a1, role_id=8513937b0b5c4d0099cb3732beb89fd4)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:44.083643 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b5fe3a-dfbb-4461-b6ff-d9dc29657d7c None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:44.108329 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 73/148] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Oct 4 03:15:43 2022] PUT /identity/v3/projects/a7dc4038bbe8418c9837b329ac4d2754/users/ccd0afd0141443b58b40b271b1b6f0a1/roles/8513937b0b5c4d0099cb3732beb89fd4 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:15:44.393996 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d6ead-5686-4ddc-a4b2-80172c54d5aa None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:44.394625 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d6ead-5686-4ddc-a4b2-80172c54d5aa None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:44.395130 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d6ead-5686-4ddc-a4b2-80172c54d5aa None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:44.396687 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 76/149] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:15:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:15:44.402681 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe9a2b4-ebc3-4b60-99b2-459364d4b202 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:44.403261 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe9a2b4-ebc3-4b60-99b2-459364d4b202 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:44.403868 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe9a2b4-ebc3-4b60-99b2-459364d4b202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:44.428177 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-cbe9a2b4-ebc3-4b60-99b2-459364d4b202 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:15:44.429728 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-cbe9a2b4-ebc3-4b60-99b2-459364d4b202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:15:44.504621 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 74/150] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:15:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 03:15:44.876408 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6d6ead-5686-4ddc-a4b2-80172c54d5aa None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:45.008648 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6d6ead-5686-4ddc-a4b2-80172c54d5aa None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:45.048500 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87887190-046b-41e4-a3d9-70773ee3ef68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:45.049486 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87887190-046b-41e4-a3d9-70773ee3ef68 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:45.049966 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87887190-046b-41e4-a3d9-70773ee3ef68 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:45.050434 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87887190-046b-41e4-a3d9-70773ee3ef68 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:45.064879 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87887190-046b-41e4-a3d9-70773ee3ef68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:15:45.070021 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-87887190-046b-41e4-a3d9-70773ee3ef68 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 03:15:45.070021 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:15:45.070021 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:15:45.070021 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:15:45.070021 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:15:45.070021 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:15:45.070021 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:15:45.070021 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:15:45.070021 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:15:45.070021 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:15:45.070021 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:15:45.070021 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:15:45.070021 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:15:45.070021 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:15:45.070021 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:15:45.070021 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:15:45.071616 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:15:45.071616 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:15:45.071616 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:15:45.071616 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:15:45.071616 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:15:45.071616 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:15:45.071616 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:15:45.071616 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:15:45.071616 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:15:45.071616 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:15:45.071616 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:15:45.071616 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:15:45.071616 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:15:45.071616 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:15:45.071616 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:15:45.071616 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:15:45.072402 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:15:45.072402 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:15:45.072402 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:15:45.072402 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:15:45.072402 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:15:45.072402 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:15:45.072402 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:15:45.072402 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:15:45.072402 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:15:45.072402 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:15:45.072402 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 03:15:45.072402 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:15:45.074678 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 77/151] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 4 03:15:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:15:45.080683 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe9a2b4-ebc3-4b60-99b2-459364d4b202 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:45.151275 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:45.194088 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe9a2b4-ebc3-4b60-99b2-459364d4b202 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:45.234336 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f176f09-cdf7-4cdf-9e62-c943a4af2ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:45.235370 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f176f09-cdf7-4cdf-9e62-c943a4af2ef9 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:45.235973 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f176f09-cdf7-4cdf-9e62-c943a4af2ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:45.236454 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f176f09-cdf7-4cdf-9e62-c943a4af2ef9 None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:45.237456 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f176f09-cdf7-4cdf-9e62-c943a4af2ef9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:15:45.237969 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f176f09-cdf7-4cdf-9e62-c943a4af2ef9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:45.239638 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f176f09-cdf7-4cdf-9e62-c943a4af2ef9 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:45.250360 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 75/152] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 03:15:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:45.256337 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87887190-046b-41e4-a3d9-70773ee3ef68 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:45.312113 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:45.379470 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87887190-046b-41e4-a3d9-70773ee3ef68 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:45.421412 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828a3e9a-bec0-44e5-86bd-e88a58cb8050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:45.421968 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a3e9a-bec0-44e5-86bd-e88a58cb8050 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:45.422247 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a3e9a-bec0-44e5-86bd-e88a58cb8050 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:45.422518 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a3e9a-bec0-44e5-86bd-e88a58cb8050 None admin] PATH_INFO: `/v3/users/7c1281e81e9c4e3da30715cc2f1b3156` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:45.423780 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828a3e9a-bec0-44e5-86bd-e88a58cb8050 None admin] RBAC: Authorizing `identity:get_user(user_id=7c1281e81e9c4e3da30715cc2f1b3156)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:45.425249 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828a3e9a-bec0-44e5-86bd-e88a58cb8050 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:45.427023 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 78/153] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 03:15:45 2022] GET /identity/v3/users/7c1281e81e9c4e3da30715cc2f1b3156 => generated 247 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:45.433532 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f176f09-cdf7-4cdf-9e62-c943a4af2ef9 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:45.561021 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f176f09-cdf7-4cdf-9e62-c943a4af2ef9 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:45.590758 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:45.601287 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0758f31c-3084-4815-b8cd-77e9f7bfdd01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:45.601899 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0758f31c-3084-4815-b8cd-77e9f7bfdd01 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:45.603126 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0758f31c-3084-4815-b8cd-77e9f7bfdd01 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:45.603998 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0758f31c-3084-4815-b8cd-77e9f7bfdd01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:45.618228 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a982f-c476-4b2f-aa28-3a1e50a32dfd None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:45.618580 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a982f-c476-4b2f-aa28-3a1e50a32dfd None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:45.618903 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a982f-c476-4b2f-aa28-3a1e50a32dfd None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:45.620747 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 79/154] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:15:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 03:15:45.626005 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc861ff4-484f-4193-859f-0f4bd4b306e8 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:45.626287 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc861ff4-484f-4193-859f-0f4bd4b306e8 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:45.626561 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc861ff4-484f-4193-859f-0f4bd4b306e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:45.660685 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-bc861ff4-484f-4193-859f-0f4bd4b306e8 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:15:45.662891 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-bc861ff4-484f-4193-859f-0f4bd4b306e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:15:45.744722 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0758f31c-3084-4815-b8cd-77e9f7bfdd01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:45.746241 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0758f31c-3084-4815-b8cd-77e9f7bfdd01 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:45.812105 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 80/155] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:15:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 03:15:45.813719 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b3890-961d-4bfc-865c-bcfe5ec6bf4e None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:45.814202 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b3890-961d-4bfc-865c-bcfe5ec6bf4e None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:45.814673 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b3890-961d-4bfc-865c-bcfe5ec6bf4e None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:45.816159 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 81/156] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:15:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:15:45.825424 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b543744c-3821-401b-bfe4-be01c1d02704 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:45.826004 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b543744c-3821-401b-bfe4-be01c1d02704 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:45.826482 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b543744c-3821-401b-bfe4-be01c1d02704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:45.880506 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-b543744c-3821-401b-bfe4-be01c1d02704 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:15:45.882516 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-b543744c-3821-401b-bfe4-be01c1d02704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:15:45.952577 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:45.957648 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 76/157] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 03:15:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 03:15:45.963585 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0758f31c-3084-4815-b8cd-77e9f7bfdd01 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:46.009571 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:46.042530 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 82/158] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:15:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Oct 04 03:15:46.147243 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0758f31c-3084-4815-b8cd-77e9f7bfdd01 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:46.201087 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9549cc11-1540-478f-ac03-ca06e72a30ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:46.202082 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9549cc11-1540-478f-ac03-ca06e72a30ae None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:46.202581 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9549cc11-1540-478f-ac03-ca06e72a30ae None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:46.203059 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9549cc11-1540-478f-ac03-ca06e72a30ae None admin] PATH_INFO: `/v3/projects/a7dc4038bbe8418c9837b329ac4d2754` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:46.204454 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9549cc11-1540-478f-ac03-ca06e72a30ae None admin] RBAC: Authorizing `identity:get_project(project_id=a7dc4038bbe8418c9837b329ac4d2754)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:46.206097 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9549cc11-1540-478f-ac03-ca06e72a30ae None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:46.208269 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 77/159] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 03:15:45 2022] GET /identity/v3/projects/a7dc4038bbe8418c9837b329ac4d2754 => generated 298 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:46.214426 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b543744c-3821-401b-bfe4-be01c1d02704 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:46.325479 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d252576c-721e-4c44-bfc6-3d25663775ac None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:46.326204 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d252576c-721e-4c44-bfc6-3d25663775ac None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:46.326764 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d252576c-721e-4c44-bfc6-3d25663775ac None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:46.328660 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 78/160] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:15:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:15:46.333738 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee0005-67f3-4612-a065-2473d2dc9cb8 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:46.334350 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee0005-67f3-4612-a065-2473d2dc9cb8 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:46.334839 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee0005-67f3-4612-a065-2473d2dc9cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:46.369245 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-21ee0005-67f3-4612-a065-2473d2dc9cb8 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:15:46.370943 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-21ee0005-67f3-4612-a065-2473d2dc9cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:15:46.379073 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b543744c-3821-401b-bfe4-be01c1d02704 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:46.460774 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4507f37-7652-4904-94bc-6797e5e4076b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:46.461955 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4507f37-7652-4904-94bc-6797e5e4076b None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:46.462412 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4507f37-7652-4904-94bc-6797e5e4076b None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:46.462905 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4507f37-7652-4904-94bc-6797e5e4076b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:46.463682 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4507f37-7652-4904-94bc-6797e5e4076b None admin] RBAC: Adding query filter params (role.id=fe9379cda35c4ff78576fe48b60bea3c, scope.project.id=a7dc4038bbe8418c9837b329ac4d2754, user.id=7c1281e81e9c4e3da30715cc2f1b3156) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:15:46.463997 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4507f37-7652-4904-94bc-6797e5e4076b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:46.465440 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4507f37-7652-4904-94bc-6797e5e4076b None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:46.485637 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 83/161] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 03:15:46 2022] GET /identity/v3/role_assignments?user.id=7c1281e81e9c4e3da30715cc2f1b3156&scope.project.id=a7dc4038bbe8418c9837b329ac4d2754&role.id=fe9379cda35c4ff78576fe48b60bea3c => generated 608 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:46.486488 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4507f37-7652-4904-94bc-6797e5e4076b None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:46.516657 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 79/162] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:15:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 03:15:46.552660 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:46.659957 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4507f37-7652-4904-94bc-6797e5e4076b None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:46.706384 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e554527c-e2d6-4450-83a9-b0f249ef6e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:46.707019 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e554527c-e2d6-4450-83a9-b0f249ef6e70 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:46.707300 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e554527c-e2d6-4450-83a9-b0f249ef6e70 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:46.707620 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e554527c-e2d6-4450-83a9-b0f249ef6e70 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:46.728809 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e554527c-e2d6-4450-83a9-b0f249ef6e70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:15:46.734269 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-e554527c-e2d6-4450-83a9-b0f249ef6e70 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 03:15:46.734269 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:15:46.734269 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:15:46.734269 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:15:46.734269 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:15:46.734269 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:15:46.734269 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:15:46.734269 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:15:46.734269 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:15:46.734269 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:15:46.734269 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:15:46.734269 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:15:46.734269 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:15:46.734269 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:15:46.734269 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:15:46.734269 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:15:46.735157 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:15:46.735157 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:15:46.735157 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:15:46.735157 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:15:46.735157 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:15:46.735157 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:15:46.735157 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:15:46.735157 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:15:46.735157 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:15:46.735157 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:15:46.735157 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:15:46.735157 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:15:46.735157 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:15:46.735157 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:15:46.735157 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:15:46.735157 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:15:46.735968 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:15:46.735968 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:15:46.735968 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:15:46.735968 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:15:46.735968 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:15:46.735968 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:15:46.735968 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:15:46.735968 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:15:46.735968 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:15:46.735968 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:15:46.735968 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 03:15:46.735968 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:15:46.735968 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 84/163] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Oct 4 03:15:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:15:46.740613 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ee0005-67f3-4612-a065-2473d2dc9cb8 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:46.746050 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e554527c-e2d6-4450-83a9-b0f249ef6e70 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:46.792823 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:46.964681 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:46.968609 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ee0005-67f3-4612-a065-2473d2dc9cb8 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:46.985637 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e554527c-e2d6-4450-83a9-b0f249ef6e70 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:47.057364 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff56dbfc-01ff-4812-9236-878b196b4257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:47.058352 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56dbfc-01ff-4812-9236-878b196b4257 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:47.058852 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56dbfc-01ff-4812-9236-878b196b4257 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:47.059320 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56dbfc-01ff-4812-9236-878b196b4257 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:47.068182 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259908d7-fc1e-4389-8ed4-ac24260b11f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:47.068800 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259908d7-fc1e-4389-8ed4-ac24260b11f6 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:47.069082 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259908d7-fc1e-4389-8ed4-ac24260b11f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:47.069355 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259908d7-fc1e-4389-8ed4-ac24260b11f6 None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:47.075512 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259908d7-fc1e-4389-8ed4-ac24260b11f6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:15:47.075512 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259908d7-fc1e-4389-8ed4-ac24260b11f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:47.075512 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259908d7-fc1e-4389-8ed4-ac24260b11f6 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:47.090532 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 85/164] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 03:15:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:15:47.091744 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff56dbfc-01ff-4812-9236-878b196b4257 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:15:47.096095 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259908d7-fc1e-4389-8ed4-ac24260b11f6 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:47.097110 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-ff56dbfc-01ff-4812-9236-878b196b4257 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 03:15:47.097110 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:15:47.097110 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:15:47.097110 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:15:47.097110 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:15:47.097110 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:15:47.097110 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:15:47.097110 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:15:47.097110 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:15:47.097110 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:15:47.097110 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:15:47.097110 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:15:47.097110 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:15:47.097110 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:15:47.097110 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:15:47.097110 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:15:47.097960 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:15:47.097960 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:15:47.097960 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:15:47.097960 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:15:47.097960 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:15:47.097960 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:15:47.097960 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:15:47.097960 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:15:47.097960 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:15:47.097960 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:15:47.097960 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:15:47.097960 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:15:47.097960 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:15:47.097960 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:15:47.097960 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:15:47.097960 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:15:47.098719 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:15:47.098719 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:15:47.098719 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:15:47.098719 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:15:47.098719 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:15:47.098719 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:15:47.098719 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:15:47.098719 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:15:47.098719 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:15:47.098719 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:15:47.098719 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 03:15:47.098719 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:15:47.101228 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 80/165] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 03:15:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:15:47.109110 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff56dbfc-01ff-4812-9236-878b196b4257 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:47.276642 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:47.299307 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff56dbfc-01ff-4812-9236-878b196b4257 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:47.303688 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259908d7-fc1e-4389-8ed4-ac24260b11f6 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:47.360252 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5379f91c-86ed-4326-b8cc-0777f01a6fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:47.360866 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5379f91c-86ed-4326-b8cc-0777f01a6fbb None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:47.361146 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5379f91c-86ed-4326-b8cc-0777f01a6fbb None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:47.361418 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5379f91c-86ed-4326-b8cc-0777f01a6fbb None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:47.362091 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5379f91c-86ed-4326-b8cc-0777f01a6fbb None admin] RBAC: Adding query filter params (name=member) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:15:47.362391 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5379f91c-86ed-4326-b8cc-0777f01a6fbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:47.363910 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5379f91c-86ed-4326-b8cc-0777f01a6fbb None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:47.384109 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 81/166] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Oct 4 03:15:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:47.385264 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5379f91c-86ed-4326-b8cc-0777f01a6fbb None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:47.385442 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6b99d2-ee41-41b3-9b3a-d8aca12a0e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:47.386174 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b99d2-ee41-41b3-9b3a-d8aca12a0e9e None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:47.386459 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b99d2-ee41-41b3-9b3a-d8aca12a0e9e None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:47.386732 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b99d2-ee41-41b3-9b3a-d8aca12a0e9e None admin] PATH_INFO: `/v3/users/b72c77a1143648e58bef98b7bb2677d1` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:47.387922 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6b99d2-ee41-41b3-9b3a-d8aca12a0e9e None admin] RBAC: Authorizing `identity:get_user(user_id=b72c77a1143648e58bef98b7bb2677d1)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:47.389376 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6b99d2-ee41-41b3-9b3a-d8aca12a0e9e None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:47.400011 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 86/167] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 03:15:47 2022] GET /identity/v3/users/b72c77a1143648e58bef98b7bb2677d1 => generated 275 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:47.401174 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6b99d2-ee41-41b3-9b3a-d8aca12a0e9e None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:47.449152 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:47.600239 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6b99d2-ee41-41b3-9b3a-d8aca12a0e9e None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:47.622935 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5379f91c-86ed-4326-b8cc-0777f01a6fbb None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:47.698001 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d839e2f2-414f-4d93-b826-db8b4ba80116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:47.698642 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d839e2f2-414f-4d93-b826-db8b4ba80116 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:47.698918 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d839e2f2-414f-4d93-b826-db8b4ba80116 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:47.699188 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d839e2f2-414f-4d93-b826-db8b4ba80116 None admin] PATH_INFO: `/v3/users/b72c77a1143648e58bef98b7bb2677d1` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:47.700993 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d839e2f2-414f-4d93-b826-db8b4ba80116 None admin] RBAC: Authorizing `identity:get_user(user_id=b72c77a1143648e58bef98b7bb2677d1)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:47.702430 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d839e2f2-414f-4d93-b826-db8b4ba80116 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:47.704042 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 87/168] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 03:15:47 2022] GET /identity/v3/users/b72c77a1143648e58bef98b7bb2677d1 => generated 275 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:47.704801 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d839e2f2-414f-4d93-b826-db8b4ba80116 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:47.716230 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b63c1e-20b3-4041-bbba-5984863a3888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:47.716880 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b63c1e-20b3-4041-bbba-5984863a3888 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:47.717167 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b63c1e-20b3-4041-bbba-5984863a3888 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:47.717448 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b63c1e-20b3-4041-bbba-5984863a3888 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:47.749000 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b63c1e-20b3-4041-bbba-5984863a3888 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:15:47.754505 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-c6b63c1e-20b3-4041-bbba-5984863a3888 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 03:15:47.754505 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:15:47.754505 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:15:47.754505 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:15:47.754505 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:15:47.754505 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:15:47.754505 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:15:47.754505 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:15:47.754505 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:15:47.754505 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:15:47.754505 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:15:47.754505 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:15:47.754505 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:15:47.754505 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:15:47.754505 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:15:47.754505 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:15:47.755391 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:15:47.755391 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:15:47.755391 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:15:47.755391 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:15:47.755391 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:15:47.755391 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:15:47.755391 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:15:47.755391 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:15:47.755391 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:15:47.755391 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:15:47.755391 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:15:47.755391 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:15:47.755391 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:15:47.755391 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:15:47.755391 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:15:47.755391 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:15:47.756207 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:15:47.756207 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:15:47.756207 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:15:47.756207 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:15:47.756207 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:15:47.756207 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:15:47.756207 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:15:47.756207 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:15:47.756207 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:15:47.756207 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:15:47.756207 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 03:15:47.756207 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:15:47.756803 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 82/169] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 03:15:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:15:47.757589 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b63c1e-20b3-4041-bbba-5984863a3888 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:47.792585 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:47.928578 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:47.941932 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d839e2f2-414f-4d93-b826-db8b4ba80116 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:47.986858 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24f313d-c347-483d-b085-eb9227ec76c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:47.987480 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f313d-c347-483d-b085-eb9227ec76c5 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:47.987771 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f313d-c347-483d-b085-eb9227ec76c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:47.988042 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f313d-c347-483d-b085-eb9227ec76c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:48.018248 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b63c1e-20b3-4041-bbba-5984863a3888 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:48.090058 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbceff2-6aff-47dd-b118-97c85a3e21d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:48.090672 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbceff2-6aff-47dd-b118-97c85a3e21d5 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:48.090948 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbceff2-6aff-47dd-b118-97c85a3e21d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:48.091221 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbceff2-6aff-47dd-b118-97c85a3e21d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:48.125443 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24f313d-c347-483d-b085-eb9227ec76c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:48.127582 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24f313d-c347-483d-b085-eb9227ec76c5 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:48.190729 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbceff2-6aff-47dd-b118-97c85a3e21d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:48.193557 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbceff2-6aff-47dd-b118-97c85a3e21d5 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:48.205160 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:48.233686 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:48.248747 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 88/170] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 03:15:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 03:15:48.249874 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24f313d-c347-483d-b085-eb9227ec76c5 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:48.311327 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 83/171] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 03:15:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 03:15:48.312861 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ecd17-ec7f-4e52-b315-dd2094c136fd None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:48.313146 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ecd17-ec7f-4e52-b315-dd2094c136fd None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:48.313415 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ecd17-ec7f-4e52-b315-dd2094c136fd None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:48.314654 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 84/172] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:15:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:15:48.320146 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5413f-0a99-40b7-b7d8-0646ee502cf7 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:48.320627 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5413f-0a99-40b7-b7d8-0646ee502cf7 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:48.321428 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5413f-0a99-40b7-b7d8-0646ee502cf7 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:48.322677 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 85/173] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:15:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:15:48.326959 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e5413f-0a99-40b7-b7d8-0646ee502cf7 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:48.378523 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24f313d-c347-483d-b085-eb9227ec76c5 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:48.416186 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee626c0-e80d-40f0-bf27-4018971da388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:48.416738 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee626c0-e80d-40f0-bf27-4018971da388 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:48.417016 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee626c0-e80d-40f0-bf27-4018971da388 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:48.417284 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee626c0-e80d-40f0-bf27-4018971da388 None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:48.417948 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee626c0-e80d-40f0-bf27-4018971da388 None admin] RBAC: Adding query filter params (name=member) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:15:48.418246 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee626c0-e80d-40f0-bf27-4018971da388 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:48.419626 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee626c0-e80d-40f0-bf27-4018971da388 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:48.433124 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 89/174] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Oct 4 03:15:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:48.434292 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee626c0-e80d-40f0-bf27-4018971da388 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:48.460193 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e5413f-0a99-40b7-b7d8-0646ee502cf7 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:48.471677 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:48.501475 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a41b41-f8cc-49d0-a9ef-57efa0989665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:48.502420 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a41b41-f8cc-49d0-a9ef-57efa0989665 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:48.502789 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:48.503040 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a41b41-f8cc-49d0-a9ef-57efa0989665 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:48.503448 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a41b41-f8cc-49d0-a9ef-57efa0989665 None admin] PATH_INFO: `/v3/projects/a7dc4038bbe8418c9837b329ac4d2754` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:48.504932 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a41b41-f8cc-49d0-a9ef-57efa0989665 None admin] RBAC: Authorizing `identity:get_project(project_id=a7dc4038bbe8418c9837b329ac4d2754)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:48.506927 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a41b41-f8cc-49d0-a9ef-57efa0989665 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:48.510032 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 86/175] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 03:15:48 2022] GET /identity/v3/projects/a7dc4038bbe8418c9837b329ac4d2754 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:48.511638 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4bfb4-d786-4c48-8fde-27d02226dbfc None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:48.512078 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4bfb4-d786-4c48-8fde-27d02226dbfc None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:48.512500 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4bfb4-d786-4c48-8fde-27d02226dbfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:48.531307 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-81b4bfb4-d786-4c48-8fde-27d02226dbfc None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:15:48.532832 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-81b4bfb4-d786-4c48-8fde-27d02226dbfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:15:48.564372 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee626c0-e80d-40f0-bf27-4018971da388 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:48.602836 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9e0de4-d3ac-4afd-b641-726fe9b4ff5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:48.603473 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e0de4-d3ac-4afd-b641-726fe9b4ff5d None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:48.603783 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e0de4-d3ac-4afd-b641-726fe9b4ff5d None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:48.604045 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e0de4-d3ac-4afd-b641-726fe9b4ff5d None admin] PATH_INFO: `/v3/projects/a7dc4038bbe8418c9837b329ac4d2754` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:48.605176 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9e0de4-d3ac-4afd-b641-726fe9b4ff5d None admin] RBAC: Authorizing `identity:get_project(project_id=a7dc4038bbe8418c9837b329ac4d2754)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:48.606625 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9e0de4-d3ac-4afd-b641-726fe9b4ff5d None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:48.608331 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 90/176] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 03:15:48 2022] GET /identity/v3/projects/a7dc4038bbe8418c9837b329ac4d2754 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:48.609466 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53829f-9c3e-4cd5-a5cd-8ef307a91540 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:48.609709 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53829f-9c3e-4cd5-a5cd-8ef307a91540 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:48.609983 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53829f-9c3e-4cd5-a5cd-8ef307a91540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:48.623524 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 87/177] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:15:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 03:15:48.623524 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b4bfb4-d786-4c48-8fde-27d02226dbfc None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:48.645893 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-ea53829f-9c3e-4cd5-a5cd-8ef307a91540 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:15:48.647093 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-ea53829f-9c3e-4cd5-a5cd-8ef307a91540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:15:48.726596 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 91/178] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:15:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 03:15:48.736383 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea53829f-9c3e-4cd5-a5cd-8ef307a91540 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:48.739240 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b4bfb4-d786-4c48-8fde-27d02226dbfc None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:48.752499 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:48.785496 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d191799a-f870-4720-bcda-05ca7944cff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:48.786626 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d191799a-f870-4720-bcda-05ca7944cff2 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:48.786973 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d191799a-f870-4720-bcda-05ca7944cff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:48.787339 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d191799a-f870-4720-bcda-05ca7944cff2 None admin] PATH_INFO: `/v3/users/b72c77a1143648e58bef98b7bb2677d1` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:48.788677 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d191799a-f870-4720-bcda-05ca7944cff2 None admin] RBAC: Authorizing `identity:get_user(user_id=b72c77a1143648e58bef98b7bb2677d1)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:48.790614 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d191799a-f870-4720-bcda-05ca7944cff2 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:48.793521 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 88/179] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 03:15:48 2022] GET /identity/v3/users/b72c77a1143648e58bef98b7bb2677d1 => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:48.794833 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faebb603-bb6f-4cba-a544-ae13978fa08e None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:48.795198 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faebb603-bb6f-4cba-a544-ae13978fa08e None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:48.795561 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faebb603-bb6f-4cba-a544-ae13978fa08e None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:48.796978 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 89/180] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:15:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:15:48.800248 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faebb603-bb6f-4cba-a544-ae13978fa08e None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:48.814759 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:48.881704 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea53829f-9c3e-4cd5-a5cd-8ef307a91540 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:48.918597 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f78e0c-e547-4c7a-abf9-d1637b7c4999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:48.919198 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f78e0c-e547-4c7a-abf9-d1637b7c4999 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:48.919481 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f78e0c-e547-4c7a-abf9-d1637b7c4999 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:48.919782 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f78e0c-e547-4c7a-abf9-d1637b7c4999 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:48.920506 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f78e0c-e547-4c7a-abf9-d1637b7c4999 None admin] RBAC: Adding query filter params (role.id=f2332a9a00b74fe0846d7211dd3850cb, scope.project.id=a7dc4038bbe8418c9837b329ac4d2754, user.id=b72c77a1143648e58bef98b7bb2677d1) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:15:48.920812 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f78e0c-e547-4c7a-abf9-d1637b7c4999 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:48.922257 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f78e0c-e547-4c7a-abf9-d1637b7c4999 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:48.924690 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faebb603-bb6f-4cba-a544-ae13978fa08e None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:48.928280 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 92/181] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 03:15:48 2022] GET /identity/v3/role_assignments?user.id=b72c77a1143648e58bef98b7bb2677d1&scope.project.id=a7dc4038bbe8418c9837b329ac4d2754&role.id=f2332a9a00b74fe0846d7211dd3850cb => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:48.929423 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff1079-6152-4f50-af6c-24016e23949d None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:48.929709 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff1079-6152-4f50-af6c-24016e23949d None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:48.929985 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff1079-6152-4f50-af6c-24016e23949d None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:48.936278 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 93/182] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:15:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:15:48.937242 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ff1079-6152-4f50-af6c-24016e23949d None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:48.970544 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8548fb31-1023-42a1-bbc3-8b963e409b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:48.971707 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548fb31-1023-42a1-bbc3-8b963e409b9f None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:48.972346 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548fb31-1023-42a1-bbc3-8b963e409b9f None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:48.972826 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548fb31-1023-42a1-bbc3-8b963e409b9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:48.973801 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8548fb31-1023-42a1-bbc3-8b963e409b9f None admin] RBAC: Adding query filter params (role.id=04d0e4575a28440eb4349b4a6565e8b8, scope.project.id=a7dc4038bbe8418c9837b329ac4d2754, user.id=b72c77a1143648e58bef98b7bb2677d1) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:15:48.974347 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8548fb31-1023-42a1-bbc3-8b963e409b9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:48.976194 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8548fb31-1023-42a1-bbc3-8b963e409b9f None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:48.987621 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 90/183] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 03:15:48 2022] GET /identity/v3/role_assignments?user.id=b72c77a1143648e58bef98b7bb2677d1&scope.project.id=a7dc4038bbe8418c9837b329ac4d2754&role.id=04d0e4575a28440eb4349b4a6565e8b8 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:48.989322 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e0150-e346-4050-8030-145ff9910b97 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:48.989759 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e0150-e346-4050-8030-145ff9910b97 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:48.990185 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e0150-e346-4050-8030-145ff9910b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:49.015718 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-976e0150-e346-4050-8030-145ff9910b97 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:15:49.017242 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-976e0150-e346-4050-8030-145ff9910b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:15:49.068796 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:49.116546 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 91/184] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:15:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 03:15:49.117638 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e0150-e346-4050-8030-145ff9910b97 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:49.125617 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ff1079-6152-4f50-af6c-24016e23949d None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:49.142417 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:49.168417 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e987cd-8def-4b0a-9427-017ddda8e6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:49.169040 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e987cd-8def-4b0a-9427-017ddda8e6a1 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:49.169318 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e987cd-8def-4b0a-9427-017ddda8e6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:49.169593 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e987cd-8def-4b0a-9427-017ddda8e6a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:49.243567 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e0150-e346-4050-8030-145ff9910b97 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:49.252567 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e987cd-8def-4b0a-9427-017ddda8e6a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:49.254020 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e987cd-8def-4b0a-9427-017ddda8e6a1 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:49.290589 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1d30e2-0422-42a2-a8d0-3bce24b304e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:49.291381 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d30e2-0422-42a2-a8d0-3bce24b304e1 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:49.291732 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d30e2-0422-42a2-a8d0-3bce24b304e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:49.292012 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d30e2-0422-42a2-a8d0-3bce24b304e1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:49.308076 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1d30e2-0422-42a2-a8d0-3bce24b304e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:15:49.314661 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-3c1d30e2-0422-42a2-a8d0-3bce24b304e1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 03:15:49.314661 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:15:49.314661 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:15:49.314661 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:15:49.314661 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:15:49.314661 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:15:49.314661 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:15:49.314661 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:15:49.314661 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:15:49.314661 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:15:49.314661 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:15:49.314661 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:15:49.314661 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:15:49.314661 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:15:49.314661 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:15:49.314661 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:15:49.316026 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:15:49.316026 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:15:49.316026 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:15:49.316026 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:15:49.316026 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:15:49.316026 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:15:49.316026 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:15:49.316026 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:15:49.316026 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:15:49.316026 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:15:49.316026 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:15:49.316026 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:15:49.316026 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:15:49.316026 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:15:49.316026 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:15:49.316026 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:15:49.317031 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:15:49.317031 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:15:49.317031 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:15:49.317031 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:15:49.317031 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:15:49.317031 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:15:49.317031 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:15:49.317031 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:15:49.317031 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:15:49.317031 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:15:49.317031 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 03:15:49.317031 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:15:49.317031 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 92/185] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 4 03:15:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:15:49.317675 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcfa843-5ff7-448b-8c9e-f20f18a83772 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:49.317675 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcfa843-5ff7-448b-8c9e-f20f18a83772 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:49.319253 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcfa843-5ff7-448b-8c9e-f20f18a83772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:49.343692 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-7dcfa843-5ff7-448b-8c9e-f20f18a83772 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:15:49.344911 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-7dcfa843-5ff7-448b-8c9e-f20f18a83772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:15:49.375577 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:49.378171 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 94/186] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 03:15:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 03:15:49.379444 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e987cd-8def-4b0a-9427-017ddda8e6a1 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:49.395364 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:49.429858 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 93/187] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:15:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 03:15:49.429858 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcfa843-5ff7-448b-8c9e-f20f18a83772 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:49.492327 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e987cd-8def-4b0a-9427-017ddda8e6a1 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:49.530131 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c8e9e0-a049-46d6-8236-a4842c41dbbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:49.530685 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c8e9e0-a049-46d6-8236-a4842c41dbbd None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:49.530967 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c8e9e0-a049-46d6-8236-a4842c41dbbd None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:49.531240 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c8e9e0-a049-46d6-8236-a4842c41dbbd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:49.536343 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcfa843-5ff7-448b-8c9e-f20f18a83772 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:49.541449 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c8e9e0-a049-46d6-8236-a4842c41dbbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:15:49.546244 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-56c8e9e0-a049-46d6-8236-a4842c41dbbd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 03:15:49.546244 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:15:49.546244 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:15:49.546244 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:15:49.546244 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:15:49.546244 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:15:49.546244 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:15:49.546244 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:15:49.546244 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:15:49.546244 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:15:49.546244 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:15:49.546244 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:15:49.546244 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:15:49.546244 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:15:49.546244 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:15:49.546244 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:15:49.547186 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:15:49.547186 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:15:49.547186 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:15:49.547186 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:15:49.547186 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:15:49.547186 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:15:49.547186 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:15:49.547186 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:15:49.547186 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:15:49.547186 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:15:49.547186 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:15:49.547186 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:15:49.547186 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:15:49.547186 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:15:49.547186 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:15:49.547186 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:15:49.553356 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:15:49.553356 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:15:49.553356 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:15:49.553356 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:15:49.553356 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:15:49.553356 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:15:49.553356 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:15:49.553356 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:15:49.553356 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:15:49.553356 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:15:49.553356 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 03:15:49.553356 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:15:49.553356 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 95/188] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 03:15:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:15:49.553356 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c8e9e0-a049-46d6-8236-a4842c41dbbd None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:49.576409 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1dfc9b-26e1-438a-adb5-84e0a21bdd40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:49.577012 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1dfc9b-26e1-438a-adb5-84e0a21bdd40 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:49.577291 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1dfc9b-26e1-438a-adb5-84e0a21bdd40 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:49.577563 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1dfc9b-26e1-438a-adb5-84e0a21bdd40 None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:49.578219 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1dfc9b-26e1-438a-adb5-84e0a21bdd40 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:15:49.578523 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1dfc9b-26e1-438a-adb5-84e0a21bdd40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:49.579904 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1dfc9b-26e1-438a-adb5-84e0a21bdd40 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:49.589039 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 94/189] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 03:15:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:49.594502 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1dfc9b-26e1-438a-adb5-84e0a21bdd40 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:49.617018 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:49.627704 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:49.659415 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c8e9e0-a049-46d6-8236-a4842c41dbbd None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:49.696070 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f52cc79-1b31-4025-82ce-18c925a88821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:49.696692 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52cc79-1b31-4025-82ce-18c925a88821 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:49.696971 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52cc79-1b31-4025-82ce-18c925a88821 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:49.697243 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52cc79-1b31-4025-82ce-18c925a88821 None admin] PATH_INFO: `/v3/projects/f7e1658c45e44adf92c8f5d873786cdc` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:49.698378 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f52cc79-1b31-4025-82ce-18c925a88821 None admin] RBAC: Authorizing `identity:get_project(project_id=f7e1658c45e44adf92c8f5d873786cdc)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:49.699854 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f52cc79-1b31-4025-82ce-18c925a88821 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:49.701430 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1dfc9b-26e1-438a-adb5-84e0a21bdd40 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:49.701575 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 96/190] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 03:15:49 2022] GET /identity/v3/projects/f7e1658c45e44adf92c8f5d873786cdc => generated 312 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:49.702210 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f52cc79-1b31-4025-82ce-18c925a88821 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:49.735784 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78b3fc1-ea68-43d1-a065-542aeb428bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:49.736409 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b3fc1-ea68-43d1-a065-542aeb428bc1 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:49.736691 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b3fc1-ea68-43d1-a065-542aeb428bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:49.736965 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b3fc1-ea68-43d1-a065-542aeb428bc1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:49.747345 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78b3fc1-ea68-43d1-a065-542aeb428bc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:15:49.752585 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-e78b3fc1-ea68-43d1-a065-542aeb428bc1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 03:15:49.752585 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:15:49.752585 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:15:49.752585 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:15:49.752585 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:15:49.752585 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:15:49.752585 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:15:49.752585 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:15:49.752585 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:15:49.752585 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:15:49.752585 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:15:49.752585 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:15:49.752585 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:15:49.752585 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:15:49.752585 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:15:49.752585 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:15:49.753628 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:15:49.753628 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:15:49.753628 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:15:49.753628 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:15:49.753628 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:15:49.753628 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:15:49.753628 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:15:49.753628 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:15:49.753628 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:15:49.753628 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:15:49.753628 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:15:49.753628 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:15:49.753628 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:15:49.753628 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:15:49.753628 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:15:49.753628 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:15:49.754616 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:15:49.754616 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:15:49.754616 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:15:49.754616 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:15:49.754616 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:15:49.754616 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:15:49.754616 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:15:49.754616 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:15:49.754616 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:15:49.754616 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:15:49.754616 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 03:15:49.754616 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:15:49.754616 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 95/191] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Oct 4 03:15:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:15:49.759985 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78b3fc1-ea68-43d1-a065-542aeb428bc1 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:49.802256 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f52cc79-1b31-4025-82ce-18c925a88821 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:49.838601 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab3b9da-106f-4baf-a3bf-f3ae339a3339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:49.839362 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab3b9da-106f-4baf-a3bf-f3ae339a3339 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:49.839676 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab3b9da-106f-4baf-a3bf-f3ae339a3339 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:49.839961 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab3b9da-106f-4baf-a3bf-f3ae339a3339 None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:49.840634 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab3b9da-106f-4baf-a3bf-f3ae339a3339 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:15:49.840778 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:49.840929 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab3b9da-106f-4baf-a3bf-f3ae339a3339 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:49.842377 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab3b9da-106f-4baf-a3bf-f3ae339a3339 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:49.851179 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 97/192] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Oct 4 03:15:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:49.856393 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab3b9da-106f-4baf-a3bf-f3ae339a3339 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:49.859896 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:49.861260 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78b3fc1-ea68-43d1-a065-542aeb428bc1 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:49.895195 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf6142-ef7c-4b11-bf62-93f5c2f358b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:49.895871 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf6142-ef7c-4b11-bf62-93f5c2f358b6 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:49.896151 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf6142-ef7c-4b11-bf62-93f5c2f358b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:49.896426 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf6142-ef7c-4b11-bf62-93f5c2f358b6 None admin] PATH_INFO: `/v3/users/b251ff62818e42c59185d214058156f4` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:49.909727 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bf6142-ef7c-4b11-bf62-93f5c2f358b6 None admin] RBAC: Authorizing `identity:get_user(user_id=b251ff62818e42c59185d214058156f4)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:49.911174 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bf6142-ef7c-4b11-bf62-93f5c2f358b6 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:49.912807 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 96/193] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 03:15:49 2022] GET /identity/v3/users/b251ff62818e42c59185d214058156f4 => generated 283 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:49.913557 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf6142-ef7c-4b11-bf62-93f5c2f358b6 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:49.961424 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab3b9da-106f-4baf-a3bf-f3ae339a3339 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:49.993891 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b754bb8c-6775-4585-88aa-a741e230179f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:49.994516 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b754bb8c-6775-4585-88aa-a741e230179f None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:49.994795 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b754bb8c-6775-4585-88aa-a741e230179f None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:49.995069 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b754bb8c-6775-4585-88aa-a741e230179f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:49.996206 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b754bb8c-6775-4585-88aa-a741e230179f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:49.997733 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b754bb8c-6775-4585-88aa-a741e230179f None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:49.999369 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 98/194] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:15:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:49.999980 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b754bb8c-6775-4585-88aa-a741e230179f None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:50.013563 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf6142-ef7c-4b11-bf62-93f5c2f358b6 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:50.046588 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab14ecb4-3c21-451e-abba-824a58c3f387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:50.047180 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab14ecb4-3c21-451e-abba-824a58c3f387 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:50.047464 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab14ecb4-3c21-451e-abba-824a58c3f387 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:50.047761 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab14ecb4-3c21-451e-abba-824a58c3f387 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:50.048470 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab14ecb4-3c21-451e-abba-824a58c3f387 None admin] RBAC: Adding query filter params (role.id=04d0e4575a28440eb4349b4a6565e8b8, scope.project.id=f7e1658c45e44adf92c8f5d873786cdc, user.id=b72c77a1143648e58bef98b7bb2677d1) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:15:50.048775 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab14ecb4-3c21-451e-abba-824a58c3f387 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:50.050180 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab14ecb4-3c21-451e-abba-824a58c3f387 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:50.056878 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 97/195] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 03:15:49 2022] GET /identity/v3/role_assignments?user.id=b72c77a1143648e58bef98b7bb2677d1&scope.project.id=f7e1658c45e44adf92c8f5d873786cdc&role.id=04d0e4575a28440eb4349b4a6565e8b8 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:50.057439 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab14ecb4-3c21-451e-abba-824a58c3f387 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:50.059897 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:50.089786 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:50.128965 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b754bb8c-6775-4585-88aa-a741e230179f None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:50.168277 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d237f5-377e-4c7e-97a2-0ec9a328e122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:50.168893 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d237f5-377e-4c7e-97a2-0ec9a328e122 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:50.169171 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d237f5-377e-4c7e-97a2-0ec9a328e122 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:50.169442 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d237f5-377e-4c7e-97a2-0ec9a328e122 None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:50.170544 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d237f5-377e-4c7e-97a2-0ec9a328e122 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:15:50.170544 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d237f5-377e-4c7e-97a2-0ec9a328e122 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:50.171824 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d237f5-377e-4c7e-97a2-0ec9a328e122 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:50.185532 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 99/196] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 03:15:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:50.185532 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d237f5-377e-4c7e-97a2-0ec9a328e122 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:50.189571 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab14ecb4-3c21-451e-abba-824a58c3f387 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:50.230700 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ebe55f-cc85-4bd5-9bde-d9d8b72226d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:50.231329 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ebe55f-cc85-4bd5-9bde-d9d8b72226d8 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:50.231658 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ebe55f-cc85-4bd5-9bde-d9d8b72226d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:50.231940 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ebe55f-cc85-4bd5-9bde-d9d8b72226d8 None admin] PATH_INFO: `/v3/users/ccd0afd0141443b58b40b271b1b6f0a1` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:50.233094 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ebe55f-cc85-4bd5-9bde-d9d8b72226d8 None admin] RBAC: Authorizing `identity:get_user(user_id=ccd0afd0141443b58b40b271b1b6f0a1)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:50.234613 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ebe55f-cc85-4bd5-9bde-d9d8b72226d8 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:50.236240 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 98/197] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 03:15:50 2022] GET /identity/v3/users/ccd0afd0141443b58b40b271b1b6f0a1 => generated 289 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:50.237118 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ebe55f-cc85-4bd5-9bde-d9d8b72226d8 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:50.301645 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d237f5-377e-4c7e-97a2-0ec9a328e122 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:50.319226 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:50.336816 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccefaf2-610a-46c7-8d17-4995d192f609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:50.337418 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccefaf2-610a-46c7-8d17-4995d192f609 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:50.337697 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccefaf2-610a-46c7-8d17-4995d192f609 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:50.337968 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccefaf2-610a-46c7-8d17-4995d192f609 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:50.340542 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:50.353321 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ebe55f-cc85-4bd5-9bde-d9d8b72226d8 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:50.385633 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902da690-f99e-4fc7-a1c0-7732faed21d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:50.386386 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902da690-f99e-4fc7-a1c0-7732faed21d4 None admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:50.386671 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902da690-f99e-4fc7-a1c0-7732faed21d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:50.386941 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902da690-f99e-4fc7-a1c0-7732faed21d4 None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:50.387608 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902da690-f99e-4fc7-a1c0-7732faed21d4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:50.389033 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902da690-f99e-4fc7-a1c0-7732faed21d4 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:50.406617 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccefaf2-610a-46c7-8d17-4995d192f609 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:50.408154 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccefaf2-610a-46c7-8d17-4995d192f609 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:50.409166 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 99/198] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Oct 4 03:15:50 2022] POST /identity/v3/users => generated 297 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:15:50.409975 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902da690-f99e-4fc7-a1c0-7732faed21d4 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:50.525116 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902da690-f99e-4fc7-a1c0-7732faed21d4 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:50.530244 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 100/199] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 03:15:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 03:15:50.531408 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccefaf2-610a-46c7-8d17-4995d192f609 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:50.555977 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:50.567403 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec8b743-2eee-4422-9079-4ca4a3f4f096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:50.568143 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec8b743-2eee-4422-9079-4ca4a3f4f096 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:50.568421 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec8b743-2eee-4422-9079-4ca4a3f4f096 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:50.568710 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec8b743-2eee-4422-9079-4ca4a3f4f096 None admin] PATH_INFO: `/v3/users/b251ff62818e42c59185d214058156f4` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:50.569946 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec8b743-2eee-4422-9079-4ca4a3f4f096 None admin] RBAC: Authorizing `identity:get_user(user_id=b251ff62818e42c59185d214058156f4)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:50.572380 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec8b743-2eee-4422-9079-4ca4a3f4f096 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:50.574040 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 100/200] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 03:15:50 2022] GET /identity/v3/users/b251ff62818e42c59185d214058156f4 => generated 283 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:50.574809 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec8b743-2eee-4422-9079-4ca4a3f4f096 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:50.576309 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:50.661177 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccefaf2-610a-46c7-8d17-4995d192f609 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:50.703862 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb0a113-b509-402a-8263-df9ac9e6cc50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:50.704270 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec8b743-2eee-4422-9079-4ca4a3f4f096 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:50.705016 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb0a113-b509-402a-8263-df9ac9e6cc50 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:50.705487 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb0a113-b509-402a-8263-df9ac9e6cc50 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:50.706021 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb0a113-b509-402a-8263-df9ac9e6cc50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:50.750444 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ef89bf-208c-4134-932a-9e05372ebd25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:50.751081 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef89bf-208c-4134-932a-9e05372ebd25 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:50.751363 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef89bf-208c-4134-932a-9e05372ebd25 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:50.751670 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef89bf-208c-4134-932a-9e05372ebd25 None admin] PATH_INFO: `/v3/projects/dcddf7d31429427a8d46e49ef77bbe82` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:50.752815 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ef89bf-208c-4134-932a-9e05372ebd25 None admin] RBAC: Authorizing `identity:get_project(project_id=dcddf7d31429427a8d46e49ef77bbe82)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:50.754492 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ef89bf-208c-4134-932a-9e05372ebd25 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:50.756290 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 101/201] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 03:15:50 2022] GET /identity/v3/projects/dcddf7d31429427a8d46e49ef77bbe82 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:50.760354 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ef89bf-208c-4134-932a-9e05372ebd25 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:50.794979 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb0a113-b509-402a-8263-df9ac9e6cc50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:50.796577 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb0a113-b509-402a-8263-df9ac9e6cc50 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:50.839465 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:50.841112 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:50.882079 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ef89bf-208c-4134-932a-9e05372ebd25 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:50.917763 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fcae87-223b-4333-9350-813c81f9da48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:50.918724 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fcae87-223b-4333-9350-813c81f9da48 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:50.919234 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fcae87-223b-4333-9350-813c81f9da48 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:50.919730 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fcae87-223b-4333-9350-813c81f9da48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:50.924121 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 101/202] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 03:15:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 03:15:50.924453 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb0a113-b509-402a-8263-df9ac9e6cc50 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:50.990704 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fcae87-223b-4333-9350-813c81f9da48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:50.993120 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fcae87-223b-4333-9350-813c81f9da48 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:51.036037 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb0a113-b509-402a-8263-df9ac9e6cc50 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:51.054382 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:51.075799 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95939ce-6d73-48d2-9548-4c14e309744c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:51.076408 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95939ce-6d73-48d2-9548-4c14e309744c None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:51.076688 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95939ce-6d73-48d2-9548-4c14e309744c None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:51.076961 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95939ce-6d73-48d2-9548-4c14e309744c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:51.077693 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95939ce-6d73-48d2-9548-4c14e309744c None admin] RBAC: Adding query filter params (role.id=fe9379cda35c4ff78576fe48b60bea3c, scope.project.id=dcddf7d31429427a8d46e49ef77bbe82, user.id=b251ff62818e42c59185d214058156f4) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:15:51.078004 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95939ce-6d73-48d2-9548-4c14e309744c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:51.079754 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95939ce-6d73-48d2-9548-4c14e309744c None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:51.081624 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:51.096309 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 102/203] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 03:15:50 2022] GET /identity/v3/role_assignments?user.id=b251ff62818e42c59185d214058156f4&scope.project.id=dcddf7d31429427a8d46e49ef77bbe82&role.id=fe9379cda35c4ff78576fe48b60bea3c => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:51.097205 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95939ce-6d73-48d2-9548-4c14e309744c None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:51.100414 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 102/204] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 03:15:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 03:15:51.112926 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fcae87-223b-4333-9350-813c81f9da48 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:51.266373 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95939ce-6d73-48d2-9548-4c14e309744c None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:51.285900 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fcae87-223b-4333-9350-813c81f9da48 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:51.315880 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f0dbc9-77e9-47cb-977a-3d31c8a732cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:51.316530 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0dbc9-77e9-47cb-977a-3d31c8a732cb None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:51.316807 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0dbc9-77e9-47cb-977a-3d31c8a732cb None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:51.317075 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0dbc9-77e9-47cb-977a-3d31c8a732cb None admin] PATH_INFO: `/v3/projects/a7dc4038bbe8418c9837b329ac4d2754` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:51.318435 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f0dbc9-77e9-47cb-977a-3d31c8a732cb None admin] RBAC: Authorizing `identity:get_project(project_id=a7dc4038bbe8418c9837b329ac4d2754)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:51.319954 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f0dbc9-77e9-47cb-977a-3d31c8a732cb None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:51.324301 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 103/205] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 03:15:51 2022] GET /identity/v3/projects/a7dc4038bbe8418c9837b329ac4d2754 => generated 298 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:51.331928 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f0dbc9-77e9-47cb-977a-3d31c8a732cb None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:51.349034 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6abf579-8b71-481b-a4a4-c284c0768393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:51.349676 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6abf579-8b71-481b-a4a4-c284c0768393 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:51.349860 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6abf579-8b71-481b-a4a4-c284c0768393 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:51.350410 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6abf579-8b71-481b-a4a4-c284c0768393 None admin] PATH_INFO: `/v3/projects/dcddf7d31429427a8d46e49ef77bbe82` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:51.351608 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6abf579-8b71-481b-a4a4-c284c0768393 None admin] RBAC: Authorizing `identity:get_project(project_id=dcddf7d31429427a8d46e49ef77bbe82)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:51.354144 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6abf579-8b71-481b-a4a4-c284c0768393 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:51.356554 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 103/206] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 03:15:51 2022] GET /identity/v3/projects/dcddf7d31429427a8d46e49ef77bbe82 => generated 302 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:51.362533 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6abf579-8b71-481b-a4a4-c284c0768393 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:51.399332 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:51.407411 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:51.449279 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f0dbc9-77e9-47cb-977a-3d31c8a732cb None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:51.484962 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220df451-f47c-411e-8767-23ddc6679c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:51.485669 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220df451-f47c-411e-8767-23ddc6679c3f None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:51.485952 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220df451-f47c-411e-8767-23ddc6679c3f None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:51.486225 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220df451-f47c-411e-8767-23ddc6679c3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:51.486948 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220df451-f47c-411e-8767-23ddc6679c3f None admin] RBAC: Adding query filter params (role.id=8513937b0b5c4d0099cb3732beb89fd4, scope.project.id=a7dc4038bbe8418c9837b329ac4d2754, user.id=ccd0afd0141443b58b40b271b1b6f0a1) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:15:51.487366 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220df451-f47c-411e-8767-23ddc6679c3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:51.488842 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220df451-f47c-411e-8767-23ddc6679c3f None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:51.499369 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 104/207] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 03:15:51 2022] GET /identity/v3/role_assignments?user.id=ccd0afd0141443b58b40b271b1b6f0a1&scope.project.id=a7dc4038bbe8418c9837b329ac4d2754&role.id=8513937b0b5c4d0099cb3732beb89fd4 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:51.528274 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6abf579-8b71-481b-a4a4-c284c0768393 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:51.577633 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f89a8f-938e-4358-a4b2-0b2ea6a717d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:51.578244 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f89a8f-938e-4358-a4b2-0b2ea6a717d4 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:51.578522 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f89a8f-938e-4358-a4b2-0b2ea6a717d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:51.578793 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f89a8f-938e-4358-a4b2-0b2ea6a717d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:51.579532 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f89a8f-938e-4358-a4b2-0b2ea6a717d4 None admin] RBAC: Adding query filter params (role.id=f2332a9a00b74fe0846d7211dd3850cb, scope.project.id=dcddf7d31429427a8d46e49ef77bbe82, user.id=b251ff62818e42c59185d214058156f4) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:15:51.579847 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f89a8f-938e-4358-a4b2-0b2ea6a717d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:51.581280 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f89a8f-938e-4358-a4b2-0b2ea6a717d4 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:51.593635 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 104/208] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 03:15:51 2022] GET /identity/v3/role_assignments?user.id=b251ff62818e42c59185d214058156f4&scope.project.id=dcddf7d31429427a8d46e49ef77bbe82&role.id=f2332a9a00b74fe0846d7211dd3850cb => generated 259 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:15:52.950034 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f9f104-7117-4960-a7ee-2e11500c12e4 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:52.950034 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f9f104-7117-4960-a7ee-2e11500c12e4 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:52.950034 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f9f104-7117-4960-a7ee-2e11500c12e4 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:52.950034 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 105/209] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:15:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:15:52.956143 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c35a1a-d56f-4adb-9c99-ac6d8a73d15d None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:52.956970 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c35a1a-d56f-4adb-9c99-ac6d8a73d15d None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:52.957437 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c35a1a-d56f-4adb-9c99-ac6d8a73d15d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:52.978742 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-d1c35a1a-d56f-4adb-9c99-ac6d8a73d15d None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:15:52.980383 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-d1c35a1a-d56f-4adb-9c99-ac6d8a73d15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:15:53.052857 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 105/210] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:15:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 03:15:53.104291 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426545d-2a67-465b-b00e-4f7b046dc02c None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:53.104594 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426545d-2a67-465b-b00e-4f7b046dc02c None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:53.104850 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426545d-2a67-465b-b00e-4f7b046dc02c None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:53.106497 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 106/211] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:15:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 03:15:53.111788 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6e5b7-d1dd-45a7-a203-da03dd09ebc4 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:53.112079 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6e5b7-d1dd-45a7-a203-da03dd09ebc4 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:53.112356 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6e5b7-d1dd-45a7-a203-da03dd09ebc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:53.131119 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-aea6e5b7-d1dd-45a7-a203-da03dd09ebc4 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:15:53.132335 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-aea6e5b7-d1dd-45a7-a203-da03dd09ebc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:15:53.151062 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:53.205730 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 106/212] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:15:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 03:15:53.340376 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0426545d-2a67-465b-b00e-4f7b046dc02c None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:53.450857 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0426545d-2a67-465b-b00e-4f7b046dc02c None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:53.481346 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea6e5b7-d1dd-45a7-a203-da03dd09ebc4 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:53.484326 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:53.490223 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc499848-bd8e-4a25-85e7-e25d13d441d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:53.491282 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc499848-bd8e-4a25-85e7-e25d13d441d8 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:53.492979 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc499848-bd8e-4a25-85e7-e25d13d441d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:53.492979 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc499848-bd8e-4a25-85e7-e25d13d441d8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:53.505004 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc499848-bd8e-4a25-85e7-e25d13d441d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:15:53.510249 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-cc499848-bd8e-4a25-85e7-e25d13d441d8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 03:15:53.510249 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:15:53.510249 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:15:53.510249 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:15:53.510249 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:15:53.510249 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:15:53.510249 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:15:53.510249 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:15:53.510249 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:15:53.510249 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:15:53.510249 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:15:53.510249 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:15:53.510249 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:15:53.510249 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:15:53.510249 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:15:53.510249 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:15:53.511170 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:15:53.511170 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:15:53.511170 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:15:53.511170 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:15:53.511170 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:15:53.511170 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:15:53.511170 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:15:53.511170 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:15:53.511170 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:15:53.511170 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:15:53.511170 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:15:53.511170 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:15:53.511170 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:15:53.511170 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:15:53.511170 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:15:53.511170 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:15:53.511983 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:15:53.511983 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:15:53.511983 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:15:53.511983 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:15:53.511983 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:15:53.511983 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:15:53.511983 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:15:53.511983 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:15:53.511983 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:15:53.511983 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:15:53.511983 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 03:15:53.511983 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:15:53.511983 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 107/213] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 03:15:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:15:53.518161 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc499848-bd8e-4a25-85e7-e25d13d441d8 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:53.596574 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea6e5b7-d1dd-45a7-a203-da03dd09ebc4 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:53.626272 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc499848-bd8e-4a25-85e7-e25d13d441d8 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:53.643854 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8c98cf-076b-4d17-922c-5423e56af2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:53.644490 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c98cf-076b-4d17-922c-5423e56af2b5 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:53.644771 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c98cf-076b-4d17-922c-5423e56af2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:53.645043 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c98cf-076b-4d17-922c-5423e56af2b5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:53.646142 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8c98cf-076b-4d17-922c-5423e56af2b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:53.647610 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8c98cf-076b-4d17-922c-5423e56af2b5 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:53.649745 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 107/214] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:15:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:53.650777 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945aa9c-d97c-44f5-b1e4-9c7d449490bb None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:53.651060 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945aa9c-d97c-44f5-b1e4-9c7d449490bb None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:53.651330 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945aa9c-d97c-44f5-b1e4-9c7d449490bb None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:53.652713 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 108/215] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:15:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:15:53.656157 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e945aa9c-d97c-44f5-b1e4-9c7d449490bb None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:53.669908 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d44c9a-3d19-4a30-9b16-dad84ff637cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:53.670519 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d44c9a-3d19-4a30-9b16-dad84ff637cb None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:53.670801 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d44c9a-3d19-4a30-9b16-dad84ff637cb None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:53.671076 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d44c9a-3d19-4a30-9b16-dad84ff637cb None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:53.671782 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d44c9a-3d19-4a30-9b16-dad84ff637cb None admin] RBAC: Adding query filter params (name=member) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:15:53.672090 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d44c9a-3d19-4a30-9b16-dad84ff637cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:53.675654 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d44c9a-3d19-4a30-9b16-dad84ff637cb None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:53.687098 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 108/216] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Oct 4 03:15:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:53.688273 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9294687d-5100-45cf-9d31-1c05db217b71 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:53.688559 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9294687d-5100-45cf-9d31-1c05db217b71 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:53.688832 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9294687d-5100-45cf-9d31-1c05db217b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:53.691877 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:53.712373 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-9294687d-5100-45cf-9d31-1c05db217b71 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:15:53.713685 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-9294687d-5100-45cf-9d31-1c05db217b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:15:53.765009 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:53.777422 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e945aa9c-d97c-44f5-b1e4-9c7d449490bb None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:53.789315 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 109/217] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:15:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 03:15:53.790080 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9294687d-5100-45cf-9d31-1c05db217b71 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:53.835588 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904179f0-0cb8-4ed4-b717-ae0b71954e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:53.837164 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904179f0-0cb8-4ed4-b717-ae0b71954e46 None admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:53.837673 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904179f0-0cb8-4ed4-b717-ae0b71954e46 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:53.838350 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904179f0-0cb8-4ed4-b717-ae0b71954e46 None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:53.839692 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904179f0-0cb8-4ed4-b717-ae0b71954e46 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:53.841934 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904179f0-0cb8-4ed4-b717-ae0b71954e46 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:53.872457 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 109/218] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Oct 4 03:15:53 2022] POST /identity/v3/users => generated 297 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 03:15:53.913735 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9294687d-5100-45cf-9d31-1c05db217b71 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:53.956798 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00965aed-aad2-4b0c-929e-2693ccc402cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:53.957622 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00965aed-aad2-4b0c-929e-2693ccc402cb None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:53.957792 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00965aed-aad2-4b0c-929e-2693ccc402cb None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:53.958046 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00965aed-aad2-4b0c-929e-2693ccc402cb None admin] PATH_INFO: `/v3/users/7ce7d16edcfa4fb4829546770a87ca4b` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:53.975626 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00965aed-aad2-4b0c-929e-2693ccc402cb None admin] RBAC: Authorizing `identity:get_user(user_id=7ce7d16edcfa4fb4829546770a87ca4b)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:53.978015 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00965aed-aad2-4b0c-929e-2693ccc402cb None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:53.981792 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 110/219] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 03:15:53 2022] GET /identity/v3/users/7ce7d16edcfa4fb4829546770a87ca4b => generated 297 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:53.987722 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904179f0-0cb8-4ed4-b717-ae0b71954e46 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:54.069275 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b9663-45fd-4b8c-af26-5817afae86dc None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:54.069830 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b9663-45fd-4b8c-af26-5817afae86dc None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:54.070773 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b9663-45fd-4b8c-af26-5817afae86dc None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:54.072879 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 111/220] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:15:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 03:15:54.076109 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0b9663-45fd-4b8c-af26-5817afae86dc None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:54.082332 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:54.108015 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904179f0-0cb8-4ed4-b717-ae0b71954e46 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:54.131104 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:54.151627 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb61d8a2-c655-4484-a18d-af97356f7197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:54.152237 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61d8a2-c655-4484-a18d-af97356f7197 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:54.153035 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61d8a2-c655-4484-a18d-af97356f7197 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:54.153035 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61d8a2-c655-4484-a18d-af97356f7197 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:54.212092 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0b9663-45fd-4b8c-af26-5817afae86dc None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:54.251062 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb61d8a2-c655-4484-a18d-af97356f7197 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:54.253104 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb61d8a2-c655-4484-a18d-af97356f7197 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:54.259435 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f36408-1084-4f32-9d1f-a4126769572d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:54.260119 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f36408-1084-4f32-9d1f-a4126769572d None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:54.260401 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f36408-1084-4f32-9d1f-a4126769572d None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:54.260676 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f36408-1084-4f32-9d1f-a4126769572d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:54.276888 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f36408-1084-4f32-9d1f-a4126769572d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:15:54.283350 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-48f36408-1084-4f32-9d1f-a4126769572d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 03:15:54.283350 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:15:54.283350 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:15:54.283350 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:15:54.283350 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:15:54.283350 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:15:54.283350 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:15:54.283350 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:15:54.283350 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:15:54.283350 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:15:54.283350 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:15:54.283350 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:15:54.283350 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:15:54.283350 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:15:54.283350 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:15:54.283350 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:15:54.284257 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:15:54.284257 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:15:54.284257 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:15:54.284257 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:15:54.284257 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:15:54.284257 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:15:54.284257 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:15:54.284257 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:15:54.284257 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:15:54.284257 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:15:54.284257 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:15:54.284257 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:15:54.284257 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:15:54.284257 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:15:54.284257 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:15:54.284257 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:15:54.285021 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:15:54.285021 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:15:54.285021 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:15:54.285021 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:15:54.285021 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:15:54.285021 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:15:54.285021 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:15:54.285021 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:15:54.285021 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:15:54.285021 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:15:54.285021 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 03:15:54.285021 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:15:54.287686 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 112/221] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 4 03:15:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 03:15:54.288788 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bdbde6-38a5-403e-af4e-2d3d120d8144 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:54.289069 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bdbde6-38a5-403e-af4e-2d3d120d8144 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:54.289877 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bdbde6-38a5-403e-af4e-2d3d120d8144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:54.310972 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-80bdbde6-38a5-403e-af4e-2d3d120d8144 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:15:54.312298 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-80bdbde6-38a5-403e-af4e-2d3d120d8144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:15:54.354299 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:54.378611 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 110/222] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 03:15:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 03:15:54.379649 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb61d8a2-c655-4484-a18d-af97356f7197 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:54.419625 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 113/223] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:15:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 03:15:54.420494 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bdbde6-38a5-403e-af4e-2d3d120d8144 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:54.456167 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:54.538571 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bdbde6-38a5-403e-af4e-2d3d120d8144 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:54.578778 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed9cd1c-838b-4456-86cb-9cb72c218daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:54.579422 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9cd1c-838b-4456-86cb-9cb72c218daa None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:54.579828 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9cd1c-838b-4456-86cb-9cb72c218daa None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:54.580104 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9cd1c-838b-4456-86cb-9cb72c218daa None admin] PATH_INFO: `/v3/projects/dcddf7d31429427a8d46e49ef77bbe82` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:54.581450 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed9cd1c-838b-4456-86cb-9cb72c218daa None admin] RBAC: Authorizing `identity:get_project(project_id=dcddf7d31429427a8d46e49ef77bbe82)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:54.583210 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed9cd1c-838b-4456-86cb-9cb72c218daa None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:54.585155 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 114/224] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 03:15:54 2022] GET /identity/v3/projects/dcddf7d31429427a8d46e49ef77bbe82 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:54.591671 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed9cd1c-838b-4456-86cb-9cb72c218daa None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:54.601439 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb61d8a2-c655-4484-a18d-af97356f7197 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:54.706347 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed9cd1c-838b-4456-86cb-9cb72c218daa None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:54.720057 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb60499-4f00-4b63-b6cd-3064ccebf4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:54.720670 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb60499-4f00-4b63-b6cd-3064ccebf4f3 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:54.720952 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb60499-4f00-4b63-b6cd-3064ccebf4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:54.721228 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb60499-4f00-4b63-b6cd-3064ccebf4f3 None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:54.721773 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:54.721898 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb60499-4f00-4b63-b6cd-3064ccebf4f3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:15:54.727322 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb60499-4f00-4b63-b6cd-3064ccebf4f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:54.729000 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb60499-4f00-4b63-b6cd-3064ccebf4f3 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:54.748362 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 111/225] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 03:15:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:54.749956 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd859c0-15e8-4d67-9df6-b1aa32023375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:54.750755 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd859c0-15e8-4d67-9df6-b1aa32023375 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:54.751182 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd859c0-15e8-4d67-9df6-b1aa32023375 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:54.751630 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd859c0-15e8-4d67-9df6-b1aa32023375 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:54.752531 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd859c0-15e8-4d67-9df6-b1aa32023375 None admin] RBAC: Adding query filter params (role.id=04d0e4575a28440eb4349b4a6565e8b8, scope.project.id=dcddf7d31429427a8d46e49ef77bbe82, user.id=7ce7d16edcfa4fb4829546770a87ca4b) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:15:54.752998 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd859c0-15e8-4d67-9df6-b1aa32023375 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:54.754507 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb60499-4f00-4b63-b6cd-3064ccebf4f3 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:54.756212 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd859c0-15e8-4d67-9df6-b1aa32023375 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:54.771938 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 115/226] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 03:15:54 2022] GET /identity/v3/role_assignments?user.id=7ce7d16edcfa4fb4829546770a87ca4b&scope.project.id=dcddf7d31429427a8d46e49ef77bbe82&role.id=04d0e4575a28440eb4349b4a6565e8b8 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:15:54.811043 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:54.819971 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd859c0-15e8-4d67-9df6-b1aa32023375 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:54.900361 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb60499-4f00-4b63-b6cd-3064ccebf4f3 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:54.943109 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71371d1b-3f55-43a5-8f7c-484e8a29413d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:54.944046 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71371d1b-3f55-43a5-8f7c-484e8a29413d None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:54.944503 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71371d1b-3f55-43a5-8f7c-484e8a29413d None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:54.944925 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71371d1b-3f55-43a5-8f7c-484e8a29413d None admin] PATH_INFO: `/v3/users/b251ff62818e42c59185d214058156f4` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:54.946772 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71371d1b-3f55-43a5-8f7c-484e8a29413d None admin] RBAC: Authorizing `identity:get_user(user_id=b251ff62818e42c59185d214058156f4)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:54.949166 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71371d1b-3f55-43a5-8f7c-484e8a29413d None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:54.951511 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 112/227] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 03:15:54 2022] GET /identity/v3/users/b251ff62818e42c59185d214058156f4 => generated 283 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:54.956853 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71371d1b-3f55-43a5-8f7c-484e8a29413d None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:55.053605 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd859c0-15e8-4d67-9df6-b1aa32023375 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:55.117472 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71371d1b-3f55-43a5-8f7c-484e8a29413d None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:55.128048 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:55.148185 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f07e91-9f84-48f1-975c-4e0cef89a157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:55.148949 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f07e91-9f84-48f1-975c-4e0cef89a157 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:55.149232 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f07e91-9f84-48f1-975c-4e0cef89a157 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:55.149505 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f07e91-9f84-48f1-975c-4e0cef89a157 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:55.156420 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2883dfb1-f577-4bbb-af9f-64ef989ad609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:55.156998 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883dfb1-f577-4bbb-af9f-64ef989ad609 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:55.157284 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883dfb1-f577-4bbb-af9f-64ef989ad609 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:55.157562 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883dfb1-f577-4bbb-af9f-64ef989ad609 None admin] PATH_INFO: `/v3/projects/dcddf7d31429427a8d46e49ef77bbe82` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:55.158694 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2883dfb1-f577-4bbb-af9f-64ef989ad609 None admin] RBAC: Authorizing `identity:get_project(project_id=dcddf7d31429427a8d46e49ef77bbe82)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:55.160223 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2883dfb1-f577-4bbb-af9f-64ef989ad609 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:55.166894 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 113/228] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 03:15:54 2022] GET /identity/v3/projects/dcddf7d31429427a8d46e49ef77bbe82 => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:55.168819 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2883dfb1-f577-4bbb-af9f-64ef989ad609 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:55.188117 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f07e91-9f84-48f1-975c-4e0cef89a157 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:15:55.193435 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-58f07e91-9f84-48f1-975c-4e0cef89a157 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 03:15:55.193435 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:15:55.193435 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:15:55.193435 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:15:55.193435 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:15:55.193435 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:15:55.193435 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:15:55.193435 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:15:55.193435 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:15:55.193435 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:15:55.193435 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:15:55.193435 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:15:55.193435 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:15:55.193435 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:15:55.193435 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:15:55.193435 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:15:55.194319 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:15:55.194319 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:15:55.194319 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:15:55.194319 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:15:55.194319 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:15:55.194319 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:15:55.194319 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:15:55.194319 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:15:55.194319 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:15:55.194319 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:15:55.194319 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:15:55.194319 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:15:55.194319 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:15:55.194319 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:15:55.194319 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:15:55.194319 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:15:55.195096 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:15:55.195096 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:15:55.195096 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:15:55.195096 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:15:55.195096 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:15:55.195096 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:15:55.195096 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:15:55.195096 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:15:55.195096 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:15:55.195096 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:15:55.195096 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 03:15:55.195096 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:15:55.195096 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 116/229] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Oct 4 03:15:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 375 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 03:15:55.216558 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f07e91-9f84-48f1-975c-4e0cef89a157 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:55.279657 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2883dfb1-f577-4bbb-af9f-64ef989ad609 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:55.284115 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:55.317714 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a1ffdf-675c-4ab5-8d8d-bef1f1101ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:55.318379 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a1ffdf-675c-4ab5-8d8d-bef1f1101ebb None admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:55.318664 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a1ffdf-675c-4ab5-8d8d-bef1f1101ebb None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:55.318944 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a1ffdf-675c-4ab5-8d8d-bef1f1101ebb None admin] PATH_INFO: `/v3/projects/dcddf7d31429427a8d46e49ef77bbe82/users/b251ff62818e42c59185d214058156f4/roles/fe9379cda35c4ff78576fe48b60bea3c` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:55.321844 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a1ffdf-675c-4ab5-8d8d-bef1f1101ebb None admin] RBAC: Authorizing `identity:create_grant(project_id=dcddf7d31429427a8d46e49ef77bbe82, user_id=b251ff62818e42c59185d214058156f4, role_id=fe9379cda35c4ff78576fe48b60bea3c)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:55.323342 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a1ffdf-675c-4ab5-8d8d-bef1f1101ebb None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:55.351662 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 114/230] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Oct 4 03:15:55 2022] PUT /identity/v3/projects/dcddf7d31429427a8d46e49ef77bbe82/users/b251ff62818e42c59185d214058156f4/roles/fe9379cda35c4ff78576fe48b60bea3c => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 03:15:55.444354 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f07e91-9f84-48f1-975c-4e0cef89a157 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:55.496275 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4b82b5-e37d-44d2-8d70-f5083fc076a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:55.496908 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b82b5-e37d-44d2-8d70-f5083fc076a6 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:55.497185 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b82b5-e37d-44d2-8d70-f5083fc076a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:55.497451 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b82b5-e37d-44d2-8d70-f5083fc076a6 None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:55.498128 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4b82b5-e37d-44d2-8d70-f5083fc076a6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:15:55.498428 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4b82b5-e37d-44d2-8d70-f5083fc076a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:55.499923 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4b82b5-e37d-44d2-8d70-f5083fc076a6 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:55.509093 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 117/231] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 03:15:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:55.515095 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a1ffdf-675c-4ab5-8d8d-bef1f1101ebb None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:55.573534 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:55.655617 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a1ffdf-675c-4ab5-8d8d-bef1f1101ebb None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:55.693868 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f275e05-9c4a-4b53-8c40-49f12b5b8931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:55.694563 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f275e05-9c4a-4b53-8c40-49f12b5b8931 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:55.694788 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f275e05-9c4a-4b53-8c40-49f12b5b8931 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:55.695361 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f275e05-9c4a-4b53-8c40-49f12b5b8931 None admin] PATH_INFO: `/v3/users/b251ff62818e42c59185d214058156f4` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:55.696762 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f275e05-9c4a-4b53-8c40-49f12b5b8931 None admin] RBAC: Authorizing `identity:get_user(user_id=b251ff62818e42c59185d214058156f4)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:55.698216 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f275e05-9c4a-4b53-8c40-49f12b5b8931 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:55.699831 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 115/232] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 03:15:55 2022] GET /identity/v3/users/b251ff62818e42c59185d214058156f4 => generated 283 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:55.705473 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4b82b5-e37d-44d2-8d70-f5083fc076a6 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:55.822461 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:55.843219 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4b82b5-e37d-44d2-8d70-f5083fc076a6 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:55.878114 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d3bf76-eaea-457d-ac59-841096f48597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:55.879030 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d3bf76-eaea-457d-ac59-841096f48597 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:55.879501 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d3bf76-eaea-457d-ac59-841096f48597 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:55.880036 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d3bf76-eaea-457d-ac59-841096f48597 None admin] PATH_INFO: `/v3/projects/dcddf7d31429427a8d46e49ef77bbe82` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:55.881396 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d3bf76-eaea-457d-ac59-841096f48597 None admin] RBAC: Authorizing `identity:get_project(project_id=dcddf7d31429427a8d46e49ef77bbe82)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:55.883616 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d3bf76-eaea-457d-ac59-841096f48597 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:55.885426 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 118/233] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 03:15:55 2022] GET /identity/v3/projects/dcddf7d31429427a8d46e49ef77bbe82 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:55.893311 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f275e05-9c4a-4b53-8c40-49f12b5b8931 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:56.022250 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f275e05-9c4a-4b53-8c40-49f12b5b8931 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:56.028429 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:56.067038 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1acc28-8002-48c1-b648-455820aee853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:56.068014 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1acc28-8002-48c1-b648-455820aee853 None admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:56.068472 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1acc28-8002-48c1-b648-455820aee853 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:56.068950 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1acc28-8002-48c1-b648-455820aee853 None admin] PATH_INFO: `/v3/projects/dcddf7d31429427a8d46e49ef77bbe82/users/b251ff62818e42c59185d214058156f4/roles/f2332a9a00b74fe0846d7211dd3850cb` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:56.072721 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1acc28-8002-48c1-b648-455820aee853 None admin] RBAC: Authorizing `identity:create_grant(project_id=dcddf7d31429427a8d46e49ef77bbe82, user_id=b251ff62818e42c59185d214058156f4, role_id=f2332a9a00b74fe0846d7211dd3850cb)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:56.074374 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1acc28-8002-48c1-b648-455820aee853 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:56.096025 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 116/234] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Oct 4 03:15:55 2022] PUT /identity/v3/projects/dcddf7d31429427a8d46e49ef77bbe82/users/b251ff62818e42c59185d214058156f4/roles/f2332a9a00b74fe0846d7211dd3850cb => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:15:56.557273 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ba048-7282-49d1-9280-9c56d3839f89 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:56.557803 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ba048-7282-49d1-9280-9c56d3839f89 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:56.557803 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ba048-7282-49d1-9280-9c56d3839f89 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:56.559349 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 119/235] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:15:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:15:56.564825 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c10cd9-3c0e-4aed-8eb5-64f39c240c4f None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:56.565225 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c10cd9-3c0e-4aed-8eb5-64f39c240c4f None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:56.565374 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c10cd9-3c0e-4aed-8eb5-64f39c240c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:56.584578 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-84c10cd9-3c0e-4aed-8eb5-64f39c240c4f None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:15:56.585762 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-84c10cd9-3c0e-4aed-8eb5-64f39c240c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:15:56.682761 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 117/236] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:15:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 03:15:56.744500 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493daa3e-5ab1-4497-8bb1-290179de7fae None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:56.744831 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493daa3e-5ab1-4497-8bb1-290179de7fae None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:56.745047 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493daa3e-5ab1-4497-8bb1-290179de7fae None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:56.746375 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 120/237] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:15:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:15:56.751771 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57bd241-00ae-405a-b25c-84664414a74b None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:56.752062 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57bd241-00ae-405a-b25c-84664414a74b None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:56.752335 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57bd241-00ae-405a-b25c-84664414a74b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:56.776515 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-f57bd241-00ae-405a-b25c-84664414a74b None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:15:56.777711 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-f57bd241-00ae-405a-b25c-84664414a74b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:15:56.864821 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 118/238] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:15:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 03:15:57.063751 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493daa3e-5ab1-4497-8bb1-290179de7fae None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:57.185460 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493daa3e-5ab1-4497-8bb1-290179de7fae None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:57.233637 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac4ee59-f2a7-4f1c-8310-3f05e54d2ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:57.234762 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57bd241-00ae-405a-b25c-84664414a74b None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:57.235009 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac4ee59-f2a7-4f1c-8310-3f05e54d2ed2 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:57.235503 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac4ee59-f2a7-4f1c-8310-3f05e54d2ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:57.235997 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac4ee59-f2a7-4f1c-8310-3f05e54d2ed2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:57.237528 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac4ee59-f2a7-4f1c-8310-3f05e54d2ed2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:57.239222 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac4ee59-f2a7-4f1c-8310-3f05e54d2ed2 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:57.241033 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 121/239] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:15:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:57.258767 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac4ee59-f2a7-4f1c-8310-3f05e54d2ed2 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:57.283808 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:57.303841 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:57.364797 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57bd241-00ae-405a-b25c-84664414a74b None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:57.384451 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac4ee59-f2a7-4f1c-8310-3f05e54d2ed2 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:57.402757 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9620e95c-63d0-4df8-8315-344e01f6d514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:57.403398 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620e95c-63d0-4df8-8315-344e01f6d514 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:57.403709 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620e95c-63d0-4df8-8315-344e01f6d514 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:57.403985 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620e95c-63d0-4df8-8315-344e01f6d514 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:57.415139 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9620e95c-63d0-4df8-8315-344e01f6d514 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:15:57.420019 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-9620e95c-63d0-4df8-8315-344e01f6d514 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 03:15:57.420019 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:15:57.420019 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:15:57.420019 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:15:57.420019 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:15:57.420019 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:15:57.420019 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:15:57.420019 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:15:57.420019 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:15:57.420019 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:15:57.420019 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:15:57.420019 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:15:57.420019 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:15:57.420019 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:15:57.420019 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:15:57.420019 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:15:57.420912 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:15:57.420912 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:15:57.420912 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:15:57.420912 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:15:57.420912 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:15:57.420912 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:15:57.420912 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:15:57.420912 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:15:57.420912 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:15:57.420912 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:15:57.420912 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:15:57.420912 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:15:57.420912 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:15:57.420912 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:15:57.420912 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:15:57.420912 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:15:57.421710 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:15:57.421710 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:15:57.421710 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:15:57.421710 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:15:57.421710 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:15:57.421710 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:15:57.421710 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:15:57.421710 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:15:57.421710 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:15:57.421710 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:15:57.421710 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 03:15:57.421710 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:15:57.421710 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 119/240] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 03:15:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 03:15:57.422882 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe3ae1-23e5-47b9-b75d-88ece7c0d2ac None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:57.423056 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe3ae1-23e5-47b9-b75d-88ece7c0d2ac None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:57.423829 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe3ae1-23e5-47b9-b75d-88ece7c0d2ac None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:57.425224 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 120/241] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:15:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:15:57.428423 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fe3ae1-23e5-47b9-b75d-88ece7c0d2ac None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:57.431201 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40efbb6b-ed81-4514-af36-f48d2c260137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:57.432178 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40efbb6b-ed81-4514-af36-f48d2c260137 None admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:57.432761 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40efbb6b-ed81-4514-af36-f48d2c260137 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:57.433277 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40efbb6b-ed81-4514-af36-f48d2c260137 None admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:57.434322 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40efbb6b-ed81-4514-af36-f48d2c260137 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:57.436102 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40efbb6b-ed81-4514-af36-f48d2c260137 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:57.462123 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 122/242] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Oct 4 03:15:57 2022] POST /identity/v3/users => generated 293 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:15:57.467313 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1970119-ce4f-465b-bf38-93b7842a2360 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:57.467313 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1970119-ce4f-465b-bf38-93b7842a2360 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:57.467313 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1970119-ce4f-465b-bf38-93b7842a2360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:57.488757 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-e1970119-ce4f-465b-bf38-93b7842a2360 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:15:57.490121 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-e1970119-ce4f-465b-bf38-93b7842a2360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:15:57.604709 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:57.622509 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 123/243] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:15:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 03:15:57.633229 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fe3ae1-23e5-47b9-b75d-88ece7c0d2ac None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:57.694730 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eede5ce-f168-4197-aebe-ad6eb1e6a1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:57.696200 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eede5ce-f168-4197-aebe-ad6eb1e6a1b0 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:57.696667 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eede5ce-f168-4197-aebe-ad6eb1e6a1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:57.697125 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eede5ce-f168-4197-aebe-ad6eb1e6a1b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:57.698010 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eede5ce-f168-4197-aebe-ad6eb1e6a1b0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:15:57.698495 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eede5ce-f168-4197-aebe-ad6eb1e6a1b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:57.700099 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eede5ce-f168-4197-aebe-ad6eb1e6a1b0 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:57.716144 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 121/244] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Oct 4 03:15:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:57.724894 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1970119-ce4f-465b-bf38-93b7842a2360 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:57.734558 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:57.843286 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1970119-ce4f-465b-bf38-93b7842a2360 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:57.878617 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee82d25-a2e4-4cf3-b091-c6d0f2bcc505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:57.879254 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee82d25-a2e4-4cf3-b091-c6d0f2bcc505 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:57.879561 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee82d25-a2e4-4cf3-b091-c6d0f2bcc505 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:57.879837 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee82d25-a2e4-4cf3-b091-c6d0f2bcc505 None admin] PATH_INFO: `/v3/users/a3d5e94ed1394c2cb81078c407c50694` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:57.894956 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee82d25-a2e4-4cf3-b091-c6d0f2bcc505 None admin] RBAC: Authorizing `identity:get_user(user_id=a3d5e94ed1394c2cb81078c407c50694)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:57.896458 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee82d25-a2e4-4cf3-b091-c6d0f2bcc505 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:57.898124 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 124/245] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 03:15:57 2022] GET /identity/v3/users/a3d5e94ed1394c2cb81078c407c50694 => generated 297 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:57.904415 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eede5ce-f168-4197-aebe-ad6eb1e6a1b0 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:57.955099 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee82d25-a2e4-4cf3-b091-c6d0f2bcc505 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:58.048251 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:58.053043 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eede5ce-f168-4197-aebe-ad6eb1e6a1b0 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:58.099205 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee82d25-a2e4-4cf3-b091-c6d0f2bcc505 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:58.100108 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58b9d61-41ea-4396-af9d-4d7ea8991dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:58.101022 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b9d61-41ea-4396-af9d-4d7ea8991dba None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:58.101501 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b9d61-41ea-4396-af9d-4d7ea8991dba None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:58.102554 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b9d61-41ea-4396-af9d-4d7ea8991dba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:58.126548 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:58.144601 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b69604-b7eb-48fd-b3f0-d079ca58f3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:58.145237 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b69604-b7eb-48fd-b3f0-d079ca58f3c2 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:58.145530 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b69604-b7eb-48fd-b3f0-d079ca58f3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:58.145806 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b69604-b7eb-48fd-b3f0-d079ca58f3c2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:58.161863 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b69604-b7eb-48fd-b3f0-d079ca58f3c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:15:58.169484 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-53b69604-b7eb-48fd-b3f0-d079ca58f3c2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 03:15:58.169484 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:15:58.169484 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:15:58.169484 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:15:58.169484 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:15:58.169484 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:15:58.169484 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:15:58.169484 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:15:58.169484 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:15:58.169484 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:15:58.169484 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:15:58.169484 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:15:58.169484 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:15:58.169484 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:15:58.169484 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:15:58.169484 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:15:58.170427 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:15:58.170427 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:15:58.170427 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:15:58.170427 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:15:58.170427 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:15:58.170427 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:15:58.170427 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:15:58.170427 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:15:58.170427 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:15:58.170427 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:15:58.170427 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:15:58.170427 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:15:58.170427 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:15:58.170427 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:15:58.170427 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:15:58.170427 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:15:58.171810 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:15:58.171810 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:15:58.171810 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:15:58.171810 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:15:58.171810 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:15:58.171810 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:15:58.171810 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:15:58.171810 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:15:58.171810 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:15:58.171810 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:15:58.171810 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 03:15:58.171810 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:15:58.171810 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 125/246] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 03:15:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 03:15:58.172528 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac11875-71d3-44ae-aa8a-0005a9a7f74c None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:58.172813 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac11875-71d3-44ae-aa8a-0005a9a7f74c None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:58.173086 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac11875-71d3-44ae-aa8a-0005a9a7f74c None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:58.174659 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 126/247] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:15:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:15:58.179962 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac11875-71d3-44ae-aa8a-0005a9a7f74c None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:58.205538 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58b9d61-41ea-4396-af9d-4d7ea8991dba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:58.206920 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58b9d61-41ea-4396-af9d-4d7ea8991dba None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:58.307562 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac11875-71d3-44ae-aa8a-0005a9a7f74c None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:58.326140 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 122/248] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 03:15:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 03:15:58.327764 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde756d-7233-49f8-ba87-91ae2982bf6e None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:58.328270 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde756d-7233-49f8-ba87-91ae2982bf6e None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:58.328753 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde756d-7233-49f8-ba87-91ae2982bf6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:58.336379 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:58.348288 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2490de-b358-4057-a23c-1e2f570445b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:58.349368 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2490de-b358-4057-a23c-1e2f570445b0 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:58.349747 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-fbde756d-7233-49f8-ba87-91ae2982bf6e None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:15:58.350069 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2490de-b358-4057-a23c-1e2f570445b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:58.350541 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2490de-b358-4057-a23c-1e2f570445b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:58.350938 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-fbde756d-7233-49f8-ba87-91ae2982bf6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:15:58.352183 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2490de-b358-4057-a23c-1e2f570445b0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:15:58.352708 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2490de-b358-4057-a23c-1e2f570445b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:58.354470 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2490de-b358-4057-a23c-1e2f570445b0 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:58.367693 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 127/249] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Oct 4 03:15:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:58.368891 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2490de-b358-4057-a23c-1e2f570445b0 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:58.396198 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:58.422017 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 123/250] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:15:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 03:15:58.422859 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbde756d-7233-49f8-ba87-91ae2982bf6e None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:58.496229 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2490de-b358-4057-a23c-1e2f570445b0 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:58.547526 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb78981a-8aed-4a51-9e54-a863c9131bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:58.549507 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb78981a-8aed-4a51-9e54-a863c9131bfd None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:58.550949 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb78981a-8aed-4a51-9e54-a863c9131bfd None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:58.551602 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb78981a-8aed-4a51-9e54-a863c9131bfd None admin] PATH_INFO: `/v3/projects/dcddf7d31429427a8d46e49ef77bbe82` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:58.554090 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb78981a-8aed-4a51-9e54-a863c9131bfd None admin] RBAC: Authorizing `identity:get_project(project_id=dcddf7d31429427a8d46e49ef77bbe82)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:58.556634 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb78981a-8aed-4a51-9e54-a863c9131bfd None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:58.562469 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 128/251] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 03:15:58 2022] GET /identity/v3/projects/dcddf7d31429427a8d46e49ef77bbe82 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:58.568323 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb78981a-8aed-4a51-9e54-a863c9131bfd None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:58.618429 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbde756d-7233-49f8-ba87-91ae2982bf6e None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:58.673354 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:58.689615 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60efe22-ff42-4a8d-997b-01a6ea6bf305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:58.690376 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60efe22-ff42-4a8d-997b-01a6ea6bf305 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:58.690657 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60efe22-ff42-4a8d-997b-01a6ea6bf305 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:58.690931 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60efe22-ff42-4a8d-997b-01a6ea6bf305 None admin] PATH_INFO: `/v3/users/7ce7d16edcfa4fb4829546770a87ca4b` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:58.693646 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60efe22-ff42-4a8d-997b-01a6ea6bf305 None admin] RBAC: Authorizing `identity:get_user(user_id=7ce7d16edcfa4fb4829546770a87ca4b)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:58.695351 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60efe22-ff42-4a8d-997b-01a6ea6bf305 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:58.697081 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 124/252] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 03:15:58 2022] GET /identity/v3/users/7ce7d16edcfa4fb4829546770a87ca4b => generated 297 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:58.707520 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60efe22-ff42-4a8d-997b-01a6ea6bf305 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:58.763546 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb78981a-8aed-4a51-9e54-a863c9131bfd None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:58.775847 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:58.826461 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d3adca-f53a-43ad-a61e-07d27b4d3ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:58.827075 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d3adca-f53a-43ad-a61e-07d27b4d3ab3 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:58.827354 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d3adca-f53a-43ad-a61e-07d27b4d3ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:58.827657 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d3adca-f53a-43ad-a61e-07d27b4d3ab3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:58.828391 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d3adca-f53a-43ad-a61e-07d27b4d3ab3 None admin] RBAC: Adding query filter params (role.id=8513937b0b5c4d0099cb3732beb89fd4, scope.project.id=dcddf7d31429427a8d46e49ef77bbe82, user.id=a3d5e94ed1394c2cb81078c407c50694) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:15:58.828697 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d3adca-f53a-43ad-a61e-07d27b4d3ab3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:58.830194 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d3adca-f53a-43ad-a61e-07d27b4d3ab3 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:58.836727 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 129/253] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 03:15:58 2022] GET /identity/v3/role_assignments?user.id=a3d5e94ed1394c2cb81078c407c50694&scope.project.id=dcddf7d31429427a8d46e49ef77bbe82&role.id=8513937b0b5c4d0099cb3732beb89fd4 => generated 259 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:15:58.838899 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d3adca-f53a-43ad-a61e-07d27b4d3ab3 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:58.897499 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60efe22-ff42-4a8d-997b-01a6ea6bf305 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:58.989763 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21ce3b5-95f1-4529-af7a-11415afd1497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:58.990421 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ce3b5-95f1-4529-af7a-11415afd1497 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:58.990701 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ce3b5-95f1-4529-af7a-11415afd1497 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:58.990976 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ce3b5-95f1-4529-af7a-11415afd1497 None admin] PATH_INFO: `/v3/projects/dcddf7d31429427a8d46e49ef77bbe82` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:58.995923 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21ce3b5-95f1-4529-af7a-11415afd1497 None admin] RBAC: Authorizing `identity:get_project(project_id=dcddf7d31429427a8d46e49ef77bbe82)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:58.997448 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21ce3b5-95f1-4529-af7a-11415afd1497 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:58.999600 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 125/254] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 03:15:58 2022] GET /identity/v3/projects/dcddf7d31429427a8d46e49ef77bbe82 => generated 302 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:59.007479 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21ce3b5-95f1-4529-af7a-11415afd1497 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:59.022956 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d3adca-f53a-43ad-a61e-07d27b4d3ab3 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:59.060842 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:59.083987 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d45780-0bf6-46f9-8e96-15e83829020a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:59.084743 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d45780-0bf6-46f9-8e96-15e83829020a None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:59.085023 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d45780-0bf6-46f9-8e96-15e83829020a None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:59.085297 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d45780-0bf6-46f9-8e96-15e83829020a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:59.097006 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d45780-0bf6-46f9-8e96-15e83829020a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:15:59.103230 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-15d45780-0bf6-46f9-8e96-15e83829020a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 03:15:59.103230 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:15:59.103230 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:15:59.103230 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:15:59.103230 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:15:59.103230 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:15:59.103230 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:15:59.103230 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:15:59.103230 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:15:59.103230 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:15:59.103230 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:15:59.103230 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:15:59.103230 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:15:59.103230 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:15:59.103230 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:15:59.103230 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:15:59.104219 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:15:59.104219 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:15:59.104219 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:15:59.104219 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:15:59.104219 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:15:59.104219 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:15:59.104219 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:15:59.104219 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:15:59.104219 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:15:59.104219 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:15:59.104219 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:15:59.104219 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:15:59.104219 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:15:59.104219 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:15:59.104219 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:15:59.104219 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:15:59.104986 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:15:59.104986 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:15:59.104986 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:15:59.104986 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:15:59.104986 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:15:59.104986 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:15:59.104986 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:15:59.104986 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:15:59.104986 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:15:59.104986 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:15:59.104986 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 03:15:59.104986 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:15:59.107719 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 130/255] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 4 03:15:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:15:59.110687 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d45780-0bf6-46f9-8e96-15e83829020a None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:59.188813 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21ce3b5-95f1-4529-af7a-11415afd1497 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:59.206225 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:59.239608 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1419eadf-bc6b-4641-9b8c-f972717bb00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:59.240274 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1419eadf-bc6b-4641-9b8c-f972717bb00b None admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:59.240554 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1419eadf-bc6b-4641-9b8c-f972717bb00b None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:59.240846 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1419eadf-bc6b-4641-9b8c-f972717bb00b None admin] PATH_INFO: `/v3/projects/dcddf7d31429427a8d46e49ef77bbe82/users/7ce7d16edcfa4fb4829546770a87ca4b/roles/04d0e4575a28440eb4349b4a6565e8b8` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:59.244476 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1419eadf-bc6b-4641-9b8c-f972717bb00b None admin] RBAC: Authorizing `identity:create_grant(project_id=dcddf7d31429427a8d46e49ef77bbe82, user_id=7ce7d16edcfa4fb4829546770a87ca4b, role_id=04d0e4575a28440eb4349b4a6565e8b8)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:59.248855 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1419eadf-bc6b-4641-9b8c-f972717bb00b None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:59.264851 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d45780-0bf6-46f9-8e96-15e83829020a None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:59.272327 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 126/256] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Oct 4 03:15:59 2022] PUT /identity/v3/projects/dcddf7d31429427a8d46e49ef77bbe82/users/7ce7d16edcfa4fb4829546770a87ca4b/roles/04d0e4575a28440eb4349b4a6565e8b8 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 03:15:59.274997 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f407a23-886d-4d08-9efb-42a30bf4fad9 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:59.276186 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f407a23-886d-4d08-9efb-42a30bf4fad9 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:59.276460 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f407a23-886d-4d08-9efb-42a30bf4fad9 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:59.277835 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 127/257] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:15:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:15:59.283916 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304562ce-12cc-4fa8-957f-71c746fb15ed None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:59.284217 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304562ce-12cc-4fa8-957f-71c746fb15ed None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:59.284512 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304562ce-12cc-4fa8-957f-71c746fb15ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:59.318310 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-304562ce-12cc-4fa8-957f-71c746fb15ed None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:15:59.319544 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-304562ce-12cc-4fa8-957f-71c746fb15ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:15:59.344561 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012a94c9-ea22-4e03-8ba5-a849ca47609b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:59.345194 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a94c9-ea22-4e03-8ba5-a849ca47609b None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:59.345471 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a94c9-ea22-4e03-8ba5-a849ca47609b None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:59.345739 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a94c9-ea22-4e03-8ba5-a849ca47609b None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:59.346425 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012a94c9-ea22-4e03-8ba5-a849ca47609b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:15:59.346727 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012a94c9-ea22-4e03-8ba5-a849ca47609b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:59.348179 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012a94c9-ea22-4e03-8ba5-a849ca47609b None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:59.365080 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 131/258] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 03:15:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:15:59.371534 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012a94c9-ea22-4e03-8ba5-a849ca47609b None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:59.455226 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:59.478183 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 128/259] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:15:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 03:15:59.523157 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012a94c9-ea22-4e03-8ba5-a849ca47609b None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:59.575153 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d0e936-0505-4d00-94c4-36a88029a769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:59.575730 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d0e936-0505-4d00-94c4-36a88029a769 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:59.576009 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d0e936-0505-4d00-94c4-36a88029a769 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:59.576279 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d0e936-0505-4d00-94c4-36a88029a769 None admin] PATH_INFO: `/v3/users/b251ff62818e42c59185d214058156f4` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:59.577420 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d0e936-0505-4d00-94c4-36a88029a769 None admin] RBAC: Authorizing `identity:get_user(user_id=b251ff62818e42c59185d214058156f4)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:59.578867 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d0e936-0505-4d00-94c4-36a88029a769 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:59.580542 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 132/260] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 03:15:59 2022] GET /identity/v3/users/b251ff62818e42c59185d214058156f4 => generated 283 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:15:59.586226 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304562ce-12cc-4fa8-957f-71c746fb15ed None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:15:59.750783 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304562ce-12cc-4fa8-957f-71c746fb15ed None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:15:59.752448 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:15:59.792061 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e9adf4-eca5-4c4b-a0f9-d5ec50fc9cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:15:59.792676 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9adf4-eca5-4c4b-a0f9-d5ec50fc9cf4 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:15:59.792956 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9adf4-eca5-4c4b-a0f9-d5ec50fc9cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:15:59.793221 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9adf4-eca5-4c4b-a0f9-d5ec50fc9cf4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:15:59.891098 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e9adf4-eca5-4c4b-a0f9-d5ec50fc9cf4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:15:59.892517 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e9adf4-eca5-4c4b-a0f9-d5ec50fc9cf4 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:15:59.918285 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d0e936-0505-4d00-94c4-36a88029a769 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:00.035120 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d0e936-0505-4d00-94c4-36a88029a769 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:00.046805 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:00.073720 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee04700-f430-4e56-925c-f0f18a695636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:00.074655 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee04700-f430-4e56-925c-f0f18a695636 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:00.075086 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee04700-f430-4e56-925c-f0f18a695636 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:00.075619 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee04700-f430-4e56-925c-f0f18a695636 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:00.084143 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 129/261] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 03:15:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 03:16:00.088277 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee04700-f430-4e56-925c-f0f18a695636 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:16:00.090210 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e9adf4-eca5-4c4b-a0f9-d5ec50fc9cf4 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:00.092342 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:00.095535 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-1ee04700-f430-4e56-925c-f0f18a695636 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 03:16:00.095535 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:00.095535 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:00.095535 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:00.095535 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:00.095535 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:00.095535 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:00.095535 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:00.095535 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:00.095535 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:00.095535 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:00.095535 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:00.095535 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:16:00.095535 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:16:00.095535 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:16:00.095535 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:16:00.096675 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:16:00.096675 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:16:00.096675 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:16:00.096675 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:16:00.096675 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:00.096675 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:00.096675 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:00.096675 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:00.096675 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:00.096675 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:00.096675 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:00.096675 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:00.096675 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:00.096675 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:00.096675 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:00.096675 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:00.097670 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:00.097670 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:00.097670 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:00.097670 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:00.097670 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:16:00.097670 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:16:00.097670 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:16:00.097670 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:16:00.097670 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:16:00.097670 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:16:00.097670 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 03:16:00.097670 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:16:00.100097 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 133/262] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Oct 4 03:15:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:00.106217 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee04700-f430-4e56-925c-f0f18a695636 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:00.284788 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e9adf4-eca5-4c4b-a0f9-d5ec50fc9cf4 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:00.298587 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee04700-f430-4e56-925c-f0f18a695636 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:00.353870 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6eeda4-d06a-4f9a-913d-c9c10e241e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:00.354745 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6eeda4-d06a-4f9a-913d-c9c10e241e19 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:00.355172 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6eeda4-d06a-4f9a-913d-c9c10e241e19 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:00.355610 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6eeda4-d06a-4f9a-913d-c9c10e241e19 None admin] PATH_INFO: `/v3/projects/dcddf7d31429427a8d46e49ef77bbe82` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:00.356992 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6eeda4-d06a-4f9a-913d-c9c10e241e19 None admin] RBAC: Authorizing `identity:get_project(project_id=dcddf7d31429427a8d46e49ef77bbe82)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:00.358584 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6eeda4-d06a-4f9a-913d-c9c10e241e19 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:00.360768 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 130/263] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 03:16:00 2022] GET /identity/v3/projects/dcddf7d31429427a8d46e49ef77bbe82 => generated 302 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:16:00.365669 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d7602-8f59-4b60-9de9-c2cc1461725d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:00.366181 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6eeda4-d06a-4f9a-913d-c9c10e241e19 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:00.366295 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d7602-8f59-4b60-9de9-c2cc1461725d None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:00.366554 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d7602-8f59-4b60-9de9-c2cc1461725d None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:00.366829 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d7602-8f59-4b60-9de9-c2cc1461725d None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:00.367585 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34d7602-8f59-4b60-9de9-c2cc1461725d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:00.367898 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34d7602-8f59-4b60-9de9-c2cc1461725d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:00.369286 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34d7602-8f59-4b60-9de9-c2cc1461725d None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:00.384202 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 134/264] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 03:16:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:00.389948 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d7602-8f59-4b60-9de9-c2cc1461725d None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:00.456535 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:00.512473 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:00.549345 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6eeda4-d06a-4f9a-913d-c9c10e241e19 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:00.594309 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d7602-8f59-4b60-9de9-c2cc1461725d None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:00.643156 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac4e9e8-ed67-4c59-be62-4943e7442370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:00.643799 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac4e9e8-ed67-4c59-be62-4943e7442370 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:00.644083 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac4e9e8-ed67-4c59-be62-4943e7442370 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:00.644361 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac4e9e8-ed67-4c59-be62-4943e7442370 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:00.645091 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac4e9e8-ed67-4c59-be62-4943e7442370 None admin] RBAC: Adding query filter params (role.id=fe9379cda35c4ff78576fe48b60bea3c, scope.project.id=dcddf7d31429427a8d46e49ef77bbe82, user.id=b251ff62818e42c59185d214058156f4) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:00.645406 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac4e9e8-ed67-4c59-be62-4943e7442370 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:00.648126 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac4e9e8-ed67-4c59-be62-4943e7442370 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:00.660309 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 131/265] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 03:16:00 2022] GET /identity/v3/role_assignments?user.id=b251ff62818e42c59185d214058156f4&scope.project.id=dcddf7d31429427a8d46e49ef77bbe82&role.id=fe9379cda35c4ff78576fe48b60bea3c => generated 608 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:16:00.689130 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e6effe-3f5a-4fdf-8571-444b2548a556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:00.689801 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e6effe-3f5a-4fdf-8571-444b2548a556 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:00.690093 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e6effe-3f5a-4fdf-8571-444b2548a556 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:00.690359 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e6effe-3f5a-4fdf-8571-444b2548a556 None admin] PATH_INFO: `/v3/users/b251ff62818e42c59185d214058156f4` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:00.691722 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e6effe-3f5a-4fdf-8571-444b2548a556 None admin] RBAC: Authorizing `identity:get_user(user_id=b251ff62818e42c59185d214058156f4)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:00.693203 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e6effe-3f5a-4fdf-8571-444b2548a556 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:00.695787 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 135/266] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 03:16:00 2022] GET /identity/v3/users/b251ff62818e42c59185d214058156f4 => generated 283 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:00.700724 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac4e9e8-ed67-4c59-be62-4943e7442370 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:00.828467 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac4e9e8-ed67-4c59-be62-4943e7442370 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:00.875768 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2b61a6-af01-48d4-9506-60472bd12678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:00.876818 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b61a6-af01-48d4-9506-60472bd12678 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:00.877317 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b61a6-af01-48d4-9506-60472bd12678 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:00.877814 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b61a6-af01-48d4-9506-60472bd12678 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:00.889559 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:00.964338 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2b61a6-af01-48d4-9506-60472bd12678 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:00.965820 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2b61a6-af01-48d4-9506-60472bd12678 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:01.087856 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 132/267] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 03:16:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 03:16:01.096943 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e6effe-3f5a-4fdf-8571-444b2548a556 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:01.219731 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:01.228126 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e6effe-3f5a-4fdf-8571-444b2548a556 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:01.279211 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d526611a-d4d9-4f6c-a87f-94c4eda5c9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:01.279903 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d526611a-d4d9-4f6c-a87f-94c4eda5c9f3 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:01.280175 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d526611a-d4d9-4f6c-a87f-94c4eda5c9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:01.280447 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d526611a-d4d9-4f6c-a87f-94c4eda5c9f3 None admin] PATH_INFO: `/v3/projects/dcddf7d31429427a8d46e49ef77bbe82` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:01.282963 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d526611a-d4d9-4f6c-a87f-94c4eda5c9f3 None admin] RBAC: Authorizing `identity:get_project(project_id=dcddf7d31429427a8d46e49ef77bbe82)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:01.284528 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d526611a-d4d9-4f6c-a87f-94c4eda5c9f3 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:01.286785 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 136/268] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 03:16:01 2022] GET /identity/v3/projects/dcddf7d31429427a8d46e49ef77bbe82 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:01.293219 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2b61a6-af01-48d4-9506-60472bd12678 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:01.339274 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:01.426050 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2b61a6-af01-48d4-9506-60472bd12678 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:01.474332 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3de3d99-4660-4fa3-b438-f4bf4653e16a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:01.475357 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de3d99-4660-4fa3-b438-f4bf4653e16a None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:01.475676 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de3d99-4660-4fa3-b438-f4bf4653e16a None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:01.475953 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de3d99-4660-4fa3-b438-f4bf4653e16a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:01.476929 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3de3d99-4660-4fa3-b438-f4bf4653e16a None admin] RBAC: Adding query filter params (role.id=f2332a9a00b74fe0846d7211dd3850cb, scope.project.id=dcddf7d31429427a8d46e49ef77bbe82, user.id=b251ff62818e42c59185d214058156f4) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:01.477242 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3de3d99-4660-4fa3-b438-f4bf4653e16a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:01.478724 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3de3d99-4660-4fa3-b438-f4bf4653e16a None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:01.487597 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 133/269] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 03:16:01 2022] GET /identity/v3/role_assignments?user.id=b251ff62818e42c59185d214058156f4&scope.project.id=dcddf7d31429427a8d46e49ef77bbe82&role.id=f2332a9a00b74fe0846d7211dd3850cb => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:01.514361 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc4e85-af1c-444a-9f07-c6c6294549ba None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:01.514752 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc4e85-af1c-444a-9f07-c6c6294549ba None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:01.515103 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc4e85-af1c-444a-9f07-c6c6294549ba None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:01.516815 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 137/270] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:16:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:16:01.522687 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd7e66-5908-425f-87b9-8d953c2cf7a0 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:01.523032 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd7e66-5908-425f-87b9-8d953c2cf7a0 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:01.523413 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd7e66-5908-425f-87b9-8d953c2cf7a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:01.552591 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-efcd7e66-5908-425f-87b9-8d953c2cf7a0 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:16:01.553833 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-efcd7e66-5908-425f-87b9-8d953c2cf7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:16:01.611029 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c5ee5-dd22-4d17-bd35-8ca05a3ff13d None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:01.611331 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c5ee5-dd22-4d17-bd35-8ca05a3ff13d None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:01.611539 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c5ee5-dd22-4d17-bd35-8ca05a3ff13d None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:01.613196 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 138/271] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:16:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:16:01.634668 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9899b1-a273-4840-ac4f-d6f4e9c97e96 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:01.634668 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9899b1-a273-4840-ac4f-d6f4e9c97e96 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:01.634668 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9899b1-a273-4840-ac4f-d6f4e9c97e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:01.653133 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 134/272] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:16:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 03:16:01.660059 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-7d9899b1-a273-4840-ac4f-d6f4e9c97e96 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:16:01.661288 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-7d9899b1-a273-4840-ac4f-d6f4e9c97e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:16:01.758595 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 139/273] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:16:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 03:16:01.936934 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb8fdb-07a2-4a2a-9c1a-f717ee45adf8 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:01.937413 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb8fdb-07a2-4a2a-9c1a-f717ee45adf8 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:01.937413 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb8fdb-07a2-4a2a-9c1a-f717ee45adf8 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:01.939020 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 135/274] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:16:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:16:01.944437 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6736acc7-4d4c-48be-a97a-38340f6d0eff None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:01.944721 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6736acc7-4d4c-48be-a97a-38340f6d0eff None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:01.944997 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6736acc7-4d4c-48be-a97a-38340f6d0eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:01.968488 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-6736acc7-4d4c-48be-a97a-38340f6d0eff None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:16:01.969697 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-6736acc7-4d4c-48be-a97a-38340f6d0eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:16:01.997885 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edb8fdb-07a2-4a2a-9c1a-f717ee45adf8 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:02.035007 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:02.064562 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 140/275] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:16:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 03:16:02.084268 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6736acc7-4d4c-48be-a97a-38340f6d0eff None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:02.113644 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:02.140711 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edb8fdb-07a2-4a2a-9c1a-f717ee45adf8 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:02.178737 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadf4a26-7638-4090-9011-213d2377acc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:02.179425 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf4a26-7638-4090-9011-213d2377acc3 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:02.179797 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf4a26-7638-4090-9011-213d2377acc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:02.180051 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf4a26-7638-4090-9011-213d2377acc3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:02.181218 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadf4a26-7638-4090-9011-213d2377acc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:02.182665 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadf4a26-7638-4090-9011-213d2377acc3 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:02.184762 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 136/276] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:16:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:02.189796 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadf4a26-7638-4090-9011-213d2377acc3 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:02.214685 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6736acc7-4d4c-48be-a97a-38340f6d0eff None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:02.255571 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f64d241-6cbf-4218-aeeb-c11449d1c41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:02.256202 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64d241-6cbf-4218-aeeb-c11449d1c41a None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:02.256487 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64d241-6cbf-4218-aeeb-c11449d1c41a None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:02.256758 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64d241-6cbf-4218-aeeb-c11449d1c41a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:02.268067 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f64d241-6cbf-4218-aeeb-c11449d1c41a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:16:02.272962 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-4f64d241-6cbf-4218-aeeb-c11449d1c41a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 03:16:02.272962 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:02.272962 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:02.272962 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:02.272962 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:02.272962 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:02.272962 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:02.272962 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:02.272962 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:02.272962 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:02.272962 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:02.272962 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:02.272962 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:16:02.272962 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:16:02.272962 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:16:02.272962 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:16:02.274373 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:16:02.274373 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:16:02.274373 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:16:02.274373 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:16:02.274373 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:02.274373 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:02.274373 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:02.274373 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:02.274373 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:02.274373 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:02.274373 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:02.274373 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:02.274373 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:02.274373 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:02.274373 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:02.274373 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:02.275243 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:02.275243 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:02.275243 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:02.275243 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:02.275243 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:16:02.275243 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:16:02.275243 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:16:02.275243 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:16:02.275243 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:16:02.275243 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:16:02.275243 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 03:16:02.275243 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:16:02.275243 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 141/277] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 03:16:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 03:16:02.280637 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f64d241-6cbf-4218-aeeb-c11449d1c41a None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:02.298794 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:02.307133 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadf4a26-7638-4090-9011-213d2377acc3 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:02.345203 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5d7f3b-7594-4584-88e5-b61e2d989b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:02.346176 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d7f3b-7594-4584-88e5-b61e2d989b5d None admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:02.346688 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d7f3b-7594-4584-88e5-b61e2d989b5d None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:02.347096 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d7f3b-7594-4584-88e5-b61e2d989b5d None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:02.347909 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5d7f3b-7594-4584-88e5-b61e2d989b5d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:02.349502 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5d7f3b-7594-4584-88e5-b61e2d989b5d None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:02.372971 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:02.383869 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 137/278] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Oct 4 03:16:02 2022] POST /identity/v3/users => generated 293 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:16:02.384681 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5d7f3b-7594-4584-88e5-b61e2d989b5d None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:02.390043 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f64d241-6cbf-4218-aeeb-c11449d1c41a None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:02.430264 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92af9346-0763-4c99-a47d-4f6caf9b18fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:02.430893 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af9346-0763-4c99-a47d-4f6caf9b18fd None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:02.431201 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af9346-0763-4c99-a47d-4f6caf9b18fd None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:02.431452 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af9346-0763-4c99-a47d-4f6caf9b18fd None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:02.432210 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92af9346-0763-4c99-a47d-4f6caf9b18fd None admin] RBAC: Adding query filter params (name=member) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:02.432517 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92af9346-0763-4c99-a47d-4f6caf9b18fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:02.434031 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92af9346-0763-4c99-a47d-4f6caf9b18fd None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:02.450785 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 142/279] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Oct 4 03:16:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:16:02.451787 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92af9346-0763-4c99-a47d-4f6caf9b18fd None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:02.518859 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5d7f3b-7594-4584-88e5-b61e2d989b5d None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:02.559201 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d90994a-0621-4f47-9e51-6d46432f1a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:02.560215 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d90994a-0621-4f47-9e51-6d46432f1a10 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:02.560488 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d90994a-0621-4f47-9e51-6d46432f1a10 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:02.560759 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d90994a-0621-4f47-9e51-6d46432f1a10 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:02.565392 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92af9346-0763-4c99-a47d-4f6caf9b18fd None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:02.572185 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d90994a-0621-4f47-9e51-6d46432f1a10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:16:02.577578 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-8d90994a-0621-4f47-9e51-6d46432f1a10 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 03:16:02.577578 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:02.577578 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:02.577578 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:02.577578 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:02.577578 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:02.577578 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:02.577578 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:02.577578 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:02.577578 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:02.577578 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:02.577578 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:02.577578 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:16:02.577578 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:16:02.577578 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:16:02.577578 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:16:02.578619 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:16:02.578619 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:16:02.578619 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:16:02.578619 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:16:02.578619 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:02.578619 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:02.578619 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:02.578619 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:02.578619 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:02.578619 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:02.578619 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:02.578619 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:02.578619 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:02.578619 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:02.578619 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:02.578619 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:02.579725 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:02.579725 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:02.579725 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:02.579725 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:02.579725 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:16:02.579725 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:16:02.579725 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:16:02.579725 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:16:02.579725 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:16:02.579725 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:16:02.579725 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 03:16:02.579725 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:16:02.583668 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 138/280] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 03:16:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:02.584943 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58240a9-99f0-41f1-bd69-32b5ff24d1bd None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:02.585229 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58240a9-99f0-41f1-bd69-32b5ff24d1bd None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:02.585501 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58240a9-99f0-41f1-bd69-32b5ff24d1bd None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:02.587880 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 139/281] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:16:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:16:02.588602 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58240a9-99f0-41f1-bd69-32b5ff24d1bd None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:02.606401 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:02.606692 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af0c678-8bb3-4791-b89f-9cfa32475647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:02.607276 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0c678-8bb3-4791-b89f-9cfa32475647 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:02.607689 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0c678-8bb3-4791-b89f-9cfa32475647 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:02.608252 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0c678-8bb3-4791-b89f-9cfa32475647 None admin] PATH_INFO: `/v3/users/1108dcf1fc50430e99ca505e83cb1a13` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:02.625667 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af0c678-8bb3-4791-b89f-9cfa32475647 None admin] RBAC: Authorizing `identity:get_user(user_id=1108dcf1fc50430e99ca505e83cb1a13)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:02.626776 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af0c678-8bb3-4791-b89f-9cfa32475647 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:02.629358 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 143/282] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 03:16:02 2022] GET /identity/v3/users/1108dcf1fc50430e99ca505e83cb1a13 => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:02.630739 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34178166-f486-4e72-9af5-351cba67b6c7 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:02.631032 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34178166-f486-4e72-9af5-351cba67b6c7 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:02.631306 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34178166-f486-4e72-9af5-351cba67b6c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:02.646730 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:02.653913 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-34178166-f486-4e72-9af5-351cba67b6c7 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:16:02.655414 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-34178166-f486-4e72-9af5-351cba67b6c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:16:02.722219 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58240a9-99f0-41f1-bd69-32b5ff24d1bd None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:02.736950 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 144/283] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:16:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 03:16:02.737234 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34178166-f486-4e72-9af5-351cba67b6c7 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:02.770772 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47124e7a-1292-4a46-82b8-67d5a2b86fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:02.771404 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47124e7a-1292-4a46-82b8-67d5a2b86fea None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:02.771725 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47124e7a-1292-4a46-82b8-67d5a2b86fea None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:02.771998 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47124e7a-1292-4a46-82b8-67d5a2b86fea None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:02.772999 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47124e7a-1292-4a46-82b8-67d5a2b86fea None admin] RBAC: Adding query filter params (name=reader) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:02.773507 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47124e7a-1292-4a46-82b8-67d5a2b86fea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:02.775742 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47124e7a-1292-4a46-82b8-67d5a2b86fea None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:02.786595 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 140/284] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Oct 4 03:16:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:02.794104 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47124e7a-1292-4a46-82b8-67d5a2b86fea None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:02.855253 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34178166-f486-4e72-9af5-351cba67b6c7 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:02.899853 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:02.916250 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a80127-17ec-4bce-89c2-a05a43d956af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:02.916863 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a80127-17ec-4bce-89c2-a05a43d956af None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:02.917141 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a80127-17ec-4bce-89c2-a05a43d956af None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:02.917414 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a80127-17ec-4bce-89c2-a05a43d956af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:02.918153 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a80127-17ec-4bce-89c2-a05a43d956af None admin] RBAC: Adding query filter params (role.id=04d0e4575a28440eb4349b4a6565e8b8, user.id=1108dcf1fc50430e99ca505e83cb1a13, scope.system=all) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:02.918459 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a80127-17ec-4bce-89c2-a05a43d956af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:02.919925 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a80127-17ec-4bce-89c2-a05a43d956af None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:02.926435 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:02.931205 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 145/285] 10.222.0.25 () {56 vars in 1308 bytes} [Tue Oct 4 03:16:02 2022] GET /identity/v3/role_assignments?user.id=1108dcf1fc50430e99ca505e83cb1a13&scope.system=all&role.id=04d0e4575a28440eb4349b4a6565e8b8 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:02.951233 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47124e7a-1292-4a46-82b8-67d5a2b86fea None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:03.006009 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dca9a0-7a59-4acd-ae65-56b06eab7f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:03.006580 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dca9a0-7a59-4acd-ae65-56b06eab7f7a None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:03.006859 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dca9a0-7a59-4acd-ae65-56b06eab7f7a None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:03.007132 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dca9a0-7a59-4acd-ae65-56b06eab7f7a None admin] PATH_INFO: `/v3/users/a3d5e94ed1394c2cb81078c407c50694` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:03.008831 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dca9a0-7a59-4acd-ae65-56b06eab7f7a None admin] RBAC: Authorizing `identity:get_user(user_id=a3d5e94ed1394c2cb81078c407c50694)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:03.010310 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dca9a0-7a59-4acd-ae65-56b06eab7f7a None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:03.012031 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 141/286] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 03:16:02 2022] GET /identity/v3/users/a3d5e94ed1394c2cb81078c407c50694 => generated 297 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:16:03.017915 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a80127-17ec-4bce-89c2-a05a43d956af None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:03.141065 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a80127-17ec-4bce-89c2-a05a43d956af None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:03.183919 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dca9a0-7a59-4acd-ae65-56b06eab7f7a None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:03.190640 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79633cf-a146-4f97-a754-8159ed5b3358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:03.191325 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79633cf-a146-4f97-a754-8159ed5b3358 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:03.191634 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79633cf-a146-4f97-a754-8159ed5b3358 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:03.191912 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79633cf-a146-4f97-a754-8159ed5b3358 None admin] PATH_INFO: `/v3/projects/dcddf7d31429427a8d46e49ef77bbe82` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:03.193050 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79633cf-a146-4f97-a754-8159ed5b3358 None admin] RBAC: Authorizing `identity:get_project(project_id=dcddf7d31429427a8d46e49ef77bbe82)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:03.194517 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79633cf-a146-4f97-a754-8159ed5b3358 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:03.197330 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 146/287] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 03:16:03 2022] GET /identity/v3/projects/dcddf7d31429427a8d46e49ef77bbe82 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:03.204440 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79633cf-a146-4f97-a754-8159ed5b3358 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:03.334037 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:03.361970 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dca9a0-7a59-4acd-ae65-56b06eab7f7a None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:03.387229 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79633cf-a146-4f97-a754-8159ed5b3358 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:03.402830 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2855a354-1780-407f-afec-33bcf299293e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:03.403467 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2855a354-1780-407f-afec-33bcf299293e None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:03.403769 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2855a354-1780-407f-afec-33bcf299293e None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:03.404041 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2855a354-1780-407f-afec-33bcf299293e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:03.416664 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2855a354-1780-407f-afec-33bcf299293e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:16:03.422768 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-2855a354-1780-407f-afec-33bcf299293e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 03:16:03.422768 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:03.422768 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:03.422768 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:03.422768 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:03.422768 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:03.422768 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:03.422768 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:03.422768 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:03.422768 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:03.422768 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:03.422768 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:03.422768 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:16:03.422768 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:16:03.422768 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:16:03.422768 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:16:03.423687 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:16:03.423687 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:16:03.423687 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:16:03.423687 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:16:03.423687 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:03.423687 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:03.423687 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:03.423687 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:03.423687 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:03.423687 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:03.423687 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:03.423687 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:03.423687 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:03.423687 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:03.423687 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:03.423687 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:03.424474 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:03.424474 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:03.424474 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:03.424474 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:03.424474 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:16:03.424474 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:16:03.424474 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:16:03.424474 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:16:03.424474 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:16:03.424474 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:16:03.424474 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 03:16:03.424474 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:16:03.424474 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 142/288] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 03:16:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:03.432554 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2855a354-1780-407f-afec-33bcf299293e None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:03.435965 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d36ace4-87c2-4284-a724-2c7e78a3eb46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:03.436907 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36ace4-87c2-4284-a724-2c7e78a3eb46 None admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:03.437393 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36ace4-87c2-4284-a724-2c7e78a3eb46 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:03.437846 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36ace4-87c2-4284-a724-2c7e78a3eb46 None admin] PATH_INFO: `/v3/projects/dcddf7d31429427a8d46e49ef77bbe82/users/a3d5e94ed1394c2cb81078c407c50694/roles/8513937b0b5c4d0099cb3732beb89fd4` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:03.441408 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:03.443873 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d36ace4-87c2-4284-a724-2c7e78a3eb46 None admin] RBAC: Authorizing `identity:create_grant(project_id=dcddf7d31429427a8d46e49ef77bbe82, user_id=a3d5e94ed1394c2cb81078c407c50694, role_id=8513937b0b5c4d0099cb3732beb89fd4)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:03.446141 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d36ace4-87c2-4284-a724-2c7e78a3eb46 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:03.460802 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 147/289] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Oct 4 03:16:03 2022] PUT /identity/v3/projects/dcddf7d31429427a8d46e49ef77bbe82/users/a3d5e94ed1394c2cb81078c407c50694/roles/8513937b0b5c4d0099cb3732beb89fd4 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:16:03.560861 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2855a354-1780-407f-afec-33bcf299293e None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:03.602633 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adb0824-0a09-4d7c-9899-06fdf10e6f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:03.603529 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb0824-0a09-4d7c-9899-06fdf10e6f62 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:03.604010 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb0824-0a09-4d7c-9899-06fdf10e6f62 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:03.604430 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb0824-0a09-4d7c-9899-06fdf10e6f62 None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:03.605268 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adb0824-0a09-4d7c-9899-06fdf10e6f62 None admin] RBAC: Adding query filter params (name=member) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:03.605746 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adb0824-0a09-4d7c-9899-06fdf10e6f62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:03.607303 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adb0824-0a09-4d7c-9899-06fdf10e6f62 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:03.617330 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 143/290] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Oct 4 03:16:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:03.623372 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d36ace4-87c2-4284-a724-2c7e78a3eb46 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:03.749117 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d36ace4-87c2-4284-a724-2c7e78a3eb46 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:03.782144 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:03.791798 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac3e704-0155-4765-989b-89a438d0e9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:03.792444 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3e704-0155-4765-989b-89a438d0e9a8 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:03.792724 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3e704-0155-4765-989b-89a438d0e9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:03.792999 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3e704-0155-4765-989b-89a438d0e9a8 None admin] PATH_INFO: `/v3/users/7ce7d16edcfa4fb4829546770a87ca4b` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:03.794233 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac3e704-0155-4765-989b-89a438d0e9a8 None admin] RBAC: Authorizing `identity:get_user(user_id=7ce7d16edcfa4fb4829546770a87ca4b)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:03.795770 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac3e704-0155-4765-989b-89a438d0e9a8 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:03.802050 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 148/291] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 03:16:03 2022] GET /identity/v3/users/7ce7d16edcfa4fb4829546770a87ca4b => generated 297 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:03.803433 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adb0824-0a09-4d7c-9899-06fdf10e6f62 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:03.888593 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:03.936917 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adb0824-0a09-4d7c-9899-06fdf10e6f62 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:03.982097 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1c1cbd-53d8-48ad-8b0d-9a1082ae9954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:03.982715 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c1cbd-53d8-48ad-8b0d-9a1082ae9954 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:03.982962 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c1cbd-53d8-48ad-8b0d-9a1082ae9954 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:03.983237 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c1cbd-53d8-48ad-8b0d-9a1082ae9954 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:04.067500 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1c1cbd-53d8-48ad-8b0d-9a1082ae9954 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:04.069280 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1c1cbd-53d8-48ad-8b0d-9a1082ae9954 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:04.134965 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:04.181490 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 144/292] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 03:16:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 03:16:04.186959 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac3e704-0155-4765-989b-89a438d0e9a8 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:04.325558 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac3e704-0155-4765-989b-89a438d0e9a8 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:04.370969 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf69be3-b2e6-4869-a705-14976d576436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:04.371633 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf69be3-b2e6-4869-a705-14976d576436 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:04.371916 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf69be3-b2e6-4869-a705-14976d576436 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:04.372191 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf69be3-b2e6-4869-a705-14976d576436 None admin] PATH_INFO: `/v3/projects/dcddf7d31429427a8d46e49ef77bbe82` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:04.373344 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf69be3-b2e6-4869-a705-14976d576436 None admin] RBAC: Authorizing `identity:get_project(project_id=dcddf7d31429427a8d46e49ef77bbe82)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:04.374841 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf69be3-b2e6-4869-a705-14976d576436 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:04.376849 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 149/293] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 03:16:04 2022] GET /identity/v3/projects/dcddf7d31429427a8d46e49ef77bbe82 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:04.382901 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1c1cbd-53d8-48ad-8b0d-9a1082ae9954 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:04.495166 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1c1cbd-53d8-48ad-8b0d-9a1082ae9954 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:04.530357 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1fa113-9648-433c-ab04-51a50abd265d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:04.531285 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1fa113-9648-433c-ab04-51a50abd265d None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:04.531798 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1fa113-9648-433c-ab04-51a50abd265d None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:04.532275 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1fa113-9648-433c-ab04-51a50abd265d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:04.533192 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1fa113-9648-433c-ab04-51a50abd265d None admin] RBAC: Adding query filter params (role.id=04d0e4575a28440eb4349b4a6565e8b8, scope.project.id=dcddf7d31429427a8d46e49ef77bbe82, user.id=7ce7d16edcfa4fb4829546770a87ca4b) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:04.533718 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1fa113-9648-433c-ab04-51a50abd265d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:04.535333 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1fa113-9648-433c-ab04-51a50abd265d None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:04.541699 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 145/294] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 03:16:04 2022] GET /identity/v3/role_assignments?user.id=7ce7d16edcfa4fb4829546770a87ca4b&scope.project.id=dcddf7d31429427a8d46e49ef77bbe82&role.id=04d0e4575a28440eb4349b4a6565e8b8 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:05.405909 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288a9e0-85b9-4b1c-bb26-3f64723116a4 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:05.406455 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288a9e0-85b9-4b1c-bb26-3f64723116a4 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:05.406455 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288a9e0-85b9-4b1c-bb26-3f64723116a4 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:05.408102 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 150/295] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:16:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:16:05.415006 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ee877-cf1d-42ef-bcde-95e295a7d5e2 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:05.415431 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ee877-cf1d-42ef-bcde-95e295a7d5e2 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:05.415632 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ee877-cf1d-42ef-bcde-95e295a7d5e2 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:05.416932 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 146/296] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:16:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:16:05.417214 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320c79e-8d0b-4a40-baa7-1d1aa98bd815 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:05.417501 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320c79e-8d0b-4a40-baa7-1d1aa98bd815 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:05.417776 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320c79e-8d0b-4a40-baa7-1d1aa98bd815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:05.422161 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b7dbdb-45c9-4fcb-a77f-6bdb1bee5fcd None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:05.422446 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b7dbdb-45c9-4fcb-a77f-6bdb1bee5fcd None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:05.422940 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b7dbdb-45c9-4fcb-a77f-6bdb1bee5fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:05.437457 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-b320c79e-8d0b-4a40-baa7-1d1aa98bd815 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:16:05.438651 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-b320c79e-8d0b-4a40-baa7-1d1aa98bd815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:16:05.442465 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-e4b7dbdb-45c9-4fcb-a77f-6bdb1bee5fcd None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:16:05.443694 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-e4b7dbdb-45c9-4fcb-a77f-6bdb1bee5fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:16:05.469078 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:05.502816 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:05.513450 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 151/297] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:16:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 03:16:05.514558 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451328e1-5550-409d-99a1-7e71c70e9bbd None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:05.514840 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451328e1-5550-409d-99a1-7e71c70e9bbd None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:05.515112 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451328e1-5550-409d-99a1-7e71c70e9bbd None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:05.516512 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 152/298] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:16:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:16:05.521596 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82417a1d-e9eb-4797-a8f7-82c8a059aa7f None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:05.522043 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82417a1d-e9eb-4797-a8f7-82c8a059aa7f None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:05.522451 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82417a1d-e9eb-4797-a8f7-82c8a059aa7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:05.524366 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 147/299] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:16:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 03:16:05.544416 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-82417a1d-e9eb-4797-a8f7-82c8a059aa7f None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:16:05.545817 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-82417a1d-e9eb-4797-a8f7-82c8a059aa7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:16:05.614543 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 153/300] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:16:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 03:16:05.794959 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b7dbdb-45c9-4fcb-a77f-6bdb1bee5fcd None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:05.805189 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82417a1d-e9eb-4797-a8f7-82c8a059aa7f None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:05.910451 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b7dbdb-45c9-4fcb-a77f-6bdb1bee5fcd None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:05.918957 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82417a1d-e9eb-4797-a8f7-82c8a059aa7f None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:05.943512 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:05.948141 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f49225-9d96-486b-a02b-f6ad9ac45145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:05.948765 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f49225-9d96-486b-a02b-f6ad9ac45145 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:05.949041 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f49225-9d96-486b-a02b-f6ad9ac45145 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:05.949314 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f49225-9d96-486b-a02b-f6ad9ac45145 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:05.955182 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8a1f7-c172-4ad3-857d-fc61110cd5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:05.955832 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8a1f7-c172-4ad3-857d-fc61110cd5e9 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:05.956110 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8a1f7-c172-4ad3-857d-fc61110cd5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:05.956384 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8a1f7-c172-4ad3-857d-fc61110cd5e9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:05.957489 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f8a1f7-c172-4ad3-857d-fc61110cd5e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:05.958925 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f8a1f7-c172-4ad3-857d-fc61110cd5e9 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:05.959131 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f49225-9d96-486b-a02b-f6ad9ac45145 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:16:05.960518 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 154/301] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:16:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:05.960518 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8a1f7-c172-4ad3-857d-fc61110cd5e9 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:05.964128 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-c9f49225-9d96-486b-a02b-f6ad9ac45145 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 03:16:05.964128 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:05.964128 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:05.964128 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:05.964128 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:05.964128 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:05.964128 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:05.964128 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:05.964128 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:05.964128 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:05.964128 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:05.964128 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:05.964128 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:16:05.964128 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:16:05.964128 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:16:05.964128 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:16:05.965019 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:16:05.965019 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:16:05.965019 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:16:05.965019 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:16:05.965019 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:05.965019 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:05.965019 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:05.965019 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:05.965019 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:05.965019 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:05.965019 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:05.965019 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:05.965019 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:05.965019 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:05.965019 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:05.965019 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:05.965792 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:05.965792 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:05.965792 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:05.965792 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:05.965792 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:16:05.965792 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:16:05.965792 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:16:05.965792 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:16:05.965792 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:16:05.965792 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:16:05.965792 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 03:16:05.965792 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:16:05.965792 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 148/302] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 03:16:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:05.966444 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f25d8-14f1-48e5-bd87-5186fecc0ae6 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:05.967080 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f25d8-14f1-48e5-bd87-5186fecc0ae6 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:05.967080 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f25d8-14f1-48e5-bd87-5186fecc0ae6 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:05.968163 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 149/303] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:16:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:16:05.968832 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26f25d8-14f1-48e5-bd87-5186fecc0ae6 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:05.987430 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:06.064461 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8a1f7-c172-4ad3-857d-fc61110cd5e9 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:06.068981 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26f25d8-14f1-48e5-bd87-5186fecc0ae6 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:06.098993 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653e447c-c4e2-411a-b257-891b9f2adc58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:06.099650 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e447c-c4e2-411a-b257-891b9f2adc58 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:06.099938 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e447c-c4e2-411a-b257-891b9f2adc58 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:06.100213 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e447c-c4e2-411a-b257-891b9f2adc58 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:06.103266 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0238eff7-6c32-4f28-9cf0-ac8d25003b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:06.103894 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0238eff7-6c32-4f28-9cf0-ac8d25003b8b None admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:06.104179 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0238eff7-6c32-4f28-9cf0-ac8d25003b8b None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:06.104453 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0238eff7-6c32-4f28-9cf0-ac8d25003b8b None admin] PATH_INFO: `/v3/groups` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:06.105087 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0238eff7-6c32-4f28-9cf0-ac8d25003b8b None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:06.106515 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0238eff7-6c32-4f28-9cf0-ac8d25003b8b None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:06.110396 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653e447c-c4e2-411a-b257-891b9f2adc58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:16:06.115198 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-653e447c-c4e2-411a-b257-891b9f2adc58 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 03:16:06.115198 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:06.115198 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:06.115198 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:06.115198 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:06.115198 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:06.115198 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:06.115198 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:06.115198 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:06.115198 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:06.115198 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:06.115198 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:06.115198 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:16:06.115198 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:16:06.115198 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:16:06.115198 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:16:06.116338 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:16:06.116338 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:16:06.116338 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:16:06.116338 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:16:06.116338 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:06.116338 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:06.116338 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:06.116338 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:06.116338 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:06.116338 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:06.116338 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:06.116338 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:06.116338 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:06.116338 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:06.116338 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:06.116338 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:06.117796 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:06.117796 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:06.117796 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:06.117796 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:06.117796 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:16:06.117796 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:16:06.117796 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:16:06.117796 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:16:06.117796 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:16:06.117796 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:16:06.117796 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 03:16:06.117796 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:16:06.117796 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 155/304] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 03:16:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:06.117796 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653e447c-c4e2-411a-b257-891b9f2adc58 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:06.139515 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 150/305] 10.222.0.25 () {60 vars in 1134 bytes} [Tue Oct 4 03:16:05 2022] POST /identity/v3/groups => generated 229 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:16:06.139515 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42dd65-ad2b-4777-a053-cec2b0ca519d None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:06.139515 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42dd65-ad2b-4777-a053-cec2b0ca519d None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:06.139515 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42dd65-ad2b-4777-a053-cec2b0ca519d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:06.149923 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-4a42dd65-ad2b-4777-a053-cec2b0ca519d None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:16:06.151152 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-4a42dd65-ad2b-4777-a053-cec2b0ca519d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:16:06.177969 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:06.231563 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 151/306] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:16:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 03:16:06.231563 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a42dd65-ad2b-4777-a053-cec2b0ca519d None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:06.240846 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653e447c-c4e2-411a-b257-891b9f2adc58 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:06.246891 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:06.306247 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4641f5-4e63-4da5-a680-0a7c3712dbf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:06.307225 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4641f5-4e63-4da5-a680-0a7c3712dbf5 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:06.308324 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4641f5-4e63-4da5-a680-0a7c3712dbf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:06.308811 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4641f5-4e63-4da5-a680-0a7c3712dbf5 None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:06.309801 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4641f5-4e63-4da5-a680-0a7c3712dbf5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:06.310401 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4641f5-4e63-4da5-a680-0a7c3712dbf5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:06.312643 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4641f5-4e63-4da5-a680-0a7c3712dbf5 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:06.329023 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 156/307] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Oct 4 03:16:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:06.335465 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4641f5-4e63-4da5-a680-0a7c3712dbf5 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:06.364335 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a42dd65-ad2b-4777-a053-cec2b0ca519d None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:06.404380 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056764eb-981d-4e0a-a71e-394f9585116d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:06.405308 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056764eb-981d-4e0a-a71e-394f9585116d None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:06.405599 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056764eb-981d-4e0a-a71e-394f9585116d None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:06.405873 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056764eb-981d-4e0a-a71e-394f9585116d None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:06.406830 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056764eb-981d-4e0a-a71e-394f9585116d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:06.407128 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056764eb-981d-4e0a-a71e-394f9585116d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:06.408537 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056764eb-981d-4e0a-a71e-394f9585116d None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:06.419976 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 152/308] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Oct 4 03:16:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:06.426067 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056764eb-981d-4e0a-a71e-394f9585116d None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:06.460987 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4641f5-4e63-4da5-a680-0a7c3712dbf5 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:06.479664 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:06.508202 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf3e64d-08a5-4f12-a03f-e8606c42424d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:06.509123 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf3e64d-08a5-4f12-a03f-e8606c42424d None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:06.510167 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf3e64d-08a5-4f12-a03f-e8606c42424d None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:06.510618 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf3e64d-08a5-4f12-a03f-e8606c42424d None admin] PATH_INFO: `/v3/users/1108dcf1fc50430e99ca505e83cb1a13` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:06.512346 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf3e64d-08a5-4f12-a03f-e8606c42424d None admin] RBAC: Authorizing `identity:get_user(user_id=1108dcf1fc50430e99ca505e83cb1a13)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:06.512859 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:06.514864 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf3e64d-08a5-4f12-a03f-e8606c42424d None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:06.516632 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 157/309] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 03:16:06 2022] GET /identity/v3/users/1108dcf1fc50430e99ca505e83cb1a13 => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:06.517285 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf3e64d-08a5-4f12-a03f-e8606c42424d None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:06.551292 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056764eb-981d-4e0a-a71e-394f9585116d None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:06.588383 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f3957a-dd1d-4570-9b80-4c071dd0a789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:06.588929 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f3957a-dd1d-4570-9b80-4c071dd0a789 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:06.589211 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f3957a-dd1d-4570-9b80-4c071dd0a789 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:06.589481 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f3957a-dd1d-4570-9b80-4c071dd0a789 None admin] PATH_INFO: `/v3/users/260b4941aeb142118ab9ff862799cd8c` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:06.604081 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f3957a-dd1d-4570-9b80-4c071dd0a789 None admin] RBAC: Authorizing `identity:get_user(user_id=260b4941aeb142118ab9ff862799cd8c)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:06.605901 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f3957a-dd1d-4570-9b80-4c071dd0a789 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:06.607180 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 153/310] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 03:16:06 2022] GET /identity/v3/users/260b4941aeb142118ab9ff862799cd8c => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:06.607952 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f3957a-dd1d-4570-9b80-4c071dd0a789 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:06.626594 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf3e64d-08a5-4f12-a03f-e8606c42424d None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:06.662986 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf30231-2917-4a9a-ba7f-93221ba03609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:06.663640 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf30231-2917-4a9a-ba7f-93221ba03609 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:06.664607 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf30231-2917-4a9a-ba7f-93221ba03609 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:06.664885 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf30231-2917-4a9a-ba7f-93221ba03609 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:06.675011 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf30231-2917-4a9a-ba7f-93221ba03609 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:16:06.680303 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-abf30231-2917-4a9a-ba7f-93221ba03609 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 03:16:06.680303 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:06.680303 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:06.680303 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:06.680303 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:06.680303 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:06.680303 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:06.680303 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:06.680303 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:06.680303 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:06.680303 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:06.680303 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:06.680303 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:16:06.680303 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:16:06.680303 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:16:06.680303 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:16:06.681193 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:16:06.681193 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:16:06.681193 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:16:06.681193 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:16:06.681193 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:06.681193 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:06.681193 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:06.681193 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:06.681193 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:06.681193 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:06.681193 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:06.681193 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:06.681193 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:06.681193 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:06.681193 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:06.681193 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:06.682575 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:06.682575 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:06.682575 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:06.682575 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:06.682575 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:16:06.682575 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:16:06.682575 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:16:06.682575 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:16:06.682575 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:16:06.682575 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:16:06.682575 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 03:16:06.682575 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:16:06.682575 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 158/311] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 03:16:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:06.682575 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf30231-2917-4a9a-ba7f-93221ba03609 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:06.729180 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:06.732282 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f3957a-dd1d-4570-9b80-4c071dd0a789 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:06.761996 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:06.771145 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c5fd5e-43a6-43d7-ba3e-5dc93abb3945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:06.771816 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c5fd5e-43a6-43d7-ba3e-5dc93abb3945 None admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:06.772094 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c5fd5e-43a6-43d7-ba3e-5dc93abb3945 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:06.772364 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c5fd5e-43a6-43d7-ba3e-5dc93abb3945 None admin] PATH_INFO: `/v3/system/users/1108dcf1fc50430e99ca505e83cb1a13/roles/04d0e4575a28440eb4349b4a6565e8b8` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:06.773854 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c5fd5e-43a6-43d7-ba3e-5dc93abb3945 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=1108dcf1fc50430e99ca505e83cb1a13, role_id=04d0e4575a28440eb4349b4a6565e8b8)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:06.775209 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c5fd5e-43a6-43d7-ba3e-5dc93abb3945 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:06.785133 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 154/312] 10.222.0.25 () {58 vars in 1334 bytes} [Tue Oct 4 03:16:06 2022] PUT /identity/v3/system/users/1108dcf1fc50430e99ca505e83cb1a13/roles/04d0e4575a28440eb4349b4a6565e8b8 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:16:06.785978 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c5fd5e-43a6-43d7-ba3e-5dc93abb3945 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:06.794694 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf30231-2917-4a9a-ba7f-93221ba03609 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:06.847899 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a5f311-6bb7-4270-aea6-821a3c246ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:06.848436 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a5f311-6bb7-4270-aea6-821a3c246ab8 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:06.848716 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a5f311-6bb7-4270-aea6-821a3c246ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:06.850769 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a5f311-6bb7-4270-aea6-821a3c246ab8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:06.852379 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a5f311-6bb7-4270-aea6-821a3c246ab8 None admin] RBAC: Adding query filter params (role.id=8513937b0b5c4d0099cb3732beb89fd4, user.id=260b4941aeb142118ab9ff862799cd8c, scope.system=all) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:06.852984 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a5f311-6bb7-4270-aea6-821a3c246ab8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:06.854476 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a5f311-6bb7-4270-aea6-821a3c246ab8 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:06.865352 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 159/313] 10.222.0.25 () {56 vars in 1308 bytes} [Tue Oct 4 03:16:06 2022] GET /identity/v3/role_assignments?user.id=260b4941aeb142118ab9ff862799cd8c&scope.system=all&role.id=8513937b0b5c4d0099cb3732beb89fd4 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:06.923465 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c5fd5e-43a6-43d7-ba3e-5dc93abb3945 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:06.969226 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce81eac-8d7d-492b-96ea-f336ca90f326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:06.970248 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce81eac-8d7d-492b-96ea-f336ca90f326 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:06.970759 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce81eac-8d7d-492b-96ea-f336ca90f326 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:06.971231 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce81eac-8d7d-492b-96ea-f336ca90f326 None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:06.972283 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce81eac-8d7d-492b-96ea-f336ca90f326 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:06.972813 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce81eac-8d7d-492b-96ea-f336ca90f326 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:06.974465 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce81eac-8d7d-492b-96ea-f336ca90f326 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:06.985169 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 155/314] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Oct 4 03:16:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:06.991431 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a5f311-6bb7-4270-aea6-821a3c246ab8 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:07.109329 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a5f311-6bb7-4270-aea6-821a3c246ab8 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:07.116723 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:07.145562 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48ed7de-5c75-4ae7-bc6c-f1549a77a445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:07.146186 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48ed7de-5c75-4ae7-bc6c-f1549a77a445 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:07.146462 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48ed7de-5c75-4ae7-bc6c-f1549a77a445 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:07.146733 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48ed7de-5c75-4ae7-bc6c-f1549a77a445 None admin] PATH_INFO: `/v3/users/a3d5e94ed1394c2cb81078c407c50694` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:07.147885 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48ed7de-5c75-4ae7-bc6c-f1549a77a445 None admin] RBAC: Authorizing `identity:get_user(user_id=a3d5e94ed1394c2cb81078c407c50694)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:07.149526 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48ed7de-5c75-4ae7-bc6c-f1549a77a445 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:07.151392 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 160/315] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 03:16:06 2022] GET /identity/v3/users/a3d5e94ed1394c2cb81078c407c50694 => generated 297 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:07.156658 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce81eac-8d7d-492b-96ea-f336ca90f326 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:07.218275 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:07.266820 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce81eac-8d7d-492b-96ea-f336ca90f326 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:07.305230 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c6e2a1-21b6-409f-99a8-ba9cbc02a73f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:07.306184 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c6e2a1-21b6-409f-99a8-ba9cbc02a73f None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:07.306702 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c6e2a1-21b6-409f-99a8-ba9cbc02a73f None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:07.307176 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c6e2a1-21b6-409f-99a8-ba9cbc02a73f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:07.383845 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c6e2a1-21b6-409f-99a8-ba9cbc02a73f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:07.385620 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c6e2a1-21b6-409f-99a8-ba9cbc02a73f None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:07.440704 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:07.488985 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 156/316] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 03:16:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 04 03:16:07.494977 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48ed7de-5c75-4ae7-bc6c-f1549a77a445 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:07.600331 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48ed7de-5c75-4ae7-bc6c-f1549a77a445 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:07.635859 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceceb815-dcc0-4f3b-a94c-3eb207d5b227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:07.636406 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceceb815-dcc0-4f3b-a94c-3eb207d5b227 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:07.636685 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceceb815-dcc0-4f3b-a94c-3eb207d5b227 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:07.636955 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceceb815-dcc0-4f3b-a94c-3eb207d5b227 None admin] PATH_INFO: `/v3/projects/dcddf7d31429427a8d46e49ef77bbe82` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:07.638093 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceceb815-dcc0-4f3b-a94c-3eb207d5b227 None admin] RBAC: Authorizing `identity:get_project(project_id=dcddf7d31429427a8d46e49ef77bbe82)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:07.639533 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceceb815-dcc0-4f3b-a94c-3eb207d5b227 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:07.642338 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 161/317] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 03:16:07 2022] GET /identity/v3/projects/dcddf7d31429427a8d46e49ef77bbe82 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:07.647189 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c6e2a1-21b6-409f-99a8-ba9cbc02a73f None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:07.756440 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c6e2a1-21b6-409f-99a8-ba9cbc02a73f None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:07.792173 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d3b8ab-79cd-45d3-a6fc-0926d52998de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:07.792775 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d3b8ab-79cd-45d3-a6fc-0926d52998de None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:07.793058 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d3b8ab-79cd-45d3-a6fc-0926d52998de None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:07.793335 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d3b8ab-79cd-45d3-a6fc-0926d52998de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:07.794055 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d3b8ab-79cd-45d3-a6fc-0926d52998de None admin] RBAC: Adding query filter params (role.id=8513937b0b5c4d0099cb3732beb89fd4, scope.project.id=dcddf7d31429427a8d46e49ef77bbe82, user.id=a3d5e94ed1394c2cb81078c407c50694) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:07.794365 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d3b8ab-79cd-45d3-a6fc-0926d52998de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:07.796074 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d3b8ab-79cd-45d3-a6fc-0926d52998de None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:07.802552 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 157/318] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 03:16:07 2022] GET /identity/v3/role_assignments?user.id=a3d5e94ed1394c2cb81078c407c50694&scope.project.id=dcddf7d31429427a8d46e49ef77bbe82&role.id=8513937b0b5c4d0099cb3732beb89fd4 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:08.419444 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c6195-e31c-4791-a2c2-eb4e4cd86bbb None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:08.420156 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c6195-e31c-4791-a2c2-eb4e4cd86bbb None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:08.420638 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c6195-e31c-4791-a2c2-eb4e4cd86bbb None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:08.422193 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 162/319] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:16:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:16:08.427528 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89465771-b5be-4c7d-994e-135562cf3cad None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:08.427842 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89465771-b5be-4c7d-994e-135562cf3cad None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:08.428122 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89465771-b5be-4c7d-994e-135562cf3cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:08.446846 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-89465771-b5be-4c7d-994e-135562cf3cad None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:16:08.448057 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-89465771-b5be-4c7d-994e-135562cf3cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:16:08.462164 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:08.518773 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 158/320] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:16:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 03:16:08.792838 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774c6195-e31c-4791-a2c2-eb4e4cd86bbb None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:08.839135 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:08.904855 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774c6195-e31c-4791-a2c2-eb4e4cd86bbb None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:08.942491 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb9b572-0e8a-445e-ac97-fcffef894c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:08.943121 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9b572-0e8a-445e-ac97-fcffef894c73 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:08.943402 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9b572-0e8a-445e-ac97-fcffef894c73 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:08.943703 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9b572-0e8a-445e-ac97-fcffef894c73 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:08.944796 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb9b572-0e8a-445e-ac97-fcffef894c73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:08.947033 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb9b572-0e8a-445e-ac97-fcffef894c73 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:08.948777 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 163/321] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:16:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:08.954263 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89465771-b5be-4c7d-994e-135562cf3cad None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:09.009102 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaedc5ec-5056-4cbd-ac24-92f97812bdd6 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:09.009412 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaedc5ec-5056-4cbd-ac24-92f97812bdd6 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:09.009647 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaedc5ec-5056-4cbd-ac24-92f97812bdd6 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:09.011101 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 164/322] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:16:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 03:16:09.015971 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b0b57b-bf7f-41ae-9aa7-b2404d296bc4 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:09.016252 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b0b57b-bf7f-41ae-9aa7-b2404d296bc4 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:09.016528 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b0b57b-bf7f-41ae-9aa7-b2404d296bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:09.035191 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-a6b0b57b-bf7f-41ae-9aa7-b2404d296bc4 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:16:09.036461 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-a6b0b57b-bf7f-41ae-9aa7-b2404d296bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:16:09.063391 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89465771-b5be-4c7d-994e-135562cf3cad None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:09.101282 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d42c1b6-cb96-4c5d-8e43-8ca2b43cae6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:09.102278 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d42c1b6-cb96-4c5d-8e43-8ca2b43cae6f None admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:09.102741 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d42c1b6-cb96-4c5d-8e43-8ca2b43cae6f None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:09.103208 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d42c1b6-cb96-4c5d-8e43-8ca2b43cae6f None admin] PATH_INFO: `/v3/groups` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:09.104088 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d42c1b6-cb96-4c5d-8e43-8ca2b43cae6f None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:09.105902 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d42c1b6-cb96-4c5d-8e43-8ca2b43cae6f None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:09.107246 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 165/323] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:16:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 03:16:09.122837 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 159/324] 10.222.0.25 () {60 vars in 1134 bytes} [Tue Oct 4 03:16:08 2022] POST /identity/v3/groups => generated 226 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:16:09.160927 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bbfef2-0805-45de-9eff-1b9db2e07eeb None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:09.161255 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bbfef2-0805-45de-9eff-1b9db2e07eeb None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:09.161495 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bbfef2-0805-45de-9eff-1b9db2e07eeb None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:09.163036 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 166/325] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:16:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:16:09.169353 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9011073e-3d60-4810-8598-1c099d385734 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:09.169639 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9011073e-3d60-4810-8598-1c099d385734 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:09.169920 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9011073e-3d60-4810-8598-1c099d385734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:09.189550 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-9011073e-3d60-4810-8598-1c099d385734 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:16:09.190788 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-9011073e-3d60-4810-8598-1c099d385734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:16:09.193191 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:09.270523 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 160/326] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:16:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 03:16:09.383173 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bbfef2-0805-45de-9eff-1b9db2e07eeb None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:09.431435 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:09.494182 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bbfef2-0805-45de-9eff-1b9db2e07eeb None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:09.530454 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dbc6e0-7c1b-49f0-a2d2-635932d1c6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:09.531348 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dbc6e0-7c1b-49f0-a2d2-635932d1c6f8 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:09.532058 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dbc6e0-7c1b-49f0-a2d2-635932d1c6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:09.532470 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dbc6e0-7c1b-49f0-a2d2-635932d1c6f8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:09.543784 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dbc6e0-7c1b-49f0-a2d2-635932d1c6f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:16:09.548280 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9011073e-3d60-4810-8598-1c099d385734 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:09.549338 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-93dbc6e0-7c1b-49f0-a2d2-635932d1c6f8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 03:16:09.549338 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:09.549338 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:09.549338 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:09.549338 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:09.549338 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:09.549338 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:09.549338 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:09.549338 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:09.549338 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:09.549338 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:09.549338 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:09.549338 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:16:09.549338 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:16:09.549338 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:16:09.549338 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:16:09.550361 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:16:09.550361 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:16:09.550361 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:16:09.550361 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:16:09.550361 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:09.550361 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:09.550361 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:09.550361 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:09.550361 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:09.550361 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:09.550361 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:09.550361 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:09.550361 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:09.550361 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:09.550361 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:09.550361 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:09.551347 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:09.551347 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:09.551347 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:09.551347 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:09.551347 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:16:09.551347 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:16:09.551347 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:16:09.551347 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:16:09.551347 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:16:09.551347 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:16:09.551347 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 03:16:09.551347 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:16:09.552778 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 167/327] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 03:16:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:09.559413 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dbc6e0-7c1b-49f0-a2d2-635932d1c6f8 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:09.684131 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9011073e-3d60-4810-8598-1c099d385734 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:09.684936 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:09.689164 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dbc6e0-7c1b-49f0-a2d2-635932d1c6f8 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:09.730234 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec397c8-f0fd-4584-adf8-a396c0cb87f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:09.730234 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec397c8-f0fd-4584-adf8-a396c0cb87f8 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:09.730518 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec397c8-f0fd-4584-adf8-a396c0cb87f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:09.730651 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec397c8-f0fd-4584-adf8-a396c0cb87f8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:09.734489 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1689e2d7-0054-4b55-b2c8-92fdbf5dabd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:09.735285 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689e2d7-0054-4b55-b2c8-92fdbf5dabd0 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:09.735743 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689e2d7-0054-4b55-b2c8-92fdbf5dabd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:09.736155 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689e2d7-0054-4b55-b2c8-92fdbf5dabd0 None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:09.736960 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1689e2d7-0054-4b55-b2c8-92fdbf5dabd0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:09.737420 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1689e2d7-0054-4b55-b2c8-92fdbf5dabd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:09.738939 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1689e2d7-0054-4b55-b2c8-92fdbf5dabd0 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:09.745759 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:09.750064 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 168/328] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Oct 4 03:16:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:16:09.755978 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec397c8-f0fd-4584-adf8-a396c0cb87f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:16:09.756401 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1689e2d7-0054-4b55-b2c8-92fdbf5dabd0 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:09.761553 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-cec397c8-f0fd-4584-adf8-a396c0cb87f8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 03:16:09.761553 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:09.761553 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:09.761553 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:09.761553 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:09.761553 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:09.761553 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:09.761553 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:09.761553 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:09.761553 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:09.761553 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:09.761553 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:09.761553 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:16:09.761553 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:16:09.761553 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:16:09.761553 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:16:09.762455 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:16:09.762455 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:16:09.762455 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:16:09.762455 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:16:09.762455 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:09.762455 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:09.762455 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:09.762455 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:09.762455 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:09.762455 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:09.762455 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:09.762455 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:09.762455 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:09.762455 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:09.762455 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:09.762455 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:09.763250 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:09.763250 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:09.763250 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:09.763250 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:09.763250 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:16:09.763250 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:16:09.763250 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:16:09.763250 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:16:09.763250 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:16:09.763250 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:16:09.763250 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 03:16:09.763250 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:16:09.764033 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 161/329] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 03:16:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 03:16:09.772496 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec397c8-f0fd-4584-adf8-a396c0cb87f8 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:09.894389 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1689e2d7-0054-4b55-b2c8-92fdbf5dabd0 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:09.908019 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec397c8-f0fd-4584-adf8-a396c0cb87f8 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:09.940652 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871b27d4-382b-412b-b233-8706e52a10fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:09.941398 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871b27d4-382b-412b-b233-8706e52a10fe None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:09.941760 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871b27d4-382b-412b-b233-8706e52a10fe None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:09.942246 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871b27d4-382b-412b-b233-8706e52a10fe None admin] PATH_INFO: `/v3/users/1108dcf1fc50430e99ca505e83cb1a13` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:09.943949 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871b27d4-382b-412b-b233-8706e52a10fe None admin] RBAC: Authorizing `identity:get_user(user_id=1108dcf1fc50430e99ca505e83cb1a13)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:09.946286 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871b27d4-382b-412b-b233-8706e52a10fe None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:09.949007 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 169/330] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 03:16:09 2022] GET /identity/v3/users/1108dcf1fc50430e99ca505e83cb1a13 => generated 293 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:16:09.951578 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcc822c-8294-494f-8888-fc11c75f20a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:09.952190 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcc822c-8294-494f-8888-fc11c75f20a6 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:09.952473 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcc822c-8294-494f-8888-fc11c75f20a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:09.952749 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcc822c-8294-494f-8888-fc11c75f20a6 None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:09.953424 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcc822c-8294-494f-8888-fc11c75f20a6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:09.953734 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcc822c-8294-494f-8888-fc11c75f20a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:09.955105 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcc822c-8294-494f-8888-fc11c75f20a6 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:09.957071 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871b27d4-382b-412b-b233-8706e52a10fe None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:09.968097 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 162/331] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Oct 4 03:16:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:09.977667 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcc822c-8294-494f-8888-fc11c75f20a6 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:10.002747 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:10.057775 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:10.110382 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871b27d4-382b-412b-b233-8706e52a10fe None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:10.114940 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcc822c-8294-494f-8888-fc11c75f20a6 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:10.166396 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caebaef-1c4f-4c93-a6d3-7bfc0981aef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:10.166950 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caebaef-1c4f-4c93-a6d3-7bfc0981aef8 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:10.167227 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caebaef-1c4f-4c93-a6d3-7bfc0981aef8 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:10.167513 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caebaef-1c4f-4c93-a6d3-7bfc0981aef8 None admin] PATH_INFO: `/v3/users/260b4941aeb142118ab9ff862799cd8c` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:10.169412 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caebaef-1c4f-4c93-a6d3-7bfc0981aef8 None admin] RBAC: Authorizing `identity:get_user(user_id=260b4941aeb142118ab9ff862799cd8c)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:10.170850 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caebaef-1c4f-4c93-a6d3-7bfc0981aef8 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:10.176684 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc350dd-28ea-4d0c-8b3c-a4d7b4ac2874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:10.177292 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc350dd-28ea-4d0c-8b3c-a4d7b4ac2874 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:10.177575 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc350dd-28ea-4d0c-8b3c-a4d7b4ac2874 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:10.177845 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc350dd-28ea-4d0c-8b3c-a4d7b4ac2874 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:10.178568 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc350dd-28ea-4d0c-8b3c-a4d7b4ac2874 None admin] RBAC: Adding query filter params (role.id=04d0e4575a28440eb4349b4a6565e8b8, user.id=1108dcf1fc50430e99ca505e83cb1a13, scope.system=all) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:10.178872 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc350dd-28ea-4d0c-8b3c-a4d7b4ac2874 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:10.180546 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc350dd-28ea-4d0c-8b3c-a4d7b4ac2874 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:10.182740 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 163/332] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 03:16:09 2022] GET /identity/v3/users/260b4941aeb142118ab9ff862799cd8c => generated 293 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:10.188476 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caebaef-1c4f-4c93-a6d3-7bfc0981aef8 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:10.210230 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 170/333] 10.222.0.25 () {56 vars in 1308 bytes} [Tue Oct 4 03:16:09 2022] GET /identity/v3/role_assignments?user.id=1108dcf1fc50430e99ca505e83cb1a13&scope.system=all&role.id=04d0e4575a28440eb4349b4a6565e8b8 => generated 510 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:10.312275 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caebaef-1c4f-4c93-a6d3-7bfc0981aef8 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:10.343098 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:10.357283 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b150b0a0-c5c0-4794-9272-9c8b293ccd3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:10.357949 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b150b0a0-c5c0-4794-9272-9c8b293ccd3d None admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:10.358228 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b150b0a0-c5c0-4794-9272-9c8b293ccd3d None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:10.358501 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b150b0a0-c5c0-4794-9272-9c8b293ccd3d None admin] PATH_INFO: `/v3/system/users/260b4941aeb142118ab9ff862799cd8c/roles/8513937b0b5c4d0099cb3732beb89fd4` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:10.359957 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b150b0a0-c5c0-4794-9272-9c8b293ccd3d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=260b4941aeb142118ab9ff862799cd8c, role_id=8513937b0b5c4d0099cb3732beb89fd4)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:10.361326 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b150b0a0-c5c0-4794-9272-9c8b293ccd3d None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:10.376918 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 164/334] 10.222.0.25 () {58 vars in 1334 bytes} [Tue Oct 4 03:16:10 2022] PUT /identity/v3/system/users/260b4941aeb142118ab9ff862799cd8c/roles/8513937b0b5c4d0099cb3732beb89fd4 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 03:16:12.354714 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f524e-980b-4fa2-93c3-d6046102dc37 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:12.355232 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f524e-980b-4fa2-93c3-d6046102dc37 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:12.355339 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f524e-980b-4fa2-93c3-d6046102dc37 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:12.356675 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 171/335] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:16:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:16:12.374561 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa066a-ca5d-446a-9125-4d68bf4763e6 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:12.375036 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa066a-ca5d-446a-9125-4d68bf4763e6 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:12.375107 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa066a-ca5d-446a-9125-4d68bf4763e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:12.400034 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-1afa066a-ca5d-446a-9125-4d68bf4763e6 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:16:12.401309 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-1afa066a-ca5d-446a-9125-4d68bf4763e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:16:12.490338 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 165/336] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:16:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 03:16:12.964388 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7da18-f6dc-4333-9eb6-85c4196591f8 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:12.965060 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7da18-f6dc-4333-9eb6-85c4196591f8 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:12.965562 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7da18-f6dc-4333-9eb6-85c4196591f8 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:12.967108 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 172/337] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:16:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:16:12.973170 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0216d47c-588d-41b0-97d3-51ddc046f0ba None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:12.973804 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0216d47c-588d-41b0-97d3-51ddc046f0ba None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:12.974295 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0216d47c-588d-41b0-97d3-51ddc046f0ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:13.001586 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-0216d47c-588d-41b0-97d3-51ddc046f0ba None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:16:13.003191 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-0216d47c-588d-41b0-97d3-51ddc046f0ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:16:13.020495 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a7da18-f6dc-4333-9eb6-85c4196591f8 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:13.107312 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 166/338] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:16:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 03:16:13.183467 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:13.192916 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aaa9b6-374f-4426-9f7c-217aff5c4e2c None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:13.193212 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aaa9b6-374f-4426-9f7c-217aff5c4e2c None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:13.193493 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aaa9b6-374f-4426-9f7c-217aff5c4e2c None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:13.196167 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 167/339] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:16:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:16:13.205070 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a7da18-f6dc-4333-9eb6-85c4196591f8 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:13.210816 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabaa012-2dfc-421c-9b12-0ac10e715967 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:13.211103 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabaa012-2dfc-421c-9b12-0ac10e715967 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:13.211383 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabaa012-2dfc-421c-9b12-0ac10e715967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:13.255188 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-fabaa012-2dfc-421c-9b12-0ac10e715967 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:16:13.258736 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-fabaa012-2dfc-421c-9b12-0ac10e715967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:16:13.276271 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa5f8d0-efe8-4ad0-8150-f39687d81575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:13.277250 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa5f8d0-efe8-4ad0-8150-f39687d81575 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:13.277721 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa5f8d0-efe8-4ad0-8150-f39687d81575 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:13.278223 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa5f8d0-efe8-4ad0-8150-f39687d81575 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:13.297890 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa5f8d0-efe8-4ad0-8150-f39687d81575 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:16:13.303021 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-8aa5f8d0-efe8-4ad0-8150-f39687d81575 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 03:16:13.303021 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:13.303021 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:13.303021 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:13.303021 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:13.303021 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:13.303021 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:13.303021 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:13.303021 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:13.303021 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:13.303021 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:13.303021 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:13.303021 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:16:13.303021 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:16:13.303021 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:16:13.303021 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:16:13.303906 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:16:13.303906 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:16:13.303906 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:16:13.303906 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:16:13.303906 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:13.303906 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:13.303906 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:13.303906 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:13.303906 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:13.303906 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:13.303906 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:13.303906 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:13.303906 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:13.303906 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:13.303906 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:13.303906 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:13.305400 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:13.305400 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:13.305400 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:13.305400 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:13.305400 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:16:13.305400 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:16:13.305400 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:16:13.305400 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:16:13.305400 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:16:13.305400 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:16:13.305400 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 03:16:13.305400 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:16:13.311998 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 173/340] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 03:16:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:13.313494 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e7cd0f-5ccd-411e-a2bc-9425e6f0faa0 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:13.313970 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e7cd0f-5ccd-411e-a2bc-9425e6f0faa0 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:13.314443 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e7cd0f-5ccd-411e-a2bc-9425e6f0faa0 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:13.315987 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 174/341] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:16:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:16:13.322505 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e7cd0f-5ccd-411e-a2bc-9425e6f0faa0 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:13.326948 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:13.355262 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 168/342] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:16:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 03:16:13.357114 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefc572f-d5c9-44c7-9603-1648be4b3671 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:13.357476 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefc572f-d5c9-44c7-9603-1648be4b3671 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:13.357828 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefc572f-d5c9-44c7-9603-1648be4b3671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:13.384909 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-cefc572f-d5c9-44c7-9603-1648be4b3671 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:16:13.386828 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-cefc572f-d5c9-44c7-9603-1648be4b3671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:16:13.504273 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 169/343] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:16:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 03:16:13.505837 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefc572f-d5c9-44c7-9603-1648be4b3671 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:13.533346 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e7cd0f-5ccd-411e-a2bc-9425e6f0faa0 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:13.605598 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab632d4-20bf-4c88-9f30-ca434ca83722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:13.606484 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab632d4-20bf-4c88-9f30-ca434ca83722 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:13.606911 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab632d4-20bf-4c88-9f30-ca434ca83722 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:13.607341 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab632d4-20bf-4c88-9f30-ca434ca83722 None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:13.608171 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab632d4-20bf-4c88-9f30-ca434ca83722 None admin] RBAC: Adding query filter params (name=member) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:13.608614 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab632d4-20bf-4c88-9f30-ca434ca83722 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:13.610121 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab632d4-20bf-4c88-9f30-ca434ca83722 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:13.627028 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 175/344] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Oct 4 03:16:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:16:13.634173 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab632d4-20bf-4c88-9f30-ca434ca83722 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:13.667376 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:13.684674 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefc572f-d5c9-44c7-9603-1648be4b3671 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:13.714366 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:13.756351 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be53047-5d50-4161-b138-1a610b9c09e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:13.756952 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be53047-5d50-4161-b138-1a610b9c09e4 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:13.757293 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be53047-5d50-4161-b138-1a610b9c09e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:13.757627 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be53047-5d50-4161-b138-1a610b9c09e4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:13.769953 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be53047-5d50-4161-b138-1a610b9c09e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:16:13.775749 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-2be53047-5d50-4161-b138-1a610b9c09e4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 03:16:13.775749 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:13.775749 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:13.775749 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:13.775749 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:13.775749 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:13.775749 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:13.775749 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:13.775749 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:13.775749 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:13.775749 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:13.775749 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:13.775749 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:16:13.775749 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:16:13.775749 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:16:13.775749 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:16:13.776643 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:16:13.776643 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:16:13.776643 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:16:13.776643 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:16:13.776643 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:13.776643 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:13.776643 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:13.776643 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:13.776643 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:13.776643 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:13.776643 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:13.776643 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:13.776643 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:13.776643 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:13.776643 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:13.776643 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:13.777427 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:13.777427 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:13.777427 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:13.777427 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:13.777427 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:16:13.777427 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:16:13.777427 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:16:13.777427 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:16:13.777427 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:16:13.777427 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:16:13.777427 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 03:16:13.777427 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:16:13.779896 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 170/345] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Oct 4 03:16:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:13.781471 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3c155-e3a3-4106-888e-cef3c0e27c86 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:13.782002 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3c155-e3a3-4106-888e-cef3c0e27c86 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:13.782525 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3c155-e3a3-4106-888e-cef3c0e27c86 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:13.788244 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 171/346] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:16:13 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:16:13.789830 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a3c155-e3a3-4106-888e-cef3c0e27c86 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:13.855882 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab632d4-20bf-4c88-9f30-ca434ca83722 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:13.905647 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856c39f6-10b1-4056-b9c1-1dfc5ff34365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:13.906872 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856c39f6-10b1-4056-b9c1-1dfc5ff34365 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:13.907380 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856c39f6-10b1-4056-b9c1-1dfc5ff34365 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:13.907884 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856c39f6-10b1-4056-b9c1-1dfc5ff34365 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:13.938614 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a3c155-e3a3-4106-888e-cef3c0e27c86 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:13.985106 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ee0700-5095-4b08-afc8-73d128f8d507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:13.985793 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ee0700-5095-4b08-afc8-73d128f8d507 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:13.986261 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ee0700-5095-4b08-afc8-73d128f8d507 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:13.986539 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ee0700-5095-4b08-afc8-73d128f8d507 None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:13.987879 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ee0700-5095-4b08-afc8-73d128f8d507 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:13.988209 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ee0700-5095-4b08-afc8-73d128f8d507 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:13.990009 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ee0700-5095-4b08-afc8-73d128f8d507 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:13.993952 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856c39f6-10b1-4056-b9c1-1dfc5ff34365 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:13.995469 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856c39f6-10b1-4056-b9c1-1dfc5ff34365 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:14.000715 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 172/347] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 03:16:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:14.002333 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9eb58c-6017-4d2e-9743-c84448ebca25 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:14.002816 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9eb58c-6017-4d2e-9743-c84448ebca25 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:14.003319 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9eb58c-6017-4d2e-9743-c84448ebca25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:14.014318 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:14.026735 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-fe9eb58c-6017-4d2e-9743-c84448ebca25 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:16:14.028244 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-fe9eb58c-6017-4d2e-9743-c84448ebca25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:16:14.062673 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:14.119731 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 173/348] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:16:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 03:16:14.120595 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9eb58c-6017-4d2e-9743-c84448ebca25 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:14.135956 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 176/349] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 03:16:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 03:16:14.137124 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856c39f6-10b1-4056-b9c1-1dfc5ff34365 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:14.253169 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9eb58c-6017-4d2e-9743-c84448ebca25 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:14.273795 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856c39f6-10b1-4056-b9c1-1dfc5ff34365 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:14.286028 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:14.295842 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5f81ab-801a-41ed-8e31-3786ddc72d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:14.296808 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f81ab-801a-41ed-8e31-3786ddc72d1b None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:14.297091 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f81ab-801a-41ed-8e31-3786ddc72d1b None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:14.297367 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f81ab-801a-41ed-8e31-3786ddc72d1b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:14.310971 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5f81ab-801a-41ed-8e31-3786ddc72d1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:16:14.311418 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362214e0-a4cc-4bb8-aa01-b096f6e86a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:14.312062 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362214e0-a4cc-4bb8-aa01-b096f6e86a95 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:14.312338 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362214e0-a4cc-4bb8-aa01-b096f6e86a95 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:14.312603 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362214e0-a4cc-4bb8-aa01-b096f6e86a95 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:14.316045 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-ed5f81ab-801a-41ed-8e31-3786ddc72d1b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 03:16:14.316045 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:14.316045 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:14.316045 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:14.316045 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:14.316045 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:14.316045 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:14.316045 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:14.316045 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:14.316045 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:14.316045 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:14.316045 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:14.316045 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:16:14.316045 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:16:14.316045 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:16:14.316045 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:16:14.316927 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:16:14.316927 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:16:14.316927 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:16:14.316927 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:16:14.316927 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:14.316927 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:14.316927 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:14.316927 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:14.316927 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:14.316927 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:14.316927 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:14.316927 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:14.316927 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:14.316927 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:14.316927 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:14.316927 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:14.320844 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:14.320844 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:14.320844 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:14.320844 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:14.320844 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:16:14.320844 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:16:14.320844 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:16:14.320844 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:16:14.320844 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:16:14.320844 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:16:14.320844 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 03:16:14.320844 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:16:14.320844 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 174/350] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 03:16:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:14.320844 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5f81ab-801a-41ed-8e31-3786ddc72d1b None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:14.328992 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362214e0-a4cc-4bb8-aa01-b096f6e86a95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:16:14.333470 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-362214e0-a4cc-4bb8-aa01-b096f6e86a95 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 03:16:14.333470 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:14.333470 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:14.333470 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:14.333470 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:14.333470 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:14.333470 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:14.333470 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:14.333470 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:14.333470 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:14.333470 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:14.333470 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:14.333470 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:16:14.333470 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:16:14.333470 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:16:14.333470 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:16:14.334362 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:16:14.334362 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:16:14.334362 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:16:14.334362 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:16:14.334362 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:14.334362 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:14.334362 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:14.334362 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:14.334362 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:14.334362 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:14.334362 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:14.334362 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:14.334362 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:14.334362 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:14.334362 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:14.334362 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:14.335141 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:14.335141 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:14.335141 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:14.335141 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:14.335141 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:16:14.335141 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:16:14.335141 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:16:14.335141 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:16:14.335141 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:16:14.335141 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:16:14.335141 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 03:16:14.335141 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:16:14.335141 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 177/351] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 03:16:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:14.337113 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6bbfd0-3541-43d0-981b-325ab6999275 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:14.337402 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6bbfd0-3541-43d0-981b-325ab6999275 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:14.337682 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6bbfd0-3541-43d0-981b-325ab6999275 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:14.339827 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 178/352] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:16:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:16:14.340828 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6bbfd0-3541-43d0-981b-325ab6999275 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:14.359348 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:14.459724 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6bbfd0-3541-43d0-981b-325ab6999275 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:14.460757 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5f81ab-801a-41ed-8e31-3786ddc72d1b None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:14.501716 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e948745c-79c3-4b21-8ed0-407f06fb8ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:14.502636 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c5688a-5fe3-4fe6-bed5-c8ffb0fb11f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:14.502783 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e948745c-79c3-4b21-8ed0-407f06fb8ee0 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:14.502783 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e948745c-79c3-4b21-8ed0-407f06fb8ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:14.502914 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5688a-5fe3-4fe6-bed5-c8ffb0fb11f5 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:14.502979 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e948745c-79c3-4b21-8ed0-407f06fb8ee0 None admin] PATH_INFO: `/v3/projects/a7dc4038bbe8418c9837b329ac4d2754` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:14.503043 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5688a-5fe3-4fe6-bed5-c8ffb0fb11f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:14.507464 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5688a-5fe3-4fe6-bed5-c8ffb0fb11f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:14.507670 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e948745c-79c3-4b21-8ed0-407f06fb8ee0 None admin] RBAC: Authorizing `identity:get_project(project_id=a7dc4038bbe8418c9837b329ac4d2754)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:14.507670 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e948745c-79c3-4b21-8ed0-407f06fb8ee0 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:14.507670 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 179/353] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 03:16:14 2022] GET /identity/v3/projects/a7dc4038bbe8418c9837b329ac4d2754 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:14.508210 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e948745c-79c3-4b21-8ed0-407f06fb8ee0 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:14.555196 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:14.598287 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c5688a-5fe3-4fe6-bed5-c8ffb0fb11f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:14.600132 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c5688a-5fe3-4fe6-bed5-c8ffb0fb11f5 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:14.622952 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e948745c-79c3-4b21-8ed0-407f06fb8ee0 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:14.637863 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:14.671562 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce6664a-5bd6-45e5-aa60-3a6679f41275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:14.672117 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6664a-5bd6-45e5-aa60-3a6679f41275 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:14.672394 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6664a-5bd6-45e5-aa60-3a6679f41275 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:14.672660 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6664a-5bd6-45e5-aa60-3a6679f41275 None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:14.673324 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce6664a-5bd6-45e5-aa60-3a6679f41275 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:14.673623 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce6664a-5bd6-45e5-aa60-3a6679f41275 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:14.675052 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce6664a-5bd6-45e5-aa60-3a6679f41275 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:14.684351 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 180/354] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Oct 4 03:16:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:14.684997 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce6664a-5bd6-45e5-aa60-3a6679f41275 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:14.732891 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 175/355] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 03:16:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 03:16:14.734370 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a205f7-4156-4abe-92dd-8721e128bc96 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:14.734825 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a205f7-4156-4abe-92dd-8721e128bc96 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:14.735232 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a205f7-4156-4abe-92dd-8721e128bc96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:14.757644 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-25a205f7-4156-4abe-92dd-8721e128bc96 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:16:14.758934 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-25a205f7-4156-4abe-92dd-8721e128bc96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:16:14.809009 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:14.813162 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce6664a-5bd6-45e5-aa60-3a6679f41275 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:14.848089 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 176/356] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:16:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 03:16:14.848939 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a205f7-4156-4abe-92dd-8721e128bc96 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:14.858628 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b6973a-3eed-41b6-88b6-b5fcc47e77c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:14.859263 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b6973a-3eed-41b6-88b6-b5fcc47e77c1 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:14.859610 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b6973a-3eed-41b6-88b6-b5fcc47e77c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:14.859995 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b6973a-3eed-41b6-88b6-b5fcc47e77c1 None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:14.860823 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b6973a-3eed-41b6-88b6-b5fcc47e77c1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:14.861126 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b6973a-3eed-41b6-88b6-b5fcc47e77c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:14.862514 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b6973a-3eed-41b6-88b6-b5fcc47e77c1 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:14.876501 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 181/357] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Oct 4 03:16:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:14.877396 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b6973a-3eed-41b6-88b6-b5fcc47e77c1 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:14.914650 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:14.981507 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a205f7-4156-4abe-92dd-8721e128bc96 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:14.995327 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b6973a-3eed-41b6-88b6-b5fcc47e77c1 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:15.023246 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11707c97-de36-4768-a314-e62a69620872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:15.023942 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11707c97-de36-4768-a314-e62a69620872 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:15.024221 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11707c97-de36-4768-a314-e62a69620872 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:15.024488 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11707c97-de36-4768-a314-e62a69620872 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:15.032443 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac5f6f-b63d-487c-99cb-628862718ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:15.033072 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac5f6f-b63d-487c-99cb-628862718ebe None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:15.033353 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac5f6f-b63d-487c-99cb-628862718ebe None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:15.034555 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac5f6f-b63d-487c-99cb-628862718ebe None admin] PATH_INFO: `/v3/groups/71f5ef5217c5400ca03ddd5e37fdc5f1` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:15.038522 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11707c97-de36-4768-a314-e62a69620872 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:16:15.042428 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ac5f6f-b63d-487c-99cb-628862718ebe None admin] RBAC: Authorizing `identity:get_group(group_id=71f5ef5217c5400ca03ddd5e37fdc5f1)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:15.043843 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-11707c97-de36-4768-a314-e62a69620872 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 03:16:15.043843 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:15.043843 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:15.043843 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:15.043843 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:15.043843 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:15.043843 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:15.043843 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:15.043843 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:15.043843 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:15.043843 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:15.043843 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:15.043843 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:16:15.043843 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:16:15.043843 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:16:15.043843 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:16:15.044695 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:16:15.044695 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:16:15.044695 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:16:15.044695 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:16:15.044695 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:15.044695 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:15.044695 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:15.044695 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:15.044695 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:15.044695 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:15.044695 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:15.044695 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:15.044695 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:15.044695 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:15.044695 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:15.044695 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:15.045561 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:15.045561 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:15.045561 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:15.045561 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:15.045561 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:16:15.045561 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:16:15.045561 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:16:15.045561 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:16:15.045561 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:16:15.045561 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:16:15.045561 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 03:16:15.045561 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:16:15.046170 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ac5f6f-b63d-487c-99cb-628862718ebe None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:15.046237 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 177/358] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Oct 4 03:16:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:15.046307 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 182/359] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Oct 4 03:16:14 2022] GET /identity/v3/groups/71f5ef5217c5400ca03ddd5e37fdc5f1 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:15.046372 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11707c97-de36-4768-a314-e62a69620872 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:15.046435 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac5f6f-b63d-487c-99cb-628862718ebe None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:15.081220 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:15.178135 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac5f6f-b63d-487c-99cb-628862718ebe None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:15.183402 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11707c97-de36-4768-a314-e62a69620872 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:15.199378 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:15.221808 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfc0c2a-de99-40a5-8d90-f9442fcd7e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:15.222434 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc0c2a-de99-40a5-8d90-f9442fcd7e5c None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:15.222712 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc0c2a-de99-40a5-8d90-f9442fcd7e5c None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:15.222980 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc0c2a-de99-40a5-8d90-f9442fcd7e5c None admin] PATH_INFO: `/v3/projects/a7dc4038bbe8418c9837b329ac4d2754` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:15.224235 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfc0c2a-de99-40a5-8d90-f9442fcd7e5c None admin] RBAC: Authorizing `identity:get_project(project_id=a7dc4038bbe8418c9837b329ac4d2754)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:15.225178 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4516c4-fafd-42f3-986c-a0ae48688719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:15.225664 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfc0c2a-de99-40a5-8d90-f9442fcd7e5c None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:15.225836 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4516c4-fafd-42f3-986c-a0ae48688719 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:15.226311 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4516c4-fafd-42f3-986c-a0ae48688719 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:15.226788 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4516c4-fafd-42f3-986c-a0ae48688719 None admin] PATH_INFO: `/v3/users/260b4941aeb142118ab9ff862799cd8c` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:15.231144 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 183/360] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 03:16:15 2022] GET /identity/v3/projects/a7dc4038bbe8418c9837b329ac4d2754 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:15.231279 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4516c4-fafd-42f3-986c-a0ae48688719 None admin] RBAC: Authorizing `identity:get_user(user_id=260b4941aeb142118ab9ff862799cd8c)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:15.231353 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfc0c2a-de99-40a5-8d90-f9442fcd7e5c None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:15.231440 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4516c4-fafd-42f3-986c-a0ae48688719 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:15.231440 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 178/361] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 03:16:15 2022] GET /identity/v3/users/260b4941aeb142118ab9ff862799cd8c => generated 293 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:15.231801 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4516c4-fafd-42f3-986c-a0ae48688719 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:15.351558 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:15.360071 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4516c4-fafd-42f3-986c-a0ae48688719 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:15.360237 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfc0c2a-de99-40a5-8d90-f9442fcd7e5c None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:15.398969 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f0fd93-17b0-488d-9902-4146b7dcf192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:15.399703 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f0fd93-17b0-488d-9902-4146b7dcf192 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:15.399985 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f0fd93-17b0-488d-9902-4146b7dcf192 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:15.400317 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f0fd93-17b0-488d-9902-4146b7dcf192 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:15.405665 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dd2a8d-746e-48b0-8bbf-28ccd3de01ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:15.406275 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd2a8d-746e-48b0-8bbf-28ccd3de01ef None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:15.406558 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd2a8d-746e-48b0-8bbf-28ccd3de01ef None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:15.406830 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd2a8d-746e-48b0-8bbf-28ccd3de01ef None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:15.407530 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dd2a8d-746e-48b0-8bbf-28ccd3de01ef None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:15.407844 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dd2a8d-746e-48b0-8bbf-28ccd3de01ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:15.409212 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dd2a8d-746e-48b0-8bbf-28ccd3de01ef None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:15.419252 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 179/362] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 03:16:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:15.420123 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dd2a8d-746e-48b0-8bbf-28ccd3de01ef None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:15.471301 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:15.484159 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f0fd93-17b0-488d-9902-4146b7dcf192 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:15.485629 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f0fd93-17b0-488d-9902-4146b7dcf192 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:15.533129 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dd2a8d-746e-48b0-8bbf-28ccd3de01ef None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:15.565345 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579a9dba-fd18-4727-96fb-1115cbf4cbc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:15.565944 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a9dba-fd18-4727-96fb-1115cbf4cbc2 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:15.566230 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a9dba-fd18-4727-96fb-1115cbf4cbc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:15.566503 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a9dba-fd18-4727-96fb-1115cbf4cbc2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:15.567215 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579a9dba-fd18-4727-96fb-1115cbf4cbc2 None admin] RBAC: Adding query filter params (group.id=71f5ef5217c5400ca03ddd5e37fdc5f1, role.id=04d0e4575a28440eb4349b4a6565e8b8, scope.project.id=a7dc4038bbe8418c9837b329ac4d2754) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:15.567559 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579a9dba-fd18-4727-96fb-1115cbf4cbc2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:15.568994 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579a9dba-fd18-4727-96fb-1115cbf4cbc2 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:15.575217 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 180/363] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Oct 4 03:16:15 2022] GET /identity/v3/role_assignments?group.id=71f5ef5217c5400ca03ddd5e37fdc5f1&scope.project.id=a7dc4038bbe8418c9837b329ac4d2754&role.id=04d0e4575a28440eb4349b4a6565e8b8 => generated 260 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:15.575829 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579a9dba-fd18-4727-96fb-1115cbf4cbc2 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:15.587840 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:15.610362 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 184/364] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 03:16:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 03:16:15.610362 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f0fd93-17b0-488d-9902-4146b7dcf192 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:15.698757 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579a9dba-fd18-4727-96fb-1115cbf4cbc2 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:15.714103 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:15.729463 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f0fd93-17b0-488d-9902-4146b7dcf192 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:15.743842 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da66155c-4f54-4f4d-9d31-55bb169b7eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:15.744592 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da66155c-4f54-4f4d-9d31-55bb169b7eea None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:15.744875 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da66155c-4f54-4f4d-9d31-55bb169b7eea None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:15.745274 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da66155c-4f54-4f4d-9d31-55bb169b7eea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:15.759545 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da66155c-4f54-4f4d-9d31-55bb169b7eea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:16:15.764079 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-da66155c-4f54-4f4d-9d31-55bb169b7eea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 03:16:15.764079 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:15.764079 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:15.764079 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:15.764079 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:15.764079 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:15.764079 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:15.764079 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:15.764079 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:15.764079 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:15.764079 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:15.764079 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:15.764079 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:16:15.764079 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:16:15.764079 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:16:15.764079 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:16:15.765020 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:16:15.765020 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:16:15.765020 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:16:15.765020 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:16:15.765020 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:15.765020 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:15.765020 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:15.765020 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:15.765020 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:15.765020 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:15.765020 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:15.765020 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:15.765020 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:15.765020 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:15.765020 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:15.765020 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:15.765846 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:15.765846 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:15.765846 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:15.765846 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:15.765846 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:16:15.765846 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:16:15.765846 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:16:15.765846 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:16:15.765846 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:16:15.765846 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:16:15.765846 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 03:16:15.765846 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:16:15.765846 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 181/365] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 4 03:16:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:15.766541 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da66155c-4f54-4f4d-9d31-55bb169b7eea None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:15.776171 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abb866c-ca3b-41f4-91bf-c80289576d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:15.777166 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abb866c-ca3b-41f4-91bf-c80289576d5f None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:15.778193 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abb866c-ca3b-41f4-91bf-c80289576d5f None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:15.778680 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abb866c-ca3b-41f4-91bf-c80289576d5f None admin] PATH_INFO: `/v3/groups/71f5ef5217c5400ca03ddd5e37fdc5f1` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:15.780762 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abb866c-ca3b-41f4-91bf-c80289576d5f None admin] RBAC: Authorizing `identity:get_group(group_id=71f5ef5217c5400ca03ddd5e37fdc5f1)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:15.782447 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abb866c-ca3b-41f4-91bf-c80289576d5f None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:15.789146 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 185/366] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Oct 4 03:16:15 2022] GET /identity/v3/groups/71f5ef5217c5400ca03ddd5e37fdc5f1 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:15.789146 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abb866c-ca3b-41f4-91bf-c80289576d5f None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:15.852928 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:15.878394 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da66155c-4f54-4f4d-9d31-55bb169b7eea None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:15.895157 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abb866c-ca3b-41f4-91bf-c80289576d5f None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:15.915556 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ccf650-85ee-4d4d-97dd-6e42acd613dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:15.916613 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ccf650-85ee-4d4d-97dd-6e42acd613dc None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:15.916613 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ccf650-85ee-4d4d-97dd-6e42acd613dc None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:15.916876 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ccf650-85ee-4d4d-97dd-6e42acd613dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:15.917566 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ccf650-85ee-4d4d-97dd-6e42acd613dc None admin] RBAC: Adding query filter params (role.id=8513937b0b5c4d0099cb3732beb89fd4, user.id=260b4941aeb142118ab9ff862799cd8c, scope.system=all) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:15.917865 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ccf650-85ee-4d4d-97dd-6e42acd613dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:15.919424 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ccf650-85ee-4d4d-97dd-6e42acd613dc None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:15.930011 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0720ce2a-f80c-4823-994f-513d5b178fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:15.930685 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720ce2a-f80c-4823-994f-513d5b178fee None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:15.930978 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720ce2a-f80c-4823-994f-513d5b178fee None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:15.931253 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720ce2a-f80c-4823-994f-513d5b178fee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:15.939762 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 182/367] 10.222.0.25 () {56 vars in 1308 bytes} [Tue Oct 4 03:16:15 2022] GET /identity/v3/role_assignments?user.id=260b4941aeb142118ab9ff862799cd8c&scope.system=all&role.id=8513937b0b5c4d0099cb3732beb89fd4 => generated 510 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:15.939762 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ccf650-85ee-4d4d-97dd-6e42acd613dc None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:15.971957 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:16.025702 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0720ce2a-f80c-4823-994f-513d5b178fee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:16.028051 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0720ce2a-f80c-4823-994f-513d5b178fee None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:16.075464 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ccf650-85ee-4d4d-97dd-6e42acd613dc None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:16.106640 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:16.125075 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6904bad7-31ac-4aa5-990e-ab511c7744da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:16.125869 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6904bad7-31ac-4aa5-990e-ab511c7744da None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:16.126251 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6904bad7-31ac-4aa5-990e-ab511c7744da None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:16.126628 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6904bad7-31ac-4aa5-990e-ab511c7744da None admin] PATH_INFO: `/v3/projects/dcddf7d31429427a8d46e49ef77bbe82` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:16.128956 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6904bad7-31ac-4aa5-990e-ab511c7744da None admin] RBAC: Authorizing `identity:get_project(project_id=dcddf7d31429427a8d46e49ef77bbe82)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:16.130288 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6904bad7-31ac-4aa5-990e-ab511c7744da None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:16.132883 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 183/368] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 03:16:15 2022] GET /identity/v3/projects/dcddf7d31429427a8d46e49ef77bbe82 => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:16.133832 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6904bad7-31ac-4aa5-990e-ab511c7744da None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:16.170100 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 186/369] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 03:16:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 03:16:16.171597 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0720ce2a-f80c-4823-994f-513d5b178fee None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:16.252544 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:16.262874 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6904bad7-31ac-4aa5-990e-ab511c7744da None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:16.296832 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0720ce2a-f80c-4823-994f-513d5b178fee None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:16.303069 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118d2248-e26a-47c6-8c25-52afdf61146e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:16.308447 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118d2248-e26a-47c6-8c25-52afdf61146e None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:16.308447 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118d2248-e26a-47c6-8c25-52afdf61146e None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:16.308447 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118d2248-e26a-47c6-8c25-52afdf61146e None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:16.308447 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118d2248-e26a-47c6-8c25-52afdf61146e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:16.308447 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118d2248-e26a-47c6-8c25-52afdf61146e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:16.308447 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118d2248-e26a-47c6-8c25-52afdf61146e None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:16.318704 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 184/370] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 03:16:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:16.320370 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118d2248-e26a-47c6-8c25-52afdf61146e None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:16.341353 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d422ca3a-66f8-4a90-a0df-4e3fb74c52e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:16.342101 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422ca3a-66f8-4a90-a0df-4e3fb74c52e3 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:16.342485 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422ca3a-66f8-4a90-a0df-4e3fb74c52e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:16.342861 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422ca3a-66f8-4a90-a0df-4e3fb74c52e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:16.345738 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d422ca3a-66f8-4a90-a0df-4e3fb74c52e3 None admin] RBAC: Adding query filter params (group.id=71f5ef5217c5400ca03ddd5e37fdc5f1, role.id=f2332a9a00b74fe0846d7211dd3850cb, scope.project.id=a7dc4038bbe8418c9837b329ac4d2754) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:16.345738 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d422ca3a-66f8-4a90-a0df-4e3fb74c52e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:16.345738 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d422ca3a-66f8-4a90-a0df-4e3fb74c52e3 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:16.354585 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 187/371] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Oct 4 03:16:16 2022] GET /identity/v3/role_assignments?group.id=71f5ef5217c5400ca03ddd5e37fdc5f1&scope.project.id=a7dc4038bbe8418c9837b329ac4d2754&role.id=f2332a9a00b74fe0846d7211dd3850cb => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:16.355429 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d422ca3a-66f8-4a90-a0df-4e3fb74c52e3 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:16.400933 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:16.469595 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118d2248-e26a-47c6-8c25-52afdf61146e None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:16.516222 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d422ca3a-66f8-4a90-a0df-4e3fb74c52e3 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:16.521007 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb861f43-0083-4c1d-b071-774e9c933d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:16.521813 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb861f43-0083-4c1d-b071-774e9c933d02 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:16.522217 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb861f43-0083-4c1d-b071-774e9c933d02 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:16.522583 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb861f43-0083-4c1d-b071-774e9c933d02 None admin] PATH_INFO: `/v3/groups/71f5ef5217c5400ca03ddd5e37fdc5f1` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:16.524682 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb861f43-0083-4c1d-b071-774e9c933d02 None admin] RBAC: Authorizing `identity:get_group(group_id=71f5ef5217c5400ca03ddd5e37fdc5f1)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:16.526235 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb861f43-0083-4c1d-b071-774e9c933d02 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:16.528619 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 185/372] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Oct 4 03:16:16 2022] GET /identity/v3/groups/71f5ef5217c5400ca03ddd5e37fdc5f1 => generated 226 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:16.529534 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb861f43-0083-4c1d-b071-774e9c933d02 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:16.560601 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:16.562612 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaeb4fa-3d24-434e-bac7-4f489452474f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:16.563527 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaeb4fa-3d24-434e-bac7-4f489452474f None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:16.564059 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaeb4fa-3d24-434e-bac7-4f489452474f None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:16.565525 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaeb4fa-3d24-434e-bac7-4f489452474f None admin] PATH_INFO: `/v3/projects/dcddf7d31429427a8d46e49ef77bbe82` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:16.566874 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaeb4fa-3d24-434e-bac7-4f489452474f None admin] RBAC: Authorizing `identity:get_project(project_id=dcddf7d31429427a8d46e49ef77bbe82)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:16.568629 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaeb4fa-3d24-434e-bac7-4f489452474f None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:16.571528 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 188/373] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 03:16:16 2022] GET /identity/v3/projects/dcddf7d31429427a8d46e49ef77bbe82 => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:16.572774 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaeb4fa-3d24-434e-bac7-4f489452474f None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:16.662770 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb861f43-0083-4c1d-b071-774e9c933d02 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:16.699097 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:16.699627 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa783a0-cc2a-474a-b7af-20f8cfefd9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:16.700301 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa783a0-cc2a-474a-b7af-20f8cfefd9db None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:16.700423 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa783a0-cc2a-474a-b7af-20f8cfefd9db None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:16.700702 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa783a0-cc2a-474a-b7af-20f8cfefd9db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:16.708590 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaeb4fa-3d24-434e-bac7-4f489452474f None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:16.752994 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad63608-3f8e-461e-a295-39ef1f03c2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:16.754148 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad63608-3f8e-461e-a295-39ef1f03c2c2 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:16.754541 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad63608-3f8e-461e-a295-39ef1f03c2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:16.754895 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad63608-3f8e-461e-a295-39ef1f03c2c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:16.756179 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad63608-3f8e-461e-a295-39ef1f03c2c2 None admin] RBAC: Adding query filter params (group.id=71f5ef5217c5400ca03ddd5e37fdc5f1, role.id=04d0e4575a28440eb4349b4a6565e8b8, scope.project.id=dcddf7d31429427a8d46e49ef77bbe82) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:16.756895 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad63608-3f8e-461e-a295-39ef1f03c2c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:16.758912 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad63608-3f8e-461e-a295-39ef1f03c2c2 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:16.766692 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 189/374] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Oct 4 03:16:16 2022] GET /identity/v3/role_assignments?group.id=71f5ef5217c5400ca03ddd5e37fdc5f1&scope.project.id=dcddf7d31429427a8d46e49ef77bbe82&role.id=04d0e4575a28440eb4349b4a6565e8b8 => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:16.767540 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad63608-3f8e-461e-a295-39ef1f03c2c2 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:16.803839 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa783a0-cc2a-474a-b7af-20f8cfefd9db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:16.805842 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa783a0-cc2a-474a-b7af-20f8cfefd9db None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:16.863930 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:16.983732 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad63608-3f8e-461e-a295-39ef1f03c2c2 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:17.001527 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 186/375] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 03:16:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 03:16:17.008283 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa783a0-cc2a-474a-b7af-20f8cfefd9db None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:17.036596 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1459f09-03fc-46c6-9ac8-dabcca9a7a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:17.037554 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1459f09-03fc-46c6-9ac8-dabcca9a7a43 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:17.038033 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1459f09-03fc-46c6-9ac8-dabcca9a7a43 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:17.039024 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1459f09-03fc-46c6-9ac8-dabcca9a7a43 None admin] PATH_INFO: `/v3/groups/71f5ef5217c5400ca03ddd5e37fdc5f1` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:17.040484 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1459f09-03fc-46c6-9ac8-dabcca9a7a43 None admin] RBAC: Authorizing `identity:get_group(group_id=71f5ef5217c5400ca03ddd5e37fdc5f1)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:17.042877 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1459f09-03fc-46c6-9ac8-dabcca9a7a43 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:17.045018 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 190/376] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Oct 4 03:16:16 2022] GET /identity/v3/groups/71f5ef5217c5400ca03ddd5e37fdc5f1 => generated 226 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:17.052464 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1459f09-03fc-46c6-9ac8-dabcca9a7a43 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:17.127574 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa783a0-cc2a-474a-b7af-20f8cfefd9db None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:17.129653 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:17.157264 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:17.170593 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1831f31-1861-48e7-b613-c484c1a6ed54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:17.171599 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1831f31-1861-48e7-b613-c484c1a6ed54 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:17.172095 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1831f31-1861-48e7-b613-c484c1a6ed54 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:17.172575 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1831f31-1861-48e7-b613-c484c1a6ed54 None admin] PATH_INFO: `/v3/projects/1f0f8d5c867d4d0e8de6fcf13db59693` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:17.174189 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1831f31-1861-48e7-b613-c484c1a6ed54 None admin] RBAC: Authorizing `identity:get_project(project_id=1f0f8d5c867d4d0e8de6fcf13db59693)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:17.176071 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1831f31-1861-48e7-b613-c484c1a6ed54 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:17.177906 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 187/377] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 03:16:17 2022] GET /identity/v3/projects/1f0f8d5c867d4d0e8de6fcf13db59693 => generated 344 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:16:17.188408 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1831f31-1861-48e7-b613-c484c1a6ed54 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:17.285886 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1459f09-03fc-46c6-9ac8-dabcca9a7a43 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:17.320200 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1831f31-1861-48e7-b613-c484c1a6ed54 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:17.346529 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca7785e-9c76-4e96-ad24-ca39701eee5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:17.347140 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca7785e-9c76-4e96-ad24-ca39701eee5a None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:17.351705 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca7785e-9c76-4e96-ad24-ca39701eee5a None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:17.353380 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca7785e-9c76-4e96-ad24-ca39701eee5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:17.354337 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca7785e-9c76-4e96-ad24-ca39701eee5a None admin] RBAC: Adding query filter params (group.id=71f5ef5217c5400ca03ddd5e37fdc5f1, role.id=f2332a9a00b74fe0846d7211dd3850cb, scope.project.id=dcddf7d31429427a8d46e49ef77bbe82) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:17.355809 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca7785e-9c76-4e96-ad24-ca39701eee5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:17.357461 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca7785e-9c76-4e96-ad24-ca39701eee5a None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:17.365096 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907aa28b-2e96-40ab-a92b-f668d6d546b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:17.365994 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907aa28b-2e96-40ab-a92b-f668d6d546b5 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:17.368311 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907aa28b-2e96-40ab-a92b-f668d6d546b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:17.369063 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907aa28b-2e96-40ab-a92b-f668d6d546b5 None admin] PATH_INFO: `/v3/groups/a73388c7228149fd865c757c373668d0` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:17.371886 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 191/378] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Oct 4 03:16:17 2022] GET /identity/v3/role_assignments?group.id=71f5ef5217c5400ca03ddd5e37fdc5f1&scope.project.id=dcddf7d31429427a8d46e49ef77bbe82&role.id=f2332a9a00b74fe0846d7211dd3850cb => generated 260 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:17.386585 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907aa28b-2e96-40ab-a92b-f668d6d546b5 None admin] RBAC: Authorizing `identity:get_group(group_id=a73388c7228149fd865c757c373668d0)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:17.388520 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907aa28b-2e96-40ab-a92b-f668d6d546b5 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:17.390517 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 188/379] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Oct 4 03:16:17 2022] GET /identity/v3/groups/a73388c7228149fd865c757c373668d0 => generated 229 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:17.396803 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca7785e-9c76-4e96-ad24-ca39701eee5a None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:17.544124 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:17.558250 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca7785e-9c76-4e96-ad24-ca39701eee5a None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:17.595987 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067867f0-5dda-4e5a-b9c2-4b39f4d1e2e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:17.596944 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067867f0-5dda-4e5a-b9c2-4b39f4d1e2e7 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:17.597439 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067867f0-5dda-4e5a-b9c2-4b39f4d1e2e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:17.597954 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067867f0-5dda-4e5a-b9c2-4b39f4d1e2e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:17.598870 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067867f0-5dda-4e5a-b9c2-4b39f4d1e2e7 None admin] RBAC: Adding query filter params (group.id=a73388c7228149fd865c757c373668d0, role.id=fe9379cda35c4ff78576fe48b60bea3c, scope.project.id=1f0f8d5c867d4d0e8de6fcf13db59693) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:17.599387 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067867f0-5dda-4e5a-b9c2-4b39f4d1e2e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:17.601568 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067867f0-5dda-4e5a-b9c2-4b39f4d1e2e7 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:17.607930 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 192/380] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Oct 4 03:16:17 2022] GET /identity/v3/role_assignments?group.id=a73388c7228149fd865c757c373668d0&scope.project.id=1f0f8d5c867d4d0e8de6fcf13db59693&role.id=fe9379cda35c4ff78576fe48b60bea3c => generated 260 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:17.871636 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f8d2cb-0c9c-45eb-82a9-96a4dd261a06 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:17.872698 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f8d2cb-0c9c-45eb-82a9-96a4dd261a06 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:17.873189 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f8d2cb-0c9c-45eb-82a9-96a4dd261a06 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:17.875287 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 189/381] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:16:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:16:17.880892 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f93a4e-12aa-4675-8981-0b37816cc47a None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:17.881828 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f93a4e-12aa-4675-8981-0b37816cc47a None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:17.882481 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f93a4e-12aa-4675-8981-0b37816cc47a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:17.912621 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-c4f93a4e-12aa-4675-8981-0b37816cc47a None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:16:17.914308 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-c4f93a4e-12aa-4675-8981-0b37816cc47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:16:18.004446 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 193/382] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:16:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 03:16:18.329557 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f8d2cb-0c9c-45eb-82a9-96a4dd261a06 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:18.395711 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:18.457130 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f8d2cb-0c9c-45eb-82a9-96a4dd261a06 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:18.503255 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d441407-ba11-4f4f-983d-43a2a90423ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:18.503927 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d441407-ba11-4f4f-983d-43a2a90423ea None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:18.504212 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d441407-ba11-4f4f-983d-43a2a90423ea None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:18.504488 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d441407-ba11-4f4f-983d-43a2a90423ea None admin] PATH_INFO: `/v3/roles/member` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:18.524386 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d441407-ba11-4f4f-983d-43a2a90423ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:16:18.529295 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-2d441407-ba11-4f4f-983d-43a2a90423ea None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 03:16:18.529295 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:18.529295 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:18.529295 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:18.529295 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:18.529295 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:18.529295 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:18.529295 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:18.529295 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:18.529295 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:18.529295 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:18.529295 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:18.529295 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:16:18.529295 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:16:18.529295 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:16:18.529295 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:16:18.530149 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:16:18.530149 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:16:18.530149 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:16:18.530149 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:16:18.530149 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:18.530149 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:18.530149 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:18.530149 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:18.530149 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:18.530149 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:18.530149 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:18.530149 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:18.530149 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:18.530149 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:18.530149 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:18.530149 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:18.530929 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:18.530929 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:18.530929 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:18.530929 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:18.530929 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:16:18.530929 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:16:18.530929 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:16:18.530929 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:16:18.530929 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:16:18.530929 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:16:18.530929 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 03:16:18.530929 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:16:18.530929 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 190/383] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 03:16:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:18.536506 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f93a4e-12aa-4675-8981-0b37816cc47a None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:18.687245 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:18.706243 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f93a4e-12aa-4675-8981-0b37816cc47a None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:18.753610 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312e99a9-6eff-437e-a4ff-58a5e4c15e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:18.754598 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312e99a9-6eff-437e-a4ff-58a5e4c15e01 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:18.755096 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312e99a9-6eff-437e-a4ff-58a5e4c15e01 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:18.755599 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312e99a9-6eff-437e-a4ff-58a5e4c15e01 None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:18.756468 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312e99a9-6eff-437e-a4ff-58a5e4c15e01 None admin] RBAC: Adding query filter params (name=member) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:18.757337 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312e99a9-6eff-437e-a4ff-58a5e4c15e01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:18.759178 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312e99a9-6eff-437e-a4ff-58a5e4c15e01 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:18.770750 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 194/384] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Oct 4 03:16:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:18.780592 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d441407-ba11-4f4f-983d-43a2a90423ea None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:18.923562 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d441407-ba11-4f4f-983d-43a2a90423ea None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:18.948725 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:18.978665 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39fc48e-5dee-4b3a-a362-ba005b749c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:18.979317 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39fc48e-5dee-4b3a-a362-ba005b749c33 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:18.979628 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39fc48e-5dee-4b3a-a362-ba005b749c33 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:18.979906 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39fc48e-5dee-4b3a-a362-ba005b749c33 None admin] PATH_INFO: `/v3/groups/71f5ef5217c5400ca03ddd5e37fdc5f1` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:18.981233 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39fc48e-5dee-4b3a-a362-ba005b749c33 None admin] RBAC: Authorizing `identity:get_group(group_id=71f5ef5217c5400ca03ddd5e37fdc5f1)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:18.982681 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39fc48e-5dee-4b3a-a362-ba005b749c33 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:18.984278 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 191/385] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Oct 4 03:16:18 2022] GET /identity/v3/groups/71f5ef5217c5400ca03ddd5e37fdc5f1 => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:18.990039 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312e99a9-6eff-437e-a4ff-58a5e4c15e01 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:19.077873 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a67c027-9e72-4787-a8da-2106a3a2956d None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:19.078209 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a67c027-9e72-4787-a8da-2106a3a2956d None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:19.078448 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a67c027-9e72-4787-a8da-2106a3a2956d None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:19.080056 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 192/386] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:16:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 03:16:19.085727 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a605f779-cf81-4dbc-9b93-68e03a7d79ac None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:19.086018 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a605f779-cf81-4dbc-9b93-68e03a7d79ac None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:19.086294 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a605f779-cf81-4dbc-9b93-68e03a7d79ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:19.107107 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-a605f779-cf81-4dbc-9b93-68e03a7d79ac None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:16:19.108380 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-a605f779-cf81-4dbc-9b93-68e03a7d79ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:16:19.165771 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312e99a9-6eff-437e-a4ff-58a5e4c15e01 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:19.217096 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 193/387] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:16:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 03:16:19.231770 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50bbf98-7dfe-4472-bf65-a90025d348ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:19.232460 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50bbf98-7dfe-4472-bf65-a90025d348ac None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:19.232740 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50bbf98-7dfe-4472-bf65-a90025d348ac None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:19.233011 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50bbf98-7dfe-4472-bf65-a90025d348ac None admin] PATH_INFO: `/v3/projects/a7dc4038bbe8418c9837b329ac4d2754` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:19.234428 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50bbf98-7dfe-4472-bf65-a90025d348ac None admin] RBAC: Authorizing `identity:get_project(project_id=a7dc4038bbe8418c9837b329ac4d2754)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:19.235979 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50bbf98-7dfe-4472-bf65-a90025d348ac None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:19.237966 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 195/388] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 03:16:18 2022] GET /identity/v3/projects/a7dc4038bbe8418c9837b329ac4d2754 => generated 298 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:19.244032 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a605f779-cf81-4dbc-9b93-68e03a7d79ac None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:19.375247 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a605f779-cf81-4dbc-9b93-68e03a7d79ac None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:19.394863 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:19.421256 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ccd705-be7f-431e-b02d-8fb1f410db46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:19.421910 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ccd705-be7f-431e-b02d-8fb1f410db46 None admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:19.422193 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ccd705-be7f-431e-b02d-8fb1f410db46 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:19.422463 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ccd705-be7f-431e-b02d-8fb1f410db46 None admin] PATH_INFO: `/v3/projects/a7dc4038bbe8418c9837b329ac4d2754/groups/71f5ef5217c5400ca03ddd5e37fdc5f1/roles/04d0e4575a28440eb4349b4a6565e8b8` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:19.428831 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ccd705-be7f-431e-b02d-8fb1f410db46 None admin] RBAC: Authorizing `identity:create_grant(project_id=a7dc4038bbe8418c9837b329ac4d2754, group_id=71f5ef5217c5400ca03ddd5e37fdc5f1, role_id=04d0e4575a28440eb4349b4a6565e8b8)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:19.430890 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ccd705-be7f-431e-b02d-8fb1f410db46 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:19.454412 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 194/389] 10.222.0.25 () {58 vars in 1442 bytes} [Tue Oct 4 03:16:19 2022] PUT /identity/v3/projects/a7dc4038bbe8418c9837b329ac4d2754/groups/71f5ef5217c5400ca03ddd5e37fdc5f1/roles/04d0e4575a28440eb4349b4a6565e8b8 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:16:19.462600 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7578fa69-e220-443e-a298-aeb0618d5a7b None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:19.462936 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7578fa69-e220-443e-a298-aeb0618d5a7b None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:19.463222 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7578fa69-e220-443e-a298-aeb0618d5a7b None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:19.464986 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 196/390] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:16:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:16:19.470228 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70f8cd-b8d0-4f94-896a-6c24f11ebf49 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:19.470492 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70f8cd-b8d0-4f94-896a-6c24f11ebf49 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:19.470692 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70f8cd-b8d0-4f94-896a-6c24f11ebf49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:19.500033 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-8a70f8cd-b8d0-4f94-896a-6c24f11ebf49 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:16:19.501251 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-8a70f8cd-b8d0-4f94-896a-6c24f11ebf49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:16:19.548221 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7578fa69-e220-443e-a298-aeb0618d5a7b None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:19.574540 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:19.594671 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 195/391] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:16:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 03:16:19.718960 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7578fa69-e220-443e-a298-aeb0618d5a7b None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:19.764710 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a457e-83ea-425e-b661-17b2c509311c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:19.765316 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a457e-83ea-425e-b661-17b2c509311c None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:19.765600 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a457e-83ea-425e-b661-17b2c509311c None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:19.765874 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a457e-83ea-425e-b661-17b2c509311c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:19.777631 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4a457e-83ea-425e-b661-17b2c509311c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:16:19.782557 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-6b4a457e-83ea-425e-b661-17b2c509311c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 03:16:19.782557 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:19.782557 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:19.782557 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:19.782557 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:19.782557 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:19.782557 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:19.782557 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:19.782557 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:19.782557 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:19.782557 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:19.782557 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:19.782557 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:16:19.782557 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:16:19.782557 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:16:19.782557 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:16:19.783428 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:16:19.783428 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:16:19.783428 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:16:19.783428 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:16:19.783428 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:19.783428 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:19.783428 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:19.783428 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:19.783428 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:19.783428 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:19.783428 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:19.783428 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:19.783428 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:19.783428 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:19.783428 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:19.783428 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:19.784253 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:19.784253 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:19.784253 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:19.784253 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:19.784253 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:16:19.784253 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:16:19.784253 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:16:19.784253 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:16:19.784253 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:16:19.784253 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:16:19.784253 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 03:16:19.784253 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:16:19.784253 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 197/392] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Oct 4 03:16:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:19.791773 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a70f8cd-b8d0-4f94-896a-6c24f11ebf49 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:19.912851 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a70f8cd-b8d0-4f94-896a-6c24f11ebf49 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:19.919791 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:19.922743 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a457e-83ea-425e-b661-17b2c509311c None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:19.996198 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7e33c0-c0b2-4cb7-8c63-c785e2534180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:19.997433 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e33c0-c0b2-4cb7-8c63-c785e2534180 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:19.997943 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e33c0-c0b2-4cb7-8c63-c785e2534180 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:19.998417 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e33c0-c0b2-4cb7-8c63-c785e2534180 None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:19.999323 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7e33c0-c0b2-4cb7-8c63-c785e2534180 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:19.999960 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7e33c0-c0b2-4cb7-8c63-c785e2534180 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:20.002212 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7e33c0-c0b2-4cb7-8c63-c785e2534180 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:20.020010 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 196/393] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 03:16:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:20.025505 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7e33c0-c0b2-4cb7-8c63-c785e2534180 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:20.057117 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:20.124238 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a457e-83ea-425e-b661-17b2c509311c None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:20.158369 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7e33c0-c0b2-4cb7-8c63-c785e2534180 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:20.196894 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d3ed6e-e825-4568-99a1-9ec7fdb6c244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:20.198705 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3ed6e-e825-4568-99a1-9ec7fdb6c244 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:20.198705 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3ed6e-e825-4568-99a1-9ec7fdb6c244 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:20.198705 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3ed6e-e825-4568-99a1-9ec7fdb6c244 None admin] PATH_INFO: `/v3/groups/71f5ef5217c5400ca03ddd5e37fdc5f1` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:20.199693 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d3ed6e-e825-4568-99a1-9ec7fdb6c244 None admin] RBAC: Authorizing `identity:get_group(group_id=71f5ef5217c5400ca03ddd5e37fdc5f1)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:20.201579 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d3ed6e-e825-4568-99a1-9ec7fdb6c244 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:20.203859 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 197/394] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Oct 4 03:16:20 2022] GET /identity/v3/groups/71f5ef5217c5400ca03ddd5e37fdc5f1 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:20.205290 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f12170-489d-434a-ab9a-f08bd811504b None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:20.205593 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f12170-489d-434a-ab9a-f08bd811504b None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:20.205843 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f12170-489d-434a-ab9a-f08bd811504b None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:20.207165 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7546cc-d1eb-4da1-abd4-df32724c7256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:20.207307 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 198/395] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:16:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:16:20.208122 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7546cc-d1eb-4da1-abd4-df32724c7256 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:20.208607 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7546cc-d1eb-4da1-abd4-df32724c7256 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:20.209079 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7546cc-d1eb-4da1-abd4-df32724c7256 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:20.215586 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a101f5-0c16-435a-b558-45ba7c8d6796 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:20.215586 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a101f5-0c16-435a-b558-45ba7c8d6796 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:20.215586 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a101f5-0c16-435a-b558-45ba7c8d6796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:20.226759 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7546cc-d1eb-4da1-abd4-df32724c7256 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:16:20.232838 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-1e7546cc-d1eb-4da1-abd4-df32724c7256 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 03:16:20.232838 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:20.232838 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:20.232838 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:20.232838 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:20.232838 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:20.232838 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:20.232838 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:20.232838 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:20.232838 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:20.232838 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:20.232838 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:20.232838 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:16:20.232838 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:16:20.232838 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:16:20.232838 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:16:20.233949 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:16:20.233949 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:16:20.233949 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:16:20.233949 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:16:20.233949 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:20.233949 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:20.233949 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:20.233949 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:20.233949 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:20.233949 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:20.233949 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:20.233949 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:20.233949 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:20.233949 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:20.233949 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:20.233949 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:20.234720 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:20.234720 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:20.234720 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:20.234720 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:20.234720 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:16:20.234720 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:16:20.234720 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:16:20.234720 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:16:20.234720 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:16:20.234720 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:16:20.234720 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 03:16:20.234720 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:16:20.236949 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-14a101f5-0c16-435a-b558-45ba7c8d6796 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:16:20.237128 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 198/396] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 03:16:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 03:16:20.238124 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7546cc-d1eb-4da1-abd4-df32724c7256 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:20.238374 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-14a101f5-0c16-435a-b558-45ba7c8d6796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:16:20.269591 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:20.323660 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 199/397] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:16:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 03:16:20.324810 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a101f5-0c16-435a-b558-45ba7c8d6796 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:20.381227 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7546cc-d1eb-4da1-abd4-df32724c7256 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:20.441062 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a101f5-0c16-435a-b558-45ba7c8d6796 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:20.464366 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17565033-316d-47c0-8c56-d470bdbac549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:20.465344 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17565033-316d-47c0-8c56-d470bdbac549 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:20.465807 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17565033-316d-47c0-8c56-d470bdbac549 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:20.466238 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17565033-316d-47c0-8c56-d470bdbac549 None admin] PATH_INFO: `/v3/projects/a7dc4038bbe8418c9837b329ac4d2754` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:20.467587 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17565033-316d-47c0-8c56-d470bdbac549 None admin] RBAC: Authorizing `identity:get_project(project_id=a7dc4038bbe8418c9837b329ac4d2754)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:20.469329 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17565033-316d-47c0-8c56-d470bdbac549 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:20.471474 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 199/398] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 03:16:20 2022] GET /identity/v3/projects/a7dc4038bbe8418c9837b329ac4d2754 => generated 298 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:20.477513 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17565033-316d-47c0-8c56-d470bdbac549 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:20.480581 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:20.492534 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e51b90-a189-407b-ad3f-033517de4e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:20.493521 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e51b90-a189-407b-ad3f-033517de4e4d None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:20.496153 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e51b90-a189-407b-ad3f-033517de4e4d None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:20.496760 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e51b90-a189-407b-ad3f-033517de4e4d None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:20.497731 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e51b90-a189-407b-ad3f-033517de4e4d None admin] RBAC: Adding query filter params (name=member) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:20.498800 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e51b90-a189-407b-ad3f-033517de4e4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:20.503257 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e51b90-a189-407b-ad3f-033517de4e4d None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:20.527680 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 200/399] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Oct 4 03:16:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:20.530827 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e51b90-a189-407b-ad3f-033517de4e4d None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:20.589203 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:20.649606 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17565033-316d-47c0-8c56-d470bdbac549 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:20.686016 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe17552-3ff5-4ff9-849b-b235094a2796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:20.687044 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe17552-3ff5-4ff9-849b-b235094a2796 None admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:20.687580 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe17552-3ff5-4ff9-849b-b235094a2796 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:20.688090 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe17552-3ff5-4ff9-849b-b235094a2796 None admin] PATH_INFO: `/v3/projects/a7dc4038bbe8418c9837b329ac4d2754/groups/71f5ef5217c5400ca03ddd5e37fdc5f1/roles/f2332a9a00b74fe0846d7211dd3850cb` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:20.688597 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e51b90-a189-407b-ad3f-033517de4e4d None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:20.690796 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe17552-3ff5-4ff9-849b-b235094a2796 None admin] RBAC: Authorizing `identity:create_grant(project_id=a7dc4038bbe8418c9837b329ac4d2754, group_id=71f5ef5217c5400ca03ddd5e37fdc5f1, role_id=f2332a9a00b74fe0846d7211dd3850cb)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:20.692463 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe17552-3ff5-4ff9-849b-b235094a2796 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:20.709874 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 200/400] 10.222.0.25 () {58 vars in 1442 bytes} [Tue Oct 4 03:16:20 2022] PUT /identity/v3/projects/a7dc4038bbe8418c9837b329ac4d2754/groups/71f5ef5217c5400ca03ddd5e37fdc5f1/roles/f2332a9a00b74fe0846d7211dd3850cb => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:16:20.712136 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd875c-a7bb-4011-90cc-013ccfb4cebf None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:20.712637 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd875c-a7bb-4011-90cc-013ccfb4cebf None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:20.713433 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd875c-a7bb-4011-90cc-013ccfb4cebf None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:20.715547 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 201/401] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:16:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:16:20.716951 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bd875c-a7bb-4011-90cc-013ccfb4cebf None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:20.735647 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb5ae42-446a-49bd-9e11-34458290141d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:20.736319 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb5ae42-446a-49bd-9e11-34458290141d None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:20.736654 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb5ae42-446a-49bd-9e11-34458290141d None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:20.736936 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb5ae42-446a-49bd-9e11-34458290141d None admin] PATH_INFO: `/v3/groups/71f5ef5217c5400ca03ddd5e37fdc5f1` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:20.738237 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb5ae42-446a-49bd-9e11-34458290141d None admin] RBAC: Authorizing `identity:get_group(group_id=71f5ef5217c5400ca03ddd5e37fdc5f1)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:20.739876 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb5ae42-446a-49bd-9e11-34458290141d None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:20.742718 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 201/402] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Oct 4 03:16:20 2022] GET /identity/v3/groups/71f5ef5217c5400ca03ddd5e37fdc5f1 => generated 226 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:16:20.744176 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ef03b-1eff-4545-b861-c8bfedd8c69b None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:20.744515 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ef03b-1eff-4545-b861-c8bfedd8c69b None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:20.744795 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ef03b-1eff-4545-b861-c8bfedd8c69b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:20.765769 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-3b2ef03b-1eff-4545-b861-c8bfedd8c69b None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:16:20.767007 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-3b2ef03b-1eff-4545-b861-c8bfedd8c69b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:16:20.808011 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:20.855998 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 202/403] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:16:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 03:16:20.856954 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ef03b-1eff-4545-b861-c8bfedd8c69b None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:20.867223 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bd875c-a7bb-4011-90cc-013ccfb4cebf None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:20.911800 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:20.913265 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac6a0c-cdcc-4794-bb24-7eb4ee19e790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:20.914106 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac6a0c-cdcc-4794-bb24-7eb4ee19e790 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:20.914558 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac6a0c-cdcc-4794-bb24-7eb4ee19e790 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:20.915033 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac6a0c-cdcc-4794-bb24-7eb4ee19e790 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:20.927101 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ac6a0c-cdcc-4794-bb24-7eb4ee19e790 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:16:20.933020 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-26ac6a0c-cdcc-4794-bb24-7eb4ee19e790 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 03:16:20.933020 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:20.933020 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:20.933020 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:20.933020 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:20.933020 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:20.933020 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:20.933020 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:20.933020 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:20.933020 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:20.933020 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:20.933020 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:20.933020 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:16:20.933020 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:16:20.933020 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:16:20.933020 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:16:20.933905 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:16:20.933905 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:16:20.933905 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:16:20.933905 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:16:20.933905 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:20.933905 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:20.933905 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:20.933905 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:20.933905 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:20.933905 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:20.933905 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:20.933905 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:20.933905 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:20.933905 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:20.933905 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:20.933905 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:20.934685 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:20.934685 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:20.934685 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:20.934685 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:20.934685 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:16:20.934685 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:16:20.934685 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:16:20.934685 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:16:20.934685 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:16:20.934685 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:16:20.934685 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 03:16:20.934685 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:16:20.937418 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 202/404] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Oct 4 03:16:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:20.943388 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac6a0c-cdcc-4794-bb24-7eb4ee19e790 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:21.002894 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ef03b-1eff-4545-b861-c8bfedd8c69b None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:21.048996 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0090b13a-4ccc-4158-a34b-d072a87f26fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:21.049770 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090b13a-4ccc-4158-a34b-d072a87f26fd None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:21.050151 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090b13a-4ccc-4158-a34b-d072a87f26fd None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:21.050499 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090b13a-4ccc-4158-a34b-d072a87f26fd None admin] PATH_INFO: `/v3/projects/dcddf7d31429427a8d46e49ef77bbe82` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:21.051975 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0090b13a-4ccc-4158-a34b-d072a87f26fd None admin] RBAC: Authorizing `identity:get_project(project_id=dcddf7d31429427a8d46e49ef77bbe82)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:21.055018 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0090b13a-4ccc-4158-a34b-d072a87f26fd None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:21.057778 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 203/405] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 03:16:20 2022] GET /identity/v3/projects/dcddf7d31429427a8d46e49ef77bbe82 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:21.067512 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0090b13a-4ccc-4158-a34b-d072a87f26fd None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:21.103119 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac6a0c-cdcc-4794-bb24-7eb4ee19e790 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:21.128794 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:21.142164 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9898b5f1-d69e-4b59-b34d-24f5db05cd40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:21.142778 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898b5f1-d69e-4b59-b34d-24f5db05cd40 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:21.143089 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898b5f1-d69e-4b59-b34d-24f5db05cd40 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:21.143446 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898b5f1-d69e-4b59-b34d-24f5db05cd40 None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:21.144151 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9898b5f1-d69e-4b59-b34d-24f5db05cd40 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:21.144463 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9898b5f1-d69e-4b59-b34d-24f5db05cd40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:21.145847 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9898b5f1-d69e-4b59-b34d-24f5db05cd40 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:21.155953 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 203/406] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 03:16:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:21.161827 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9898b5f1-d69e-4b59-b34d-24f5db05cd40 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:21.238513 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:21.252005 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0090b13a-4ccc-4158-a34b-d072a87f26fd None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:21.286875 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9898b5f1-d69e-4b59-b34d-24f5db05cd40 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:21.295869 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602a9692-2884-4355-a4be-0c006584eb79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:21.296535 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a9692-2884-4355-a4be-0c006584eb79 None admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:21.297262 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a9692-2884-4355-a4be-0c006584eb79 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:21.297620 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a9692-2884-4355-a4be-0c006584eb79 None admin] PATH_INFO: `/v3/projects/dcddf7d31429427a8d46e49ef77bbe82/groups/71f5ef5217c5400ca03ddd5e37fdc5f1/roles/04d0e4575a28440eb4349b4a6565e8b8` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:21.300280 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602a9692-2884-4355-a4be-0c006584eb79 None admin] RBAC: Authorizing `identity:create_grant(project_id=dcddf7d31429427a8d46e49ef77bbe82, group_id=71f5ef5217c5400ca03ddd5e37fdc5f1, role_id=04d0e4575a28440eb4349b4a6565e8b8)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:21.302458 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602a9692-2884-4355-a4be-0c006584eb79 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:21.324234 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 204/407] 10.222.0.25 () {58 vars in 1442 bytes} [Tue Oct 4 03:16:21 2022] PUT /identity/v3/projects/dcddf7d31429427a8d46e49ef77bbe82/groups/71f5ef5217c5400ca03ddd5e37fdc5f1/roles/04d0e4575a28440eb4349b4a6565e8b8 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:16:21.325386 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602a9692-2884-4355-a4be-0c006584eb79 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:21.326795 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07444440-4f05-43ac-bd96-9e9783509f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:21.327440 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07444440-4f05-43ac-bd96-9e9783509f68 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:21.327781 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07444440-4f05-43ac-bd96-9e9783509f68 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:21.328058 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07444440-4f05-43ac-bd96-9e9783509f68 None admin] PATH_INFO: `/v3/groups/71f5ef5217c5400ca03ddd5e37fdc5f1` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:21.329269 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07444440-4f05-43ac-bd96-9e9783509f68 None admin] RBAC: Authorizing `identity:get_group(group_id=71f5ef5217c5400ca03ddd5e37fdc5f1)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:21.330756 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07444440-4f05-43ac-bd96-9e9783509f68 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:21.332955 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 204/408] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Oct 4 03:16:21 2022] GET /identity/v3/groups/71f5ef5217c5400ca03ddd5e37fdc5f1 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:21.338479 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07444440-4f05-43ac-bd96-9e9783509f68 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:21.407116 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:21.454107 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602a9692-2884-4355-a4be-0c006584eb79 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:21.463321 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07444440-4f05-43ac-bd96-9e9783509f68 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:21.494546 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0fa84c-5ef6-4815-afff-15816ee380ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:21.495188 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0fa84c-5ef6-4815-afff-15816ee380ab None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:21.495470 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0fa84c-5ef6-4815-afff-15816ee380ab None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:21.495772 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0fa84c-5ef6-4815-afff-15816ee380ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:21.501076 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8f43ba-e1cf-4541-a309-362bc9c8f224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:21.501720 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f43ba-e1cf-4541-a309-362bc9c8f224 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:21.502068 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f43ba-e1cf-4541-a309-362bc9c8f224 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:21.502353 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f43ba-e1cf-4541-a309-362bc9c8f224 None admin] PATH_INFO: `/v3/projects/dcddf7d31429427a8d46e49ef77bbe82` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:21.503583 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8f43ba-e1cf-4541-a309-362bc9c8f224 None admin] RBAC: Authorizing `identity:get_project(project_id=dcddf7d31429427a8d46e49ef77bbe82)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:21.505281 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8f43ba-e1cf-4541-a309-362bc9c8f224 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:21.507937 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 205/409] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 03:16:21 2022] GET /identity/v3/projects/dcddf7d31429427a8d46e49ef77bbe82 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:21.508476 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0fa84c-5ef6-4815-afff-15816ee380ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:16:21.519744 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-3b0fa84c-5ef6-4815-afff-15816ee380ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 03:16:21.519744 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:21.519744 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:21.519744 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:21.519744 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:21.519744 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:21.519744 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:21.519744 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:21.519744 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:21.519744 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:21.519744 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:21.519744 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:21.519744 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:16:21.519744 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:16:21.519744 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:16:21.519744 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:16:21.520701 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:16:21.520701 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:16:21.520701 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:16:21.520701 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:16:21.520701 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:21.520701 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:21.520701 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:21.520701 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:21.520701 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:21.520701 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:21.520701 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:21.520701 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:21.520701 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:21.520701 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:21.520701 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:21.520701 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:21.521500 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:21.521500 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:21.521500 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:21.521500 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:21.521500 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:16:21.521500 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:16:21.521500 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:16:21.521500 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:16:21.521500 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:16:21.521500 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:16:21.521500 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 03:16:21.521500 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:16:21.521500 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 205/410] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 4 03:16:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:21.523418 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8f43ba-e1cf-4541-a309-362bc9c8f224 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:21.524641 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0fa84c-5ef6-4815-afff-15816ee380ab None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:21.542698 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:21.643026 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0fa84c-5ef6-4815-afff-15816ee380ab None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:21.650599 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8f43ba-e1cf-4541-a309-362bc9c8f224 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:21.672696 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:21.684312 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468df2f0-c8be-4f7c-99f0-799926380878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:21.685116 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468df2f0-c8be-4f7c-99f0-799926380878 None admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:21.685551 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468df2f0-c8be-4f7c-99f0-799926380878 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:21.685880 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468df2f0-c8be-4f7c-99f0-799926380878 None admin] PATH_INFO: `/v3/projects/dcddf7d31429427a8d46e49ef77bbe82/groups/71f5ef5217c5400ca03ddd5e37fdc5f1/roles/f2332a9a00b74fe0846d7211dd3850cb` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:21.688189 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468df2f0-c8be-4f7c-99f0-799926380878 None admin] RBAC: Authorizing `identity:create_grant(project_id=dcddf7d31429427a8d46e49ef77bbe82, group_id=71f5ef5217c5400ca03ddd5e37fdc5f1, role_id=f2332a9a00b74fe0846d7211dd3850cb)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:21.689700 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468df2f0-c8be-4f7c-99f0-799926380878 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:21.691793 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2bed6b-dddd-4e72-8b63-5ca7b699b91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:21.692575 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2bed6b-dddd-4e72-8b63-5ca7b699b91a None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:21.693003 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2bed6b-dddd-4e72-8b63-5ca7b699b91a None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:21.693474 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2bed6b-dddd-4e72-8b63-5ca7b699b91a None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:21.694615 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2bed6b-dddd-4e72-8b63-5ca7b699b91a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:21.695331 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2bed6b-dddd-4e72-8b63-5ca7b699b91a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:21.697813 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2bed6b-dddd-4e72-8b63-5ca7b699b91a None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:21.707219 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 206/411] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 03:16:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:21.708135 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 206/412] 10.222.0.25 () {58 vars in 1442 bytes} [Tue Oct 4 03:16:21 2022] PUT /identity/v3/projects/dcddf7d31429427a8d46e49ef77bbe82/groups/71f5ef5217c5400ca03ddd5e37fdc5f1/roles/f2332a9a00b74fe0846d7211dd3850cb => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:16:21.714047 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2bed6b-dddd-4e72-8b63-5ca7b699b91a None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:21.846395 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2bed6b-dddd-4e72-8b63-5ca7b699b91a None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:21.895150 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e56018-3493-499a-a0f2-7d78b237d275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:21.895856 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e56018-3493-499a-a0f2-7d78b237d275 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:21.896144 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e56018-3493-499a-a0f2-7d78b237d275 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:21.896420 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e56018-3493-499a-a0f2-7d78b237d275 None admin] PATH_INFO: `/v3/groups/a73388c7228149fd865c757c373668d0` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:21.898082 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e56018-3493-499a-a0f2-7d78b237d275 None admin] RBAC: Authorizing `identity:get_group(group_id=a73388c7228149fd865c757c373668d0)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:21.899558 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e56018-3493-499a-a0f2-7d78b237d275 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:21.901371 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 207/413] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Oct 4 03:16:21 2022] GET /identity/v3/groups/a73388c7228149fd865c757c373668d0 => generated 229 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:21.906722 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468df2f0-c8be-4f7c-99f0-799926380878 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:21.996408 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:22.032645 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468df2f0-c8be-4f7c-99f0-799926380878 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:22.072240 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf0ad55-fb6a-40e6-8bbd-11ccc4b201fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:22.073259 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0ad55-fb6a-40e6-8bbd-11ccc4b201fb None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:22.073746 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0ad55-fb6a-40e6-8bbd-11ccc4b201fb None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:22.074213 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0ad55-fb6a-40e6-8bbd-11ccc4b201fb None admin] PATH_INFO: `/v3/projects/1f0f8d5c867d4d0e8de6fcf13db59693` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:22.075630 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf0ad55-fb6a-40e6-8bbd-11ccc4b201fb None admin] RBAC: Authorizing `identity:get_project(project_id=1f0f8d5c867d4d0e8de6fcf13db59693)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:22.077331 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf0ad55-fb6a-40e6-8bbd-11ccc4b201fb None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:22.079481 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 207/414] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 03:16:21 2022] GET /identity/v3/projects/1f0f8d5c867d4d0e8de6fcf13db59693 => generated 344 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:22.084907 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e56018-3493-499a-a0f2-7d78b237d275 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:22.126053 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d360cd-6539-4240-af1a-17d20b79fab9 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:22.126668 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d360cd-6539-4240-af1a-17d20b79fab9 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:22.127199 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d360cd-6539-4240-af1a-17d20b79fab9 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:22.129250 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 208/415] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:16:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 03:16:22.136993 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c71d3e-acd4-4651-b6bb-f3881f926899 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:22.137543 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c71d3e-acd4-4651-b6bb-f3881f926899 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:22.140164 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c71d3e-acd4-4651-b6bb-f3881f926899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:22.162582 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-a9c71d3e-acd4-4651-b6bb-f3881f926899 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:16:22.165844 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-a9c71d3e-acd4-4651-b6bb-f3881f926899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:16:22.168849 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:22.265021 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e56018-3493-499a-a0f2-7d78b237d275 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:22.287815 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 209/416] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:16:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 03:16:22.320838 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e97460-cb1a-4757-a42f-ef10a20c0373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:22.321496 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e97460-cb1a-4757-a42f-ef10a20c0373 None admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:22.321771 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e97460-cb1a-4757-a42f-ef10a20c0373 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:22.322040 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e97460-cb1a-4757-a42f-ef10a20c0373 None admin] PATH_INFO: `/v3/projects/1f0f8d5c867d4d0e8de6fcf13db59693/groups/a73388c7228149fd865c757c373668d0/roles/fe9379cda35c4ff78576fe48b60bea3c` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:22.324010 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e97460-cb1a-4757-a42f-ef10a20c0373 None admin] RBAC: Authorizing `identity:create_grant(project_id=1f0f8d5c867d4d0e8de6fcf13db59693, group_id=a73388c7228149fd865c757c373668d0, role_id=fe9379cda35c4ff78576fe48b60bea3c)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:22.325419 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e97460-cb1a-4757-a42f-ef10a20c0373 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:22.343190 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 208/417] 10.222.0.25 () {58 vars in 1442 bytes} [Tue Oct 4 03:16:22 2022] PUT /identity/v3/projects/1f0f8d5c867d4d0e8de6fcf13db59693/groups/a73388c7228149fd865c757c373668d0/roles/fe9379cda35c4ff78576fe48b60bea3c => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:16:22.649879 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c71d3e-acd4-4651-b6bb-f3881f926899 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:22.731915 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:22.771153 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c71d3e-acd4-4651-b6bb-f3881f926899 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:22.821872 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c155c014-ded0-4523-bd60-2d8859e68c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:22.822510 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c155c014-ded0-4523-bd60-2d8859e68c24 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:22.822791 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c155c014-ded0-4523-bd60-2d8859e68c24 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:22.823063 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c155c014-ded0-4523-bd60-2d8859e68c24 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:22.839800 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c155c014-ded0-4523-bd60-2d8859e68c24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:16:22.844607 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-c155c014-ded0-4523-bd60-2d8859e68c24 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 03:16:22.844607 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:22.844607 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:22.844607 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:22.844607 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:22.844607 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:22.844607 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:22.844607 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:22.844607 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:22.844607 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:22.844607 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:22.844607 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:22.844607 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:16:22.844607 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:16:22.844607 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:16:22.844607 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:16:22.845477 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:16:22.845477 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:16:22.845477 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:16:22.845477 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:16:22.845477 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:22.845477 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:22.845477 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:22.845477 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:22.845477 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:22.845477 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:22.845477 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:22.845477 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:22.845477 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:22.845477 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:22.845477 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:22.845477 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:22.846257 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:22.846257 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:22.846257 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:22.846257 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:22.846257 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:16:22.846257 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:16:22.846257 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:16:22.846257 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:16:22.846257 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:16:22.846257 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:16:22.846257 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 03:16:22.846257 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:16:22.848327 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 210/418] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 03:16:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:22.854193 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e97460-cb1a-4757-a42f-ef10a20c0373 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:22.986768 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e97460-cb1a-4757-a42f-ef10a20c0373 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:23.002815 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:23.032289 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84db787-f7b2-40ac-bf8c-6b284c408975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:23.032900 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84db787-f7b2-40ac-bf8c-6b284c408975 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:23.033175 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84db787-f7b2-40ac-bf8c-6b284c408975 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:23.033448 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84db787-f7b2-40ac-bf8c-6b284c408975 None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:23.034282 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84db787-f7b2-40ac-bf8c-6b284c408975 None admin] RBAC: Adding query filter params (name=member) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:23.034590 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84db787-f7b2-40ac-bf8c-6b284c408975 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:23.035976 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84db787-f7b2-40ac-bf8c-6b284c408975 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:23.046656 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 209/419] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Oct 4 03:16:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:23.052454 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c155c014-ded0-4523-bd60-2d8859e68c24 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:23.189492 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c155c014-ded0-4523-bd60-2d8859e68c24 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:23.226100 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:23.239054 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd495b4e-a652-4756-b809-dc6b9c691f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:23.239984 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd495b4e-a652-4756-b809-dc6b9c691f2a None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:23.240484 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd495b4e-a652-4756-b809-dc6b9c691f2a None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:23.240951 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd495b4e-a652-4756-b809-dc6b9c691f2a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:23.330192 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd495b4e-a652-4756-b809-dc6b9c691f2a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:23.332010 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd495b4e-a652-4756-b809-dc6b9c691f2a None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:23.386181 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8424ead2-41a9-4eb9-8102-0a11f8915511 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:23.386691 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8424ead2-41a9-4eb9-8102-0a11f8915511 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:23.386792 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8424ead2-41a9-4eb9-8102-0a11f8915511 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:23.388307 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 210/420] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:16:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:16:23.393372 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9def74-f29b-4f9a-a84f-378d7a129b0a None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:23.393660 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9def74-f29b-4f9a-a84f-378d7a129b0a None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:23.393937 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9def74-f29b-4f9a-a84f-378d7a129b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:23.433914 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-aa9def74-f29b-4f9a-a84f-378d7a129b0a None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:16:23.435275 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-aa9def74-f29b-4f9a-a84f-378d7a129b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:16:23.441654 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 211/421] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 03:16:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 03:16:23.447648 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd495b4e-a652-4756-b809-dc6b9c691f2a None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:23.479166 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:23.554810 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd495b4e-a652-4756-b809-dc6b9c691f2a None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:23.592456 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a75f589-7176-4fe5-8f7a-347c9b007f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:23.593755 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75f589-7176-4fe5-8f7a-347c9b007f49 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:23.594237 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75f589-7176-4fe5-8f7a-347c9b007f49 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:23.594708 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75f589-7176-4fe5-8f7a-347c9b007f49 None admin] PATH_INFO: `/v3/projects/a7dc4038bbe8418c9837b329ac4d2754` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:23.596083 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a75f589-7176-4fe5-8f7a-347c9b007f49 None admin] RBAC: Authorizing `identity:get_project(project_id=a7dc4038bbe8418c9837b329ac4d2754)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:23.598015 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a75f589-7176-4fe5-8f7a-347c9b007f49 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:23.600196 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 212/422] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 03:16:23 2022] GET /identity/v3/projects/a7dc4038bbe8418c9837b329ac4d2754 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:16:23.611696 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a75f589-7176-4fe5-8f7a-347c9b007f49 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:23.619153 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 211/423] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:16:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 03:16:23.717832 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:23.722386 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a75f589-7176-4fe5-8f7a-347c9b007f49 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:23.758626 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f919af19-89bf-46fd-b9ee-76ab6832fe7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:23.759744 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f919af19-89bf-46fd-b9ee-76ab6832fe7c None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:23.760263 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f919af19-89bf-46fd-b9ee-76ab6832fe7c None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:23.760731 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f919af19-89bf-46fd-b9ee-76ab6832fe7c None admin] PATH_INFO: `/v3/groups/71f5ef5217c5400ca03ddd5e37fdc5f1` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:23.762051 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f919af19-89bf-46fd-b9ee-76ab6832fe7c None admin] RBAC: Authorizing `identity:get_group(group_id=71f5ef5217c5400ca03ddd5e37fdc5f1)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:23.763726 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f919af19-89bf-46fd-b9ee-76ab6832fe7c None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:23.765786 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 213/424] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Oct 4 03:16:23 2022] GET /identity/v3/groups/71f5ef5217c5400ca03ddd5e37fdc5f1 => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:16:23.771899 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9def74-f29b-4f9a-a84f-378d7a129b0a None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:23.924210 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9def74-f29b-4f9a-a84f-378d7a129b0a None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:23.925584 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:23.969677 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f919af19-89bf-46fd-b9ee-76ab6832fe7c None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:23.981361 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3bda29-847f-4a04-945e-4117e466f82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:23.981967 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3bda29-847f-4a04-945e-4117e466f82d None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:23.982360 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3bda29-847f-4a04-945e-4117e466f82d None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:23.982643 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3bda29-847f-4a04-945e-4117e466f82d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:23.983373 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3bda29-847f-4a04-945e-4117e466f82d None admin] RBAC: Adding query filter params (group.id=71f5ef5217c5400ca03ddd5e37fdc5f1, role.id=04d0e4575a28440eb4349b4a6565e8b8, scope.project.id=a7dc4038bbe8418c9837b329ac4d2754) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:23.983706 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3bda29-847f-4a04-945e-4117e466f82d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:23.985124 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3bda29-847f-4a04-945e-4117e466f82d None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:23.999479 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 212/425] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Oct 4 03:16:23 2022] GET /identity/v3/role_assignments?group.id=71f5ef5217c5400ca03ddd5e37fdc5f1&scope.project.id=a7dc4038bbe8418c9837b329ac4d2754&role.id=04d0e4575a28440eb4349b4a6565e8b8 => generated 611 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:24.119910 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f919af19-89bf-46fd-b9ee-76ab6832fe7c None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:24.175257 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ce03d2-bff0-408d-a1da-5f586747b703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:24.175867 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce03d2-bff0-408d-a1da-5f586747b703 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:24.176148 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce03d2-bff0-408d-a1da-5f586747b703 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:24.176423 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce03d2-bff0-408d-a1da-5f586747b703 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:24.193079 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ce03d2-bff0-408d-a1da-5f586747b703 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:16:24.199556 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-37ce03d2-bff0-408d-a1da-5f586747b703 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 03:16:24.199556 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:24.199556 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:24.199556 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:24.199556 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:24.199556 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:24.199556 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:24.199556 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:24.199556 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:24.199556 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:24.199556 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:24.199556 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:24.199556 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:16:24.199556 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:16:24.199556 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:16:24.199556 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:16:24.200483 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:16:24.200483 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:16:24.200483 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:16:24.200483 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:16:24.200483 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:24.200483 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:24.200483 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:24.200483 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:24.200483 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:24.200483 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:24.200483 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:24.200483 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:24.200483 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:24.200483 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:24.200483 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:24.200483 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:24.201447 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:24.201447 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:24.201447 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:24.201447 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:24.201447 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:16:24.201447 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:16:24.201447 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:16:24.201447 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:16:24.201447 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:16:24.201447 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:16:24.201447 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 03:16:24.201447 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:16:24.201447 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 214/426] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Oct 4 03:16:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 03:16:24.208818 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3bda29-847f-4a04-945e-4117e466f82d None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:24.294979 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a479f4de-9b38-4281-8502-12f55cc472d3 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:24.295354 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a479f4de-9b38-4281-8502-12f55cc472d3 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:24.295547 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a479f4de-9b38-4281-8502-12f55cc472d3 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:24.297160 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 215/427] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:16:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:16:24.303063 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b441fe3c-2e7b-4538-9a2b-e94d8b031eca None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:24.303368 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b441fe3c-2e7b-4538-9a2b-e94d8b031eca None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:24.304060 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b441fe3c-2e7b-4538-9a2b-e94d8b031eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:24.329655 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-b441fe3c-2e7b-4538-9a2b-e94d8b031eca None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:16:24.331028 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-b441fe3c-2e7b-4538-9a2b-e94d8b031eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:16:24.352471 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3bda29-847f-4a04-945e-4117e466f82d None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:24.357968 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:24.398824 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02465109-e3b8-41c9-870b-25659e5fa16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:24.400062 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02465109-e3b8-41c9-870b-25659e5fa16b None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:24.400479 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02465109-e3b8-41c9-870b-25659e5fa16b None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:24.400883 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02465109-e3b8-41c9-870b-25659e5fa16b None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:24.402258 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02465109-e3b8-41c9-870b-25659e5fa16b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:24.402791 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02465109-e3b8-41c9-870b-25659e5fa16b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:24.404600 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02465109-e3b8-41c9-870b-25659e5fa16b None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:24.422104 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 216/429] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:16:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 03:16:24.422295 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 213/429] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 03:16:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:24.427708 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02465109-e3b8-41c9-870b-25659e5fa16b None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:24.447047 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0874f-54fb-447f-b053-3266e2444543 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:24.447385 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0874f-54fb-447f-b053-3266e2444543 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:24.447669 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0874f-54fb-447f-b053-3266e2444543 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:24.449369 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 217/430] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:16:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:16:24.454268 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec734ba-66aa-4dbe-ba7c-d29861850f25 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:24.454623 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec734ba-66aa-4dbe-ba7c-d29861850f25 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:24.454899 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec734ba-66aa-4dbe-ba7c-d29861850f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:24.465874 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:24.478074 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-0ec734ba-66aa-4dbe-ba7c-d29861850f25 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:16:24.479254 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-0ec734ba-66aa-4dbe-ba7c-d29861850f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:16:24.550842 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02465109-e3b8-41c9-870b-25659e5fa16b None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:24.563705 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 218/431] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:16:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 03:16:24.598131 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777642d9-b4d3-46de-8e00-919955c76f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:24.599153 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777642d9-b4d3-46de-8e00-919955c76f62 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:24.599703 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777642d9-b4d3-46de-8e00-919955c76f62 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:24.600271 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777642d9-b4d3-46de-8e00-919955c76f62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:24.689371 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777642d9-b4d3-46de-8e00-919955c76f62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:24.690747 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777642d9-b4d3-46de-8e00-919955c76f62 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:24.719667 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:24.740120 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec734ba-66aa-4dbe-ba7c-d29861850f25 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:24.806716 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 214/432] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 03:16:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 03:16:24.812959 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777642d9-b4d3-46de-8e00-919955c76f62 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:24.860522 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:24.879193 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec734ba-66aa-4dbe-ba7c-d29861850f25 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:24.932128 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1451c7a3-fdc7-4a5d-b171-14e0b8ed807a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:24.932759 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1451c7a3-fdc7-4a5d-b171-14e0b8ed807a None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:24.933038 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1451c7a3-fdc7-4a5d-b171-14e0b8ed807a None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:24.933692 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1451c7a3-fdc7-4a5d-b171-14e0b8ed807a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:24.941182 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777642d9-b4d3-46de-8e00-919955c76f62 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:24.953370 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1451c7a3-fdc7-4a5d-b171-14e0b8ed807a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:16:24.958324 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-1451c7a3-fdc7-4a5d-b171-14e0b8ed807a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 03:16:24.958324 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:24.958324 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:24.958324 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:24.958324 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:24.958324 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:24.958324 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:24.958324 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:24.958324 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:24.958324 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:24.958324 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:24.958324 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:24.958324 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:16:24.958324 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:16:24.958324 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:16:24.958324 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:16:24.959213 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:16:24.959213 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:16:24.959213 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:16:24.959213 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:16:24.959213 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:24.959213 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:24.959213 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:24.959213 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:24.959213 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:24.959213 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:24.959213 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:24.959213 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:24.959213 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:24.959213 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:24.959213 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:24.959213 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:24.960162 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:24.960162 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:24.960162 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:24.960162 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:24.960162 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:16:24.960162 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:16:24.960162 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:16:24.960162 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:16:24.960162 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:16:24.960162 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:16:24.960162 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 03:16:24.960162 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:16:24.960162 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 219/433] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 03:16:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:24.961033 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1451c7a3-fdc7-4a5d-b171-14e0b8ed807a None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:24.974043 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:24.984339 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56552fb2-5128-47ab-bf35-baa813563340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:24.984967 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56552fb2-5128-47ab-bf35-baa813563340 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:24.985243 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56552fb2-5128-47ab-bf35-baa813563340 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:24.985513 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56552fb2-5128-47ab-bf35-baa813563340 None admin] PATH_INFO: `/v3/projects/a7dc4038bbe8418c9837b329ac4d2754` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:24.986719 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56552fb2-5128-47ab-bf35-baa813563340 None admin] RBAC: Authorizing `identity:get_project(project_id=a7dc4038bbe8418c9837b329ac4d2754)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:24.988217 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56552fb2-5128-47ab-bf35-baa813563340 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:24.989869 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 215/434] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 03:16:24 2022] GET /identity/v3/projects/a7dc4038bbe8418c9837b329ac4d2754 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:24.990630 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56552fb2-5128-47ab-bf35-baa813563340 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:25.076152 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1451c7a3-fdc7-4a5d-b171-14e0b8ed807a None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:25.097184 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56552fb2-5128-47ab-bf35-baa813563340 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:25.111694 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf9ca0-9791-42c8-bd35-a25048ca3afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:25.112317 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf9ca0-9791-42c8-bd35-a25048ca3afa None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:25.112599 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf9ca0-9791-42c8-bd35-a25048ca3afa None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:25.112867 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf9ca0-9791-42c8-bd35-a25048ca3afa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:25.124252 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaf9ca0-9791-42c8-bd35-a25048ca3afa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:16:25.128949 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-bdaf9ca0-9791-42c8-bd35-a25048ca3afa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 03:16:25.128949 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:25.128949 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:25.128949 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:25.128949 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:25.128949 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:25.128949 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:25.128949 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:25.128949 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:25.128949 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:25.128949 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:25.128949 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:25.128949 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:16:25.128949 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:16:25.128949 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:16:25.128949 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:16:25.129842 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:16:25.129842 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:16:25.129842 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:16:25.129842 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:16:25.129842 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:25.129842 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:25.129842 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:25.129842 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:25.129842 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:25.129842 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:25.129842 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:25.129842 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:25.129842 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:25.129842 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:25.129842 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:25.129842 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:25.130632 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:25.130632 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:25.130632 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:25.130632 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:25.130632 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:16:25.130632 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:16:25.130632 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:16:25.130632 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:16:25.130632 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:16:25.130632 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:16:25.130632 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 03:16:25.130632 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:16:25.130632 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 220/435] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Oct 4 03:16:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:25.131291 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf9ca0-9791-42c8-bd35-a25048ca3afa None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:25.141210 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb282ec-90d7-46e5-9ee7-d461853520c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:25.142056 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb282ec-90d7-46e5-9ee7-d461853520c2 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:25.142515 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb282ec-90d7-46e5-9ee7-d461853520c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:25.142990 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb282ec-90d7-46e5-9ee7-d461853520c2 None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:25.143468 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:25.144851 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb282ec-90d7-46e5-9ee7-d461853520c2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:25.145351 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb282ec-90d7-46e5-9ee7-d461853520c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:25.146813 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb282ec-90d7-46e5-9ee7-d461853520c2 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:25.160252 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 216/436] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Oct 4 03:16:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:25.160252 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb282ec-90d7-46e5-9ee7-d461853520c2 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:25.218963 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:25.252931 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf9ca0-9791-42c8-bd35-a25048ca3afa None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:25.268654 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb282ec-90d7-46e5-9ee7-d461853520c2 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:25.292629 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d13d62-36fd-45d7-8274-0378c1414ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:25.293268 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d13d62-36fd-45d7-8274-0378c1414ac2 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:25.293547 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d13d62-36fd-45d7-8274-0378c1414ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:25.293819 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d13d62-36fd-45d7-8274-0378c1414ac2 None admin] PATH_INFO: `/v3/groups/71f5ef5217c5400ca03ddd5e37fdc5f1` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:25.295001 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d13d62-36fd-45d7-8274-0378c1414ac2 None admin] RBAC: Authorizing `identity:get_group(group_id=71f5ef5217c5400ca03ddd5e37fdc5f1)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:25.296527 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d13d62-36fd-45d7-8274-0378c1414ac2 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:25.298179 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 221/437] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Oct 4 03:16:25 2022] GET /identity/v3/groups/71f5ef5217c5400ca03ddd5e37fdc5f1 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:25.298944 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d13d62-36fd-45d7-8274-0378c1414ac2 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:25.311873 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad32a99-7802-4f09-b09a-c3764b92d784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:25.312498 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad32a99-7802-4f09-b09a-c3764b92d784 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:25.312756 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad32a99-7802-4f09-b09a-c3764b92d784 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:25.313025 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad32a99-7802-4f09-b09a-c3764b92d784 None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:25.313687 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad32a99-7802-4f09-b09a-c3764b92d784 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:25.313984 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad32a99-7802-4f09-b09a-c3764b92d784 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:25.315333 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad32a99-7802-4f09-b09a-c3764b92d784 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:25.324639 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 217/438] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 03:16:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:25.328616 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad32a99-7802-4f09-b09a-c3764b92d784 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:25.380206 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:25.407363 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d13d62-36fd-45d7-8274-0378c1414ac2 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:25.435588 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad32a99-7802-4f09-b09a-c3764b92d784 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:25.442072 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fbe1ab-760a-40a1-8777-16677df6757c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:25.443077 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fbe1ab-760a-40a1-8777-16677df6757c None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:25.443362 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fbe1ab-760a-40a1-8777-16677df6757c None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:25.443673 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fbe1ab-760a-40a1-8777-16677df6757c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:25.454854 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:25.469706 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1468d54f-2d52-4450-9bb6-876703ff2071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:25.470498 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1468d54f-2d52-4450-9bb6-876703ff2071 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:25.470775 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1468d54f-2d52-4450-9bb6-876703ff2071 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:25.471044 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1468d54f-2d52-4450-9bb6-876703ff2071 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:25.471793 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1468d54f-2d52-4450-9bb6-876703ff2071 None admin] RBAC: Adding query filter params (group.id=71f5ef5217c5400ca03ddd5e37fdc5f1, role.id=f2332a9a00b74fe0846d7211dd3850cb, scope.project.id=a7dc4038bbe8418c9837b329ac4d2754) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:25.472095 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1468d54f-2d52-4450-9bb6-876703ff2071 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:25.473500 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1468d54f-2d52-4450-9bb6-876703ff2071 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:25.479061 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 218/439] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Oct 4 03:16:25 2022] GET /identity/v3/role_assignments?group.id=71f5ef5217c5400ca03ddd5e37fdc5f1&scope.project.id=a7dc4038bbe8418c9837b329ac4d2754&role.id=f2332a9a00b74fe0846d7211dd3850cb => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:25.479855 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1468d54f-2d52-4450-9bb6-876703ff2071 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:25.516910 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fbe1ab-760a-40a1-8777-16677df6757c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:25.518376 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fbe1ab-760a-40a1-8777-16677df6757c None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:25.601588 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1468d54f-2d52-4450-9bb6-876703ff2071 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:25.609578 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:25.641385 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd69d00-9fe7-48b3-adc7-5761849c44c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:25.642004 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd69d00-9fe7-48b3-adc7-5761849c44c8 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:25.642283 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd69d00-9fe7-48b3-adc7-5761849c44c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:25.642553 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd69d00-9fe7-48b3-adc7-5761849c44c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:25.649463 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 222/440] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 03:16:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 03:16:25.650797 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81157edf-d17a-4312-9313-c42c0e79c6d6 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:25.651089 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81157edf-d17a-4312-9313-c42c0e79c6d6 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:25.651364 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81157edf-d17a-4312-9313-c42c0e79c6d6 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:25.652765 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 223/441] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:16:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:16:25.657394 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81157edf-d17a-4312-9313-c42c0e79c6d6 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:25.708758 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:25.728534 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd69d00-9fe7-48b3-adc7-5761849c44c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:25.730145 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd69d00-9fe7-48b3-adc7-5761849c44c8 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:25.783016 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81157edf-d17a-4312-9313-c42c0e79c6d6 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:25.824783 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da57a3a9-1bcc-4d5c-b097-56654c2fcdb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:25.824783 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57a3a9-1bcc-4d5c-b097-56654c2fcdb7 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:25.825062 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57a3a9-1bcc-4d5c-b097-56654c2fcdb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:25.825282 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57a3a9-1bcc-4d5c-b097-56654c2fcdb7 None admin] PATH_INFO: `/v3/projects/dcddf7d31429427a8d46e49ef77bbe82` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:25.827587 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da57a3a9-1bcc-4d5c-b097-56654c2fcdb7 None admin] RBAC: Authorizing `identity:get_project(project_id=dcddf7d31429427a8d46e49ef77bbe82)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:25.829023 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da57a3a9-1bcc-4d5c-b097-56654c2fcdb7 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:25.830635 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 224/442] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 03:16:25 2022] GET /identity/v3/projects/dcddf7d31429427a8d46e49ef77bbe82 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:25.831928 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f53f35-e018-4c4b-8818-762ac3021a83 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:25.832211 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f53f35-e018-4c4b-8818-762ac3021a83 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:25.832481 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f53f35-e018-4c4b-8818-762ac3021a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:25.848910 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 219/443] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 03:16:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 03:16:25.849755 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd69d00-9fe7-48b3-adc7-5761849c44c8 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:25.856782 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-80f53f35-e018-4c4b-8818-762ac3021a83 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:16:25.858253 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-80f53f35-e018-4c4b-8818-762ac3021a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:16:25.894326 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:25.925543 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 225/444] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:16:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 03:16:25.926364 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f53f35-e018-4c4b-8818-762ac3021a83 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:25.936983 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:25.953729 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd69d00-9fe7-48b3-adc7-5761849c44c8 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:25.988687 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0e4e05-a8a3-462b-9eeb-3bbfddec2449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:25.989293 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e4e05-a8a3-462b-9eeb-3bbfddec2449 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:25.989511 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e4e05-a8a3-462b-9eeb-3bbfddec2449 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:25.989782 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e4e05-a8a3-462b-9eeb-3bbfddec2449 None admin] PATH_INFO: `/v3/groups/71f5ef5217c5400ca03ddd5e37fdc5f1` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:25.990882 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0e4e05-a8a3-462b-9eeb-3bbfddec2449 None admin] RBAC: Authorizing `identity:get_group(group_id=71f5ef5217c5400ca03ddd5e37fdc5f1)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:25.993023 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0e4e05-a8a3-462b-9eeb-3bbfddec2449 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:25.994790 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 220/445] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Oct 4 03:16:25 2022] GET /identity/v3/groups/71f5ef5217c5400ca03ddd5e37fdc5f1 => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:26.000273 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0e4e05-a8a3-462b-9eeb-3bbfddec2449 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:26.047520 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f53f35-e018-4c4b-8818-762ac3021a83 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:26.083892 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf0f77-4247-4163-8c94-f1724b5afa51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:26.084513 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf0f77-4247-4163-8c94-f1724b5afa51 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:26.084791 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf0f77-4247-4163-8c94-f1724b5afa51 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:26.085144 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf0f77-4247-4163-8c94-f1724b5afa51 None admin] PATH_INFO: `/v3/projects/dcddf7d31429427a8d46e49ef77bbe82` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:26.086214 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcf0f77-4247-4163-8c94-f1724b5afa51 None admin] RBAC: Authorizing `identity:get_project(project_id=dcddf7d31429427a8d46e49ef77bbe82)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:26.087695 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcf0f77-4247-4163-8c94-f1724b5afa51 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:26.089427 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 226/446] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 03:16:25 2022] GET /identity/v3/projects/dcddf7d31429427a8d46e49ef77bbe82 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:26.094637 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf0f77-4247-4163-8c94-f1724b5afa51 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:26.101318 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0e4e05-a8a3-462b-9eeb-3bbfddec2449 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:26.138115 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:26.141464 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ae397-5b98-4b9f-b4e4-f07f605759c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:26.142196 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ae397-5b98-4b9f-b4e4-f07f605759c0 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:26.142414 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ae397-5b98-4b9f-b4e4-f07f605759c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:26.142690 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ae397-5b98-4b9f-b4e4-f07f605759c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:26.143413 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925ae397-5b98-4b9f-b4e4-f07f605759c0 None admin] RBAC: Adding query filter params (group.id=71f5ef5217c5400ca03ddd5e37fdc5f1, role.id=04d0e4575a28440eb4349b4a6565e8b8, scope.project.id=dcddf7d31429427a8d46e49ef77bbe82) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:26.143764 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925ae397-5b98-4b9f-b4e4-f07f605759c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:26.145199 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925ae397-5b98-4b9f-b4e4-f07f605759c0 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:26.151825 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 221/447] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Oct 4 03:16:25 2022] GET /identity/v3/role_assignments?group.id=71f5ef5217c5400ca03ddd5e37fdc5f1&scope.project.id=dcddf7d31429427a8d46e49ef77bbe82&role.id=04d0e4575a28440eb4349b4a6565e8b8 => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:16:26.199393 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ae397-5b98-4b9f-b4e4-f07f605759c0 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:26.202603 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf0f77-4247-4163-8c94-f1724b5afa51 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:26.223650 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:26.244083 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0006ee07-0087-4fcf-a5a7-812f9bb37cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:26.244795 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0006ee07-0087-4fcf-a5a7-812f9bb37cf8 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:26.245074 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0006ee07-0087-4fcf-a5a7-812f9bb37cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:26.245349 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0006ee07-0087-4fcf-a5a7-812f9bb37cf8 None admin] PATH_INFO: `/v3/groups/71f5ef5217c5400ca03ddd5e37fdc5f1` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:26.246737 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0006ee07-0087-4fcf-a5a7-812f9bb37cf8 None admin] RBAC: Authorizing `identity:get_group(group_id=71f5ef5217c5400ca03ddd5e37fdc5f1)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:26.248109 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0006ee07-0087-4fcf-a5a7-812f9bb37cf8 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:26.254585 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 227/448] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Oct 4 03:16:26 2022] GET /identity/v3/groups/71f5ef5217c5400ca03ddd5e37fdc5f1 => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:16:26.255726 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0006ee07-0087-4fcf-a5a7-812f9bb37cf8 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:26.321241 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ae397-5b98-4b9f-b4e4-f07f605759c0 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:26.364367 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34305031-451b-43bf-8906-9ec1bc936cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:26.365000 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34305031-451b-43bf-8906-9ec1bc936cc4 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:26.365359 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34305031-451b-43bf-8906-9ec1bc936cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:26.365553 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34305031-451b-43bf-8906-9ec1bc936cc4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:26.370051 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0006ee07-0087-4fcf-a5a7-812f9bb37cf8 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:26.378627 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34305031-451b-43bf-8906-9ec1bc936cc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:16:26.382534 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:26.384992 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-34305031-451b-43bf-8906-9ec1bc936cc4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 03:16:26.384992 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:26.384992 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:26.384992 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:26.384992 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:26.384992 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:26.384992 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:26.384992 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:26.384992 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:26.384992 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:26.384992 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:26.384992 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:26.384992 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:16:26.384992 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:16:26.384992 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:16:26.384992 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:16:26.385864 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:16:26.385864 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:16:26.385864 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:16:26.385864 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:16:26.385864 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:26.385864 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:26.385864 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:26.385864 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:26.385864 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:26.385864 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:26.385864 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:26.385864 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:26.385864 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:26.385864 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:26.385864 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:26.385864 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:26.386656 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:26.386656 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:26.386656 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:26.386656 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:26.386656 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:16:26.386656 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:16:26.386656 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:16:26.386656 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:16:26.386656 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:16:26.386656 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:16:26.386656 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 03:16:26.386656 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:16:26.386656 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 222/449] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 4 03:16:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 03:16:26.391996 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34305031-451b-43bf-8906-9ec1bc936cc4 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:26.418387 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19b99ba-5bf4-437b-81fa-79dec2a35739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:26.419007 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b99ba-5bf4-437b-81fa-79dec2a35739 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:26.419297 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b99ba-5bf4-437b-81fa-79dec2a35739 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:26.419617 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b99ba-5bf4-437b-81fa-79dec2a35739 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:26.420337 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19b99ba-5bf4-437b-81fa-79dec2a35739 None admin] RBAC: Adding query filter params (group.id=71f5ef5217c5400ca03ddd5e37fdc5f1, role.id=f2332a9a00b74fe0846d7211dd3850cb, scope.project.id=dcddf7d31429427a8d46e49ef77bbe82) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:26.420644 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19b99ba-5bf4-437b-81fa-79dec2a35739 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:26.422083 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19b99ba-5bf4-437b-81fa-79dec2a35739 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:26.429781 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 228/450] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Oct 4 03:16:26 2022] GET /identity/v3/role_assignments?group.id=71f5ef5217c5400ca03ddd5e37fdc5f1&scope.project.id=dcddf7d31429427a8d46e49ef77bbe82&role.id=f2332a9a00b74fe0846d7211dd3850cb => generated 611 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:26.490700 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:26.521303 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34305031-451b-43bf-8906-9ec1bc936cc4 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:26.559370 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd1b45b-df80-4b2c-a44b-bbc63925b80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:26.560776 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd1b45b-df80-4b2c-a44b-bbc63925b80b None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:26.560776 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd1b45b-df80-4b2c-a44b-bbc63925b80b None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:26.560776 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd1b45b-df80-4b2c-a44b-bbc63925b80b None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:26.561287 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd1b45b-df80-4b2c-a44b-bbc63925b80b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:26.561594 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd1b45b-df80-4b2c-a44b-bbc63925b80b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:26.562992 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd1b45b-df80-4b2c-a44b-bbc63925b80b None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:26.573329 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 223/451] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 03:16:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:16:26.579215 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19b99ba-5bf4-437b-81fa-79dec2a35739 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:26.691112 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19b99ba-5bf4-437b-81fa-79dec2a35739 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:26.726326 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5538bce8-14d6-48a6-b63b-d7a5f2539ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:26.726918 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538bce8-14d6-48a6-b63b-d7a5f2539ba5 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:26.727197 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538bce8-14d6-48a6-b63b-d7a5f2539ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:26.727466 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538bce8-14d6-48a6-b63b-d7a5f2539ba5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:26.767813 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:26.794919 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5538bce8-14d6-48a6-b63b-d7a5f2539ba5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:26.796326 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5538bce8-14d6-48a6-b63b-d7a5f2539ba5 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:26.892469 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 229/452] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 03:16:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 04 03:16:26.898342 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd1b45b-df80-4b2c-a44b-bbc63925b80b None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:26.995928 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd1b45b-df80-4b2c-a44b-bbc63925b80b None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:27.028153 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ef1160-8b2a-4d0b-88c3-fc97d84adaf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:27.028752 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef1160-8b2a-4d0b-88c3-fc97d84adaf0 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:27.029029 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef1160-8b2a-4d0b-88c3-fc97d84adaf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:27.029302 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef1160-8b2a-4d0b-88c3-fc97d84adaf0 None admin] PATH_INFO: `/v3/projects/1f0f8d5c867d4d0e8de6fcf13db59693` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:27.030392 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ef1160-8b2a-4d0b-88c3-fc97d84adaf0 None admin] RBAC: Authorizing `identity:get_project(project_id=1f0f8d5c867d4d0e8de6fcf13db59693)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:27.031830 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ef1160-8b2a-4d0b-88c3-fc97d84adaf0 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:27.033394 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 224/453] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 03:16:26 2022] GET /identity/v3/projects/1f0f8d5c867d4d0e8de6fcf13db59693 => generated 344 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:27.038786 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5538bce8-14d6-48a6-b63b-d7a5f2539ba5 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:27.108161 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:27.135555 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5538bce8-14d6-48a6-b63b-d7a5f2539ba5 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:27.168347 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be490cf-bf3c-4dcd-9174-a7dae02a4451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:27.168971 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be490cf-bf3c-4dcd-9174-a7dae02a4451 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:27.169255 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be490cf-bf3c-4dcd-9174-a7dae02a4451 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:27.169529 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be490cf-bf3c-4dcd-9174-a7dae02a4451 None admin] PATH_INFO: `/v3/groups/a73388c7228149fd865c757c373668d0` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:27.170637 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be490cf-bf3c-4dcd-9174-a7dae02a4451 None admin] RBAC: Authorizing `identity:get_group(group_id=a73388c7228149fd865c757c373668d0)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:27.172093 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be490cf-bf3c-4dcd-9174-a7dae02a4451 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:27.173647 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 230/454] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Oct 4 03:16:27 2022] GET /identity/v3/groups/a73388c7228149fd865c757c373668d0 => generated 229 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:27.179520 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ef1160-8b2a-4d0b-88c3-fc97d84adaf0 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:27.188540 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:27.279049 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ef1160-8b2a-4d0b-88c3-fc97d84adaf0 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:27.311400 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac92ae4-d370-4f8f-92fe-945d0acf6c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:27.312014 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac92ae4-d370-4f8f-92fe-945d0acf6c50 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:27.312298 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac92ae4-d370-4f8f-92fe-945d0acf6c50 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:27.312575 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac92ae4-d370-4f8f-92fe-945d0acf6c50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:27.313292 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac92ae4-d370-4f8f-92fe-945d0acf6c50 None admin] RBAC: Adding query filter params (group.id=a73388c7228149fd865c757c373668d0, role.id=fe9379cda35c4ff78576fe48b60bea3c, scope.project.id=1f0f8d5c867d4d0e8de6fcf13db59693) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:27.313603 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac92ae4-d370-4f8f-92fe-945d0acf6c50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:27.315018 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac92ae4-d370-4f8f-92fe-945d0acf6c50 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:27.321415 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 225/455] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Oct 4 03:16:27 2022] GET /identity/v3/role_assignments?group.id=a73388c7228149fd865c757c373668d0&scope.project.id=1f0f8d5c867d4d0e8de6fcf13db59693&role.id=fe9379cda35c4ff78576fe48b60bea3c => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:29.898029 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda4a9d-b70e-454e-b4d8-5070af2c75ea None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:29.899299 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda4a9d-b70e-454e-b4d8-5070af2c75ea None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:29.899808 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda4a9d-b70e-454e-b4d8-5070af2c75ea None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:29.901354 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 231/456] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:16:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:16:29.906877 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1004353-a1e5-41b4-94e7-16845d3fbacd None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:29.907697 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1004353-a1e5-41b4-94e7-16845d3fbacd None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:29.908172 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1004353-a1e5-41b4-94e7-16845d3fbacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:29.932012 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-e1004353-a1e5-41b4-94e7-16845d3fbacd None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:16:29.933184 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-e1004353-a1e5-41b4-94e7-16845d3fbacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:16:30.020362 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:30.029774 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 226/457] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:16:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 03:16:30.174435 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed196e-82ef-496e-afc7-29df709feb83 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:30.174693 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed196e-82ef-496e-afc7-29df709feb83 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:30.174904 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed196e-82ef-496e-afc7-29df709feb83 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:30.176656 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 232/458] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:16:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:16:30.182877 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1def4-20c7-4bf6-9514-35574b42be96 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:30.183328 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1def4-20c7-4bf6-9514-35574b42be96 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:30.183771 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1def4-20c7-4bf6-9514-35574b42be96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:30.208584 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-80b1def4-20c7-4bf6-9514-35574b42be96 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:16:30.210585 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-80b1def4-20c7-4bf6-9514-35574b42be96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:16:30.302800 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 227/459] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:16:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 03:16:30.412112 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56081d4b-fd29-457e-b71c-5c20fcab1c4c None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:30.412638 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56081d4b-fd29-457e-b71c-5c20fcab1c4c None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:30.413919 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56081d4b-fd29-457e-b71c-5c20fcab1c4c None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:30.415527 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 233/460] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:16:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:16:30.420660 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c124b18b-a44c-4d24-8c55-eebd371126e5 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:30.420950 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c124b18b-a44c-4d24-8c55-eebd371126e5 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:30.421226 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c124b18b-a44c-4d24-8c55-eebd371126e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:30.424010 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56081d4b-fd29-457e-b71c-5c20fcab1c4c None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:30.448724 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-c124b18b-a44c-4d24-8c55-eebd371126e5 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:16:30.449844 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-c124b18b-a44c-4d24-8c55-eebd371126e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:16:30.559739 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 228/461] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:16:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 03:16:30.577138 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56081d4b-fd29-457e-b71c-5c20fcab1c4c None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:30.656661 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b151fe-b248-4b68-baa8-7a11e93397ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:30.657299 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b151fe-b248-4b68-baa8-7a11e93397ce None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:30.657584 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b151fe-b248-4b68-baa8-7a11e93397ce None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:30.657859 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b151fe-b248-4b68-baa8-7a11e93397ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:30.679589 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b151fe-b248-4b68-baa8-7a11e93397ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:30.681046 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b151fe-b248-4b68-baa8-7a11e93397ce None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:30.683792 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:30.700508 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-86b151fe-b248-4b68-baa8-7a11e93397ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:16:30.700508 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:30.700508 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:30.700508 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:30.700508 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:30.700508 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:30.700508 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:30.700508 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:30.700508 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:30.700508 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:30.700508 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:30.700508 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:30.700508 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 03:16:30.700508 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 03:16:30.700508 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 03:16:30.700508 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 03:16:30.701447 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:30.701447 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:30.701447 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:30.701447 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:30.701447 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:30.701447 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:30.701447 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:30.701447 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:30.701447 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:30.701447 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:30.701447 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:30.701447 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:30.701447 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:30.701447 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:30.701447 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:30.701447 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:30.701447 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 03:16:30.702276 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 03:16:30.702276 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:16:30.702276 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:16:30.704373 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 234/462] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:16:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:30.710744 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c124b18b-a44c-4d24-8c55-eebd371126e5 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:30.742568 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b151fe-b248-4b68-baa8-7a11e93397ce None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:30.843872 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:30.889966 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c124b18b-a44c-4d24-8c55-eebd371126e5 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:30.918429 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b151fe-b248-4b68-baa8-7a11e93397ce None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:30.926033 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e465745-616b-4e8a-8b68-e212b222b951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:30.926630 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e465745-616b-4e8a-8b68-e212b222b951 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:30.926908 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e465745-616b-4e8a-8b68-e212b222b951 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:30.927175 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e465745-616b-4e8a-8b68-e212b222b951 None admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:30.927947 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e465745-616b-4e8a-8b68-e212b222b951 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:30.928243 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e465745-616b-4e8a-8b68-e212b222b951 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:30.930180 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e465745-616b-4e8a-8b68-e212b222b951 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:30.952943 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 229/463] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 03:16:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:30.952943 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e465745-616b-4e8a-8b68-e212b222b951 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:30.959797 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0416795-8235-45d5-b96d-66e33ba109a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:30.960722 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0416795-8235-45d5-b96d-66e33ba109a7 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:30.961073 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0416795-8235-45d5-b96d-66e33ba109a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:30.961352 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0416795-8235-45d5-b96d-66e33ba109a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:30.972419 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0416795-8235-45d5-b96d-66e33ba109a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:30.973858 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0416795-8235-45d5-b96d-66e33ba109a7 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:30.988466 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-d0416795-8235-45d5-b96d-66e33ba109a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:16:30.988466 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:30.988466 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:30.988466 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:30.988466 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:30.988466 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:30.988466 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:30.988466 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:30.988466 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:30.988466 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:30.988466 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:30.988466 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:30.988466 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 03:16:30.988466 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 03:16:30.988466 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 03:16:30.988466 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 03:16:30.989552 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:30.989552 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:30.989552 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:30.989552 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:30.989552 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:30.989552 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:30.989552 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:30.989552 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:30.989552 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:30.989552 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:30.989552 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:30.989552 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:30.989552 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:30.989552 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:30.989552 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:30.989552 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:30.989552 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 03:16:30.990599 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 03:16:30.990599 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:16:30.990599 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:16:30.993189 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 235/464] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:16:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:30.994522 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7336a-8d8b-4427-9a93-1c35b867f33b None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:30.994806 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7336a-8d8b-4427-9a93-1c35b867f33b None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:30.995079 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7336a-8d8b-4427-9a93-1c35b867f33b None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:30.996390 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 236/465] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:16:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:16:30.997203 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e7336a-8d8b-4427-9a93-1c35b867f33b None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:31.049618 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:31.057958 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e465745-616b-4e8a-8b68-e212b222b951 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:31.082248 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:31.100092 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4988283a-722b-483a-bb8e-3e4166cc1e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:31.101338 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988283a-722b-483a-bb8e-3e4166cc1e87 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:31.101618 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988283a-722b-483a-bb8e-3e4166cc1e87 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:31.102079 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988283a-722b-483a-bb8e-3e4166cc1e87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:31.110718 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e7336a-8d8b-4427-9a93-1c35b867f33b None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:31.113945 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4988283a-722b-483a-bb8e-3e4166cc1e87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:31.115423 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4988283a-722b-483a-bb8e-3e4166cc1e87 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:31.133356 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-4988283a-722b-483a-bb8e-3e4166cc1e87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:16:31.133356 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:31.133356 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:31.133356 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:31.133356 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:31.133356 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:31.133356 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:31.133356 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:31.133356 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:31.133356 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:31.133356 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:31.133356 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:31.133356 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 03:16:31.133356 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 03:16:31.133356 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 03:16:31.133356 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 03:16:31.134347 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:31.134347 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:31.134347 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:31.134347 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:31.134347 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:31.134347 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:31.134347 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:31.134347 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:31.134347 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:31.134347 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:31.134347 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:31.134347 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:31.134347 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:31.134347 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:31.134347 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:31.134347 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:31.134347 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 03:16:31.135164 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 03:16:31.135164 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:16:31.135164 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:16:31.135164 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 230/466] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:16:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:31.135383 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4988283a-722b-483a-bb8e-3e4166cc1e87 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:31.153858 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9856658f-ace4-4758-a879-39423df8af0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:31.154466 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856658f-ace4-4758-a879-39423df8af0d None admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:31.154748 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856658f-ace4-4758-a879-39423df8af0d None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:31.155023 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856658f-ace4-4758-a879-39423df8af0d None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:31.155847 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9856658f-ace4-4758-a879-39423df8af0d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:31.157580 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9856658f-ace4-4758-a879-39423df8af0d None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:31.187945 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 237/467] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Oct 4 03:16:30 2022] POST /identity/v3/users => generated 246 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:16:31.190083 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92168ee3-6c9c-4ccd-ad4e-3980f4be1ef8 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:31.190397 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92168ee3-6c9c-4ccd-ad4e-3980f4be1ef8 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:31.190807 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92168ee3-6c9c-4ccd-ad4e-3980f4be1ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:31.218710 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-92168ee3-6c9c-4ccd-ad4e-3980f4be1ef8 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:16:31.221146 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-92168ee3-6c9c-4ccd-ad4e-3980f4be1ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:16:31.256088 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4988283a-722b-483a-bb8e-3e4166cc1e87 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:31.296552 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a8675-3564-4d55-8597-01bc033477ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:31.297614 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a8675-3564-4d55-8597-01bc033477ef None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:31.298104 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a8675-3564-4d55-8597-01bc033477ef None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:31.298788 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a8675-3564-4d55-8597-01bc033477ef None admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:31.299767 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36a8675-3564-4d55-8597-01bc033477ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:31.300290 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36a8675-3564-4d55-8597-01bc033477ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:31.301901 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36a8675-3564-4d55-8597-01bc033477ef None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:31.319584 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 231/468] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 03:16:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:31.319772 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 238/469] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:16:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 03:16:31.319772 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92168ee3-6c9c-4ccd-ad4e-3980f4be1ef8 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:31.323646 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a8675-3564-4d55-8597-01bc033477ef None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:31.354788 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:31.388807 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:31.454068 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92168ee3-6c9c-4ccd-ad4e-3980f4be1ef8 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:31.478867 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a8675-3564-4d55-8597-01bc033477ef None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:31.499519 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a37873d-c232-402b-98b1-48178f4c12af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:31.500543 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a37873d-c232-402b-98b1-48178f4c12af None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:31.500826 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a37873d-c232-402b-98b1-48178f4c12af None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:31.501098 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a37873d-c232-402b-98b1-48178f4c12af None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:31.501746 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a37873d-c232-402b-98b1-48178f4c12af None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:31.502048 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a37873d-c232-402b-98b1-48178f4c12af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:31.504010 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a37873d-c232-402b-98b1-48178f4c12af None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:31.518557 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 239/470] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 03:16:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:31.518752 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee7857d-ca5f-44fe-893f-cc732ed3c3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:31.519129 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7857d-ca5f-44fe-893f-cc732ed3c3bc None admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:31.519411 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7857d-ca5f-44fe-893f-cc732ed3c3bc None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:31.519724 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7857d-ca5f-44fe-893f-cc732ed3c3bc None admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:31.520371 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee7857d-ca5f-44fe-893f-cc732ed3c3bc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:31.520759 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d85c2-7a20-4b79-8ac3-d5d0dfdbc83c None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:31.521046 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d85c2-7a20-4b79-8ac3-d5d0dfdbc83c None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:31.521324 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d85c2-7a20-4b79-8ac3-d5d0dfdbc83c None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:31.521792 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee7857d-ca5f-44fe-893f-cc732ed3c3bc None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:31.525052 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 240/471] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:16:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:16:31.529086 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f6baec-a8fa-44ae-bc91-a99512701a3f None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:31.529371 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f6baec-a8fa-44ae-bc91-a99512701a3f None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:31.529649 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f6baec-a8fa-44ae-bc91-a99512701a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:31.547901 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 232/472] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Oct 4 03:16:31 2022] POST /identity/v3/users => generated 248 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:16:31.548760 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee7857d-ca5f-44fe-893f-cc732ed3c3bc None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:31.558446 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-e3f6baec-a8fa-44ae-bc91-a99512701a3f None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:16:31.559694 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-e3f6baec-a8fa-44ae-bc91-a99512701a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:16:31.677928 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 241/473] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:16:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 03:16:31.679928 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f6baec-a8fa-44ae-bc91-a99512701a3f None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:31.708758 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:31.736272 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:31.762917 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee7857d-ca5f-44fe-893f-cc732ed3c3bc None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:31.810546 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571648e9-4b2c-4cb4-806d-6ba01c703c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:31.811531 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571648e9-4b2c-4cb4-806d-6ba01c703c22 None admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:31.811735 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571648e9-4b2c-4cb4-806d-6ba01c703c22 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:31.811994 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571648e9-4b2c-4cb4-806d-6ba01c703c22 None admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:31.813060 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571648e9-4b2c-4cb4-806d-6ba01c703c22 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:31.814517 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571648e9-4b2c-4cb4-806d-6ba01c703c22 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:31.833373 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f6baec-a8fa-44ae-bc91-a99512701a3f None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:31.849473 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 233/474] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Oct 4 03:16:31 2022] POST /identity/v3/users => generated 248 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:16:31.878015 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ba8aff-8ce6-4c41-9e8f-b1b2df085cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:31.878695 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba8aff-8ce6-4c41-9e8f-b1b2df085cfb None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:31.878980 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba8aff-8ce6-4c41-9e8f-b1b2df085cfb None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:31.879253 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba8aff-8ce6-4c41-9e8f-b1b2df085cfb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:31.891812 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ba8aff-8ce6-4c41-9e8f-b1b2df085cfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:31.893360 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ba8aff-8ce6-4c41-9e8f-b1b2df085cfb None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:31.910642 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-59ba8aff-8ce6-4c41-9e8f-b1b2df085cfb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:16:31.910642 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:31.910642 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:31.910642 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:31.910642 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:31.910642 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:31.910642 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:31.910642 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:31.910642 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:31.910642 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:31.910642 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:31.910642 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:31.910642 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 03:16:31.910642 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 03:16:31.910642 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 03:16:31.910642 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 03:16:31.911653 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:31.911653 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:31.911653 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:31.911653 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:31.911653 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:31.911653 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:31.911653 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:31.911653 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:31.911653 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:31.911653 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:31.911653 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:31.911653 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:31.911653 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:31.911653 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:31.911653 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:31.911653 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:31.911653 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 03:16:31.913452 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 03:16:31.913452 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:16:31.913452 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:16:31.913452 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 242/475] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:16:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:31.918903 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571648e9-4b2c-4cb4-806d-6ba01c703c22 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:32.023851 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ba8aff-8ce6-4c41-9e8f-b1b2df085cfb None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:32.039347 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571648e9-4b2c-4cb4-806d-6ba01c703c22 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:32.092074 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251fd6b6-7a64-4da8-b043-72e445783289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:32.092780 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251fd6b6-7a64-4da8-b043-72e445783289 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:32.093060 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251fd6b6-7a64-4da8-b043-72e445783289 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:32.093333 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251fd6b6-7a64-4da8-b043-72e445783289 None admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:32.093979 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251fd6b6-7a64-4da8-b043-72e445783289 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:32.094281 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251fd6b6-7a64-4da8-b043-72e445783289 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:32.095780 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251fd6b6-7a64-4da8-b043-72e445783289 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:32.110509 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 234/476] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 03:16:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:32.116674 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251fd6b6-7a64-4da8-b043-72e445783289 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:32.122453 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:32.123028 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:32.156211 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ba8aff-8ce6-4c41-9e8f-b1b2df085cfb None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:32.193589 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d3ff61-7b17-47c0-b57c-88ca0294be09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:32.194329 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3ff61-7b17-47c0-b57c-88ca0294be09 None admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:32.194613 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3ff61-7b17-47c0-b57c-88ca0294be09 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:32.195128 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3ff61-7b17-47c0-b57c-88ca0294be09 None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:32.195877 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d3ff61-7b17-47c0-b57c-88ca0294be09 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:32.197249 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d3ff61-7b17-47c0-b57c-88ca0294be09 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:32.207075 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.sql.core [None req-55d3ff61-7b17-47c0-b57c-88ca0294be09 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 04 03:16:32.207075 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 04 03:16:32.207075 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [parameters: {'id': '94a856f074cd498097c09136d8cd1865', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 04 03:16:32.207075 dv-cinder-849143-9-smb devstack@keystone.service[81379]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81379) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 04 03:16:32.226193 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-55d3ff61-7b17-47c0-b57c-88ca0294be09 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 04 03:16:32.226193 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:32.226193 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 03:16:32.226193 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 04 03:16:32.226193 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 03:16:32.226193 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 04 03:16:32.226193 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 03:16:32.226193 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application result = self._query(query) Oct 04 03:16:32.226193 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 03:16:32.226193 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application conn.query(q) Oct 04 03:16:32.226193 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 03:16:32.226193 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 03:16:32.226193 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 03:16:32.226193 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application result.read() Oct 04 03:16:32.226193 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 03:16:32.227126 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 04 03:16:32.227126 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 03:16:32.227126 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 04 03:16:32.227126 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 03:16:32.227126 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 04 03:16:32.227126 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 03:16:32.227126 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 04 03:16:32.227126 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 04 03:16:32.227126 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:16:32.227126 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 04 03:16:32.227126 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:16:32.227126 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:32.227126 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 04 03:16:32.227126 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 04 03:16:32.227126 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 04 03:16:32.227126 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return ref.to_dict() Oct 04 03:16:32.227126 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 04 03:16:32.227126 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application next(self.gen) Oct 04 03:16:32.232608 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 04 03:16:32.232608 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application yield resource Oct 04 03:16:32.232608 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 04 03:16:32.232608 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application next(self.gen) Oct 04 03:16:32.232608 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 04 03:16:32.232608 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self.session.rollback() Oct 04 03:16:32.232608 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 03:16:32.232608 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self.force_reraise() Oct 04 03:16:32.232608 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 03:16:32.232608 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise self.value Oct 04 03:16:32.232608 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 04 03:16:32.232608 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 04 03:16:32.232608 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 04 03:16:32.232608 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application session.commit() Oct 04 03:16:32.232608 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 04 03:16:32.232608 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 04 03:16:32.232608 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 04 03:16:32.233504 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self._prepare_impl() Oct 04 03:16:32.233504 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 04 03:16:32.233504 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self.session.flush() Oct 04 03:16:32.233504 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 04 03:16:32.233504 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self._flush(objects) Oct 04 03:16:32.233504 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 04 03:16:32.233504 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 04 03:16:32.233504 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 04 03:16:32.233504 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application compat.raise_( Oct 04 03:16:32.233504 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 03:16:32.233504 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception Oct 04 03:16:32.233504 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 04 03:16:32.233504 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application flush_context.execute() Oct 04 03:16:32.233504 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 04 03:16:32.233504 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rec.execute(self) Oct 04 03:16:32.233504 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 04 03:16:32.233504 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 04 03:16:32.234347 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 04 03:16:32.234347 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 04 03:16:32.234347 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 04 03:16:32.234347 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 04 03:16:32.234347 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 04 03:16:32.234347 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 04 03:16:32.234347 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 04 03:16:32.234347 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 04 03:16:32.234347 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 04 03:16:32.234347 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 04 03:16:32.234347 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 04 03:16:32.234347 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 04 03:16:32.234347 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 04 03:16:32.234347 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 04 03:16:32.234347 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 03:16:32.234347 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception Oct 04 03:16:32.237501 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 03:16:32.237501 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 04 03:16:32.237501 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 03:16:32.237501 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 04 03:16:32.237501 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 03:16:32.237501 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application result = self._query(query) Oct 04 03:16:32.237501 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 03:16:32.237501 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application conn.query(q) Oct 04 03:16:32.237501 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 03:16:32.237501 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 03:16:32.237501 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 03:16:32.237501 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application result.read() Oct 04 03:16:32.237501 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 03:16:32.237501 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 04 03:16:32.237501 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 03:16:32.237501 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 04 03:16:32.239311 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 03:16:32.239311 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 04 03:16:32.239311 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 03:16:32.239311 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 04 03:16:32.239311 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 04 03:16:32.239311 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 04 03:16:32.239311 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [parameters: {'id': '94a856f074cd498097c09136d8cd1865', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 04 03:16:32.239311 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 04 03:16:32.239311 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:16:32.239311 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 03:16:32.239311 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:16:32.239311 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:32.239311 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:32.239311 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:32.239311 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:32.239311 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:32.241700 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:32.241700 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:32.241700 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:32.241700 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:32.241700 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:32.241700 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:32.241700 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 04 03:16:32.241700 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 04 03:16:32.241700 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:32.241700 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:32.241700 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 04 03:16:32.241700 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 04 03:16:32.241700 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 04 03:16:32.241700 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 04 03:16:32.241700 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 04 03:16:32.241700 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:16:32.246205 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 243/477] 10.222.0.25 () {60 vars in 1131 bytes} [Tue Oct 4 03:16:32 2022] POST /identity/v3/roles => generated 144 bytes in 204 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 04 03:16:32.247311 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d3ff61-7b17-47c0-b57c-88ca0294be09 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:32.290966 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251fd6b6-7a64-4da8-b043-72e445783289 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:32.344998 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f196a0-b812-4717-8e60-6dbf89675349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:32.345709 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f196a0-b812-4717-8e60-6dbf89675349 None admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:32.346056 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f196a0-b812-4717-8e60-6dbf89675349 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:32.346391 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f196a0-b812-4717-8e60-6dbf89675349 None admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:32.347699 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f196a0-b812-4717-8e60-6dbf89675349 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:32.349662 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f196a0-b812-4717-8e60-6dbf89675349 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:32.380440 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 235/478] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Oct 4 03:16:32 2022] POST /identity/v3/users => generated 249 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:16:32.383022 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d3ff61-7b17-47c0-b57c-88ca0294be09 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:32.433085 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d72758d-9f74-46bd-b721-30833978f34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:32.434214 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72758d-9f74-46bd-b721-30833978f34c None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:32.434896 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72758d-9f74-46bd-b721-30833978f34c None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:32.435689 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72758d-9f74-46bd-b721-30833978f34c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:32.444773 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:32.458664 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d72758d-9f74-46bd-b721-30833978f34c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:16:32.467048 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-1d72758d-9f74-46bd-b721-30833978f34c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 03:16:32.467048 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:32.467048 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:32.467048 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:32.467048 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:32.467048 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:32.467048 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:32.467048 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:32.467048 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:32.467048 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:32.467048 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:32.467048 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:32.467048 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:16:32.467048 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:16:32.467048 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:16:32.467048 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:16:32.468058 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:16:32.468058 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:16:32.468058 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:16:32.468058 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:16:32.468058 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:32.468058 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:32.468058 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:32.468058 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:32.468058 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:32.468058 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:32.468058 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:32.468058 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:32.468058 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:32.468058 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:32.468058 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:32.468058 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:32.468847 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:32.468847 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:32.468847 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:32.468847 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:32.468847 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:16:32.468847 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:16:32.468847 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:16:32.468847 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:16:32.468847 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:16:32.468847 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:16:32.468847 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 03:16:32.468847 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:16:32.468847 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 244/479] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Oct 4 03:16:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:32.474705 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f196a0-b812-4717-8e60-6dbf89675349 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:32.558608 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:32.623003 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f196a0-b812-4717-8e60-6dbf89675349 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:32.680314 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693512ac-88d7-41e9-8aec-c0a533a59c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:32.680933 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693512ac-88d7-41e9-8aec-c0a533a59c06 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:32.681215 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693512ac-88d7-41e9-8aec-c0a533a59c06 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:32.681491 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693512ac-88d7-41e9-8aec-c0a533a59c06 None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:32.682170 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693512ac-88d7-41e9-8aec-c0a533a59c06 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:32.682474 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693512ac-88d7-41e9-8aec-c0a533a59c06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:32.683910 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693512ac-88d7-41e9-8aec-c0a533a59c06 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:32.697807 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 236/480] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 03:16:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:33.949823 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9089b69e-2be2-4709-a307-4ec54d66aec2 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:33.950826 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9089b69e-2be2-4709-a307-4ec54d66aec2 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:33.951306 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9089b69e-2be2-4709-a307-4ec54d66aec2 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:33.953112 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 245/481] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:16:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:16:33.958106 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20598ec0-9164-436f-9770-87db0f67767d None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:33.958894 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20598ec0-9164-436f-9770-87db0f67767d None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:33.959383 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20598ec0-9164-436f-9770-87db0f67767d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:33.980459 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-20598ec0-9164-436f-9770-87db0f67767d None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:16:33.988353 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-20598ec0-9164-436f-9770-87db0f67767d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:16:34.077870 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 237/482] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:16:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 03:16:34.417015 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8ad53a-769a-49f2-9dd4-604ffed8ef33 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:34.417976 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8ad53a-769a-49f2-9dd4-604ffed8ef33 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:34.418478 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8ad53a-769a-49f2-9dd4-604ffed8ef33 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:34.420411 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 246/483] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:16:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:16:34.425333 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c3dc77-73c6-440b-8dd9-aba3813d4b59 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:34.425837 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c3dc77-73c6-440b-8dd9-aba3813d4b59 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:34.426315 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c3dc77-73c6-440b-8dd9-aba3813d4b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:34.447281 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-a4c3dc77-73c6-440b-8dd9-aba3813d4b59 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:16:34.448785 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-a4c3dc77-73c6-440b-8dd9-aba3813d4b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:16:34.473197 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8ad53a-769a-49f2-9dd4-604ffed8ef33 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:34.519722 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:34.586801 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 238/484] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:16:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 03:16:34.589126 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8ad53a-769a-49f2-9dd4-604ffed8ef33 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:34.625518 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef0a608-3b5c-4923-a22e-2d849b663a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:34.626538 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef0a608-3b5c-4923-a22e-2d849b663a97 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:34.627013 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef0a608-3b5c-4923-a22e-2d849b663a97 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:34.627476 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef0a608-3b5c-4923-a22e-2d849b663a97 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:34.641368 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef0a608-3b5c-4923-a22e-2d849b663a97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:16:34.646659 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-0ef0a608-3b5c-4923-a22e-2d849b663a97 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 03:16:34.646659 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:34.646659 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:34.646659 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:34.646659 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:34.646659 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:34.646659 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:34.646659 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:34.646659 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:34.646659 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:34.646659 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:34.646659 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:34.646659 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:16:34.646659 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:16:34.646659 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:16:34.646659 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:16:34.648221 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:16:34.648221 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:16:34.648221 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:16:34.648221 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:16:34.648221 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:34.648221 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:34.648221 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:34.648221 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:34.648221 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:34.648221 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:34.648221 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:34.648221 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:34.648221 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:34.648221 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:34.648221 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:34.648221 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:34.649005 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:34.649005 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:34.649005 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:34.649005 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:34.649005 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:16:34.649005 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:16:34.649005 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:16:34.649005 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:16:34.649005 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:16:34.649005 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:16:34.649005 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 03:16:34.649005 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:16:34.651893 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 247/485] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Oct 4 03:16:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 03:16:34.658196 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c3dc77-73c6-440b-8dd9-aba3813d4b59 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:34.766465 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb8c65-56ed-4f81-862c-f3d9d36d9ba9 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:34.766793 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb8c65-56ed-4f81-862c-f3d9d36d9ba9 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:34.767042 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb8c65-56ed-4f81-862c-f3d9d36d9ba9 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:34.768625 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 248/486] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:16:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:16:34.773626 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac0cd1-0ba1-49de-83de-31a150d9d18a None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:34.773913 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac0cd1-0ba1-49de-83de-31a150d9d18a None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:34.774186 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac0cd1-0ba1-49de-83de-31a150d9d18a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:34.776086 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c3dc77-73c6-440b-8dd9-aba3813d4b59 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:34.792701 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-9fac0cd1-0ba1-49de-83de-31a150d9d18a None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:16:34.793977 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-9fac0cd1-0ba1-49de-83de-31a150d9d18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:16:34.823161 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb87991e-59a9-491a-9a61-ed170a22564d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:34.823868 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb87991e-59a9-491a-9a61-ed170a22564d None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:34.824151 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb87991e-59a9-491a-9a61-ed170a22564d None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:34.824420 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb87991e-59a9-491a-9a61-ed170a22564d None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:34.825082 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb87991e-59a9-491a-9a61-ed170a22564d None admin] RBAC: Adding query filter params (name=service) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:34.825383 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb87991e-59a9-491a-9a61-ed170a22564d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:34.826818 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb87991e-59a9-491a-9a61-ed170a22564d None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:34.835678 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 239/487] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Oct 4 03:16:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:34.847922 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb87991e-59a9-491a-9a61-ed170a22564d None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:34.864923 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:34.876421 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 249/488] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:16:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 03:16:34.918685 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:34.996079 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb87991e-59a9-491a-9a61-ed170a22564d None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:35.036346 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f7403f-ce07-44e9-896e-317ad8373d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:35.037274 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f7403f-ce07-44e9-896e-317ad8373d07 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:35.038512 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f7403f-ce07-44e9-896e-317ad8373d07 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:35.039105 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f7403f-ce07-44e9-896e-317ad8373d07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:35.050131 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f7403f-ce07-44e9-896e-317ad8373d07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:35.057035 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f7403f-ce07-44e9-896e-317ad8373d07 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:35.074484 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-e1f7403f-ce07-44e9-896e-317ad8373d07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:16:35.074484 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:35.074484 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:35.074484 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:35.074484 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:35.074484 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:35.074484 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:35.074484 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:35.074484 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:35.074484 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:35.074484 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:35.074484 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:35.074484 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 03:16:35.074484 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 03:16:35.074484 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 03:16:35.074484 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 03:16:35.075403 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:35.075403 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:35.075403 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:35.075403 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:35.075403 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:35.075403 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:35.075403 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:35.075403 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:35.075403 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:35.075403 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:35.075403 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:35.075403 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:35.075403 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:35.075403 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:35.075403 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:35.075403 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:35.075403 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 03:16:35.076308 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 03:16:35.076308 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:16:35.076308 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:16:35.078085 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 240/489] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:16:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:35.083885 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac0cd1-0ba1-49de-83de-31a150d9d18a None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:35.096734 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f7403f-ce07-44e9-896e-317ad8373d07 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:35.211423 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:35.221683 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f7403f-ce07-44e9-896e-317ad8373d07 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:35.236223 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac0cd1-0ba1-49de-83de-31a150d9d18a None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:35.271865 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27770a7-d1d1-4a86-9048-469a28912d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:35.272982 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67e5907-aeb7-4d5c-a6fc-92644c917e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:35.273585 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e5907-aeb7-4d5c-a6fc-92644c917e82 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:35.273866 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e5907-aeb7-4d5c-a6fc-92644c917e82 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:35.274139 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e5907-aeb7-4d5c-a6fc-92644c917e82 None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:35.274326 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27770a7-d1d1-4a86-9048-469a28912d16 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:35.274783 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67e5907-aeb7-4d5c-a6fc-92644c917e82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:35.274893 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27770a7-d1d1-4a86-9048-469a28912d16 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:35.275081 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67e5907-aeb7-4d5c-a6fc-92644c917e82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:35.275536 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27770a7-d1d1-4a86-9048-469a28912d16 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:35.276679 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67e5907-aeb7-4d5c-a6fc-92644c917e82 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:35.288878 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27770a7-d1d1-4a86-9048-469a28912d16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:16:35.293334 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 250/490] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 03:16:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:35.294245 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67e5907-aeb7-4d5c-a6fc-92644c917e82 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:35.295325 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-c27770a7-d1d1-4a86-9048-469a28912d16 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 03:16:35.295325 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:35.295325 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:35.295325 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:35.295325 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:35.295325 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:35.295325 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:35.295325 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:35.295325 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:35.295325 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:35.295325 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:35.295325 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:35.295325 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:16:35.295325 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:16:35.295325 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:16:35.295325 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:16:35.296324 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:16:35.296324 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:16:35.296324 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:16:35.296324 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:16:35.296324 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:35.296324 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:35.296324 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:35.296324 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:35.296324 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:35.296324 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:35.296324 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:35.296324 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:35.296324 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:35.296324 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:35.296324 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:35.296324 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:35.297109 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:35.297109 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:35.297109 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:35.297109 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:35.297109 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:16:35.297109 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:16:35.297109 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:16:35.297109 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:16:35.297109 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:16:35.297109 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:16:35.297109 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 03:16:35.297109 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:16:35.300770 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 241/491] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Oct 4 03:16:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:35.306650 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27770a7-d1d1-4a86-9048-469a28912d16 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:35.365403 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:35.437357 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67e5907-aeb7-4d5c-a6fc-92644c917e82 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:35.444489 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27770a7-d1d1-4a86-9048-469a28912d16 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:35.475367 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d837720-06ac-4833-bf36-762d0099b1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:35.476125 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d837720-06ac-4833-bf36-762d0099b1bd None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:35.476416 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d837720-06ac-4833-bf36-762d0099b1bd None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:35.476674 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d837720-06ac-4833-bf36-762d0099b1bd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:35.480373 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa57b42-5155-46e0-a5fb-788ca031a2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:35.480988 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa57b42-5155-46e0-a5fb-788ca031a2d3 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:35.481266 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa57b42-5155-46e0-a5fb-788ca031a2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:35.481544 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa57b42-5155-46e0-a5fb-788ca031a2d3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:35.487323 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d837720-06ac-4833-bf36-762d0099b1bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:16:35.489256 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa57b42-5155-46e0-a5fb-788ca031a2d3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:35.490677 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa57b42-5155-46e0-a5fb-788ca031a2d3 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:35.493195 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-4d837720-06ac-4833-bf36-762d0099b1bd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 03:16:35.493195 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:35.493195 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:35.493195 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:35.493195 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:35.493195 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:35.493195 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:35.493195 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:35.493195 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:35.493195 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:35.493195 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:35.493195 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:35.493195 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:16:35.493195 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:16:35.493195 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:16:35.493195 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:16:35.494102 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:16:35.494102 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:16:35.494102 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:16:35.494102 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:16:35.494102 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:35.494102 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:35.494102 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:35.494102 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:35.494102 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:35.494102 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:35.494102 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:35.494102 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:35.494102 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:35.494102 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:35.494102 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:35.494102 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:35.494932 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:35.494932 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:35.494932 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:35.494932 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:35.494932 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:16:35.494932 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:16:35.494932 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:16:35.494932 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:16:35.494932 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:16:35.494932 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:16:35.494932 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 03:16:35.494932 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:16:35.494932 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 251/492] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Oct 4 03:16:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:35.495651 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d837720-06ac-4833-bf36-762d0099b1bd None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:35.514960 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-dfa57b42-5155-46e0-a5fb-788ca031a2d3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 03:16:35.514960 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:35.514960 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:35.514960 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:35.514960 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:35.514960 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:35.514960 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:35.514960 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:35.514960 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:35.514960 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:35.514960 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:35.514960 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:35.514960 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 03:16:35.514960 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 03:16:35.514960 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 03:16:35.514960 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 03:16:35.515981 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:35.515981 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:35.515981 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 03:16:35.515981 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 03:16:35.515981 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 03:16:35.515981 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 03:16:35.515981 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:35.515981 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:35.515981 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:35.515981 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:35.515981 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:35.515981 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:35.515981 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:35.515981 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:35.515981 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:35.515981 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:35.515981 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:35.515981 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:35.516877 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:35.516877 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:35.516877 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 03:16:35.516877 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 03:16:35.516877 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 03:16:35.516877 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 03:16:35.516877 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 03:16:35.516877 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 03:16:35.516877 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 03:16:35.516877 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:16:35.516877 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 242/493] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Oct 4 03:16:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:35.518217 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b0462-9bdf-4942-aaa6-fefcd3fb4000 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:35.518498 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b0462-9bdf-4942-aaa6-fefcd3fb4000 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:35.518832 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b0462-9bdf-4942-aaa6-fefcd3fb4000 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:35.520435 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 243/494] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:16:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:16:35.525589 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551b0462-9bdf-4942-aaa6-fefcd3fb4000 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:35.546792 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:35.612569 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d837720-06ac-4833-bf36-762d0099b1bd None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:35.621067 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:35.640477 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551b0462-9bdf-4942-aaa6-fefcd3fb4000 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:35.650300 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb70e68-971e-42dc-b930-4c811e8263be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:35.650898 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb70e68-971e-42dc-b930-4c811e8263be None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:35.651190 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb70e68-971e-42dc-b930-4c811e8263be None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:35.651457 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb70e68-971e-42dc-b930-4c811e8263be None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:35.652148 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb70e68-971e-42dc-b930-4c811e8263be None admin] RBAC: Adding query filter params (name=service) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:35.652451 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb70e68-971e-42dc-b930-4c811e8263be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:35.653792 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb70e68-971e-42dc-b930-4c811e8263be None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:35.666545 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 252/495] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Oct 4 03:16:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:35.666545 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb70e68-971e-42dc-b930-4c811e8263be None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:35.674815 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bd7298-d9a8-4a1c-b464-5867d9f15b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:35.675414 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd7298-d9a8-4a1c-b464-5867d9f15b0e None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:35.675721 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd7298-d9a8-4a1c-b464-5867d9f15b0e None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:35.675994 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd7298-d9a8-4a1c-b464-5867d9f15b0e None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:35.676660 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bd7298-d9a8-4a1c-b464-5867d9f15b0e None admin] RBAC: Adding query filter params (name=service) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:35.676969 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bd7298-d9a8-4a1c-b464-5867d9f15b0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:35.678367 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bd7298-d9a8-4a1c-b464-5867d9f15b0e None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:35.686734 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 244/496] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Oct 4 03:16:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:35.687892 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50203d-6346-43b1-8303-82e2b06d3d44 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:35.688178 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50203d-6346-43b1-8303-82e2b06d3d44 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:35.688452 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50203d-6346-43b1-8303-82e2b06d3d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:35.705758 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-ee50203d-6346-43b1-8303-82e2b06d3d44 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:16:35.706950 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-ee50203d-6346-43b1-8303-82e2b06d3d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:16:35.768858 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb70e68-971e-42dc-b930-4c811e8263be None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:35.773168 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 245/497] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:16:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 03:16:35.774455 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4387229-76d4-4edd-821c-34cdac48f1c0 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:35.774748 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4387229-76d4-4edd-821c-34cdac48f1c0 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:35.775020 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4387229-76d4-4edd-821c-34cdac48f1c0 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:35.776421 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 246/498] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:16:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:16:35.780518 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4387229-76d4-4edd-821c-34cdac48f1c0 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:35.792492 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:35.806028 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f5062-0b7b-4036-b5cf-7423932ad1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:35.806876 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f5062-0b7b-4036-b5cf-7423932ad1d6 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:35.807160 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f5062-0b7b-4036-b5cf-7423932ad1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:35.807452 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f5062-0b7b-4036-b5cf-7423932ad1d6 None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:35.808445 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502f5062-0b7b-4036-b5cf-7423932ad1d6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:35.808573 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502f5062-0b7b-4036-b5cf-7423932ad1d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:35.809910 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502f5062-0b7b-4036-b5cf-7423932ad1d6 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:35.853105 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 253/499] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Oct 4 03:16:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:35.853105 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f5062-0b7b-4036-b5cf-7423932ad1d6 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:35.880371 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:35.893312 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4387229-76d4-4edd-821c-34cdac48f1c0 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:35.929396 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ffd1e-53f6-4eb9-b802-564ccf14edd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:35.930016 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ffd1e-53f6-4eb9-b802-564ccf14edd6 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:35.930296 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ffd1e-53f6-4eb9-b802-564ccf14edd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:35.930568 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ffd1e-53f6-4eb9-b802-564ccf14edd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:35.940773 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693ffd1e-53f6-4eb9-b802-564ccf14edd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:35.942223 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693ffd1e-53f6-4eb9-b802-564ccf14edd6 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:35.958435 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-693ffd1e-53f6-4eb9-b802-564ccf14edd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:16:35.958435 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:35.958435 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:35.958435 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:35.958435 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:35.958435 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:35.958435 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:35.958435 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:35.958435 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:35.958435 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:35.958435 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:35.958435 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:35.958435 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 03:16:35.958435 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 03:16:35.958435 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 03:16:35.958435 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 03:16:35.959424 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:35.959424 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:35.959424 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:35.959424 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:35.959424 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:35.959424 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:35.959424 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:35.959424 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:35.959424 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:35.959424 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:35.959424 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:35.959424 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:35.959424 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:35.959424 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:35.959424 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:35.959424 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:35.959424 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 03:16:35.960961 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 03:16:35.960961 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:16:35.960961 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:16:35.961591 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f5062-0b7b-4036-b5cf-7423932ad1d6 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:35.964535 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 247/500] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:16:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:35.965728 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5f84d-435a-4040-9b54-73e17385fcbe None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:35.966011 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5f84d-435a-4040-9b54-73e17385fcbe None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:35.966286 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5f84d-435a-4040-9b54-73e17385fcbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:35.984390 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-9ae5f84d-435a-4040-9b54-73e17385fcbe None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:16:35.985572 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-9ae5f84d-435a-4040-9b54-73e17385fcbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:16:36.002021 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4595e7b1-6514-471f-9970-706cf6f0d357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:36.002639 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4595e7b1-6514-471f-9970-706cf6f0d357 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:36.002918 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4595e7b1-6514-471f-9970-706cf6f0d357 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:36.003253 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4595e7b1-6514-471f-9970-706cf6f0d357 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:36.014639 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4595e7b1-6514-471f-9970-706cf6f0d357 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:36.016066 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4595e7b1-6514-471f-9970-706cf6f0d357 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:36.031595 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-4595e7b1-6514-471f-9970-706cf6f0d357 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:16:36.031595 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:36.031595 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:36.031595 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:36.031595 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:36.031595 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:36.031595 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:36.031595 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:36.031595 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:36.031595 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:36.031595 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:36.031595 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:36.031595 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 03:16:36.031595 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 03:16:36.031595 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 03:16:36.031595 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 03:16:36.032535 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:36.032535 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:36.032535 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:36.032535 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:36.032535 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:36.032535 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:36.032535 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:36.032535 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:36.032535 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:36.032535 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:36.032535 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:36.032535 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:36.032535 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:36.032535 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:36.032535 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:36.032535 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:36.032535 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 03:16:36.033371 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 03:16:36.033371 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:16:36.033371 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:16:36.035632 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 254/501] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:16:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:36.037064 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4595e7b1-6514-471f-9970-706cf6f0d357 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:36.049012 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:36.062880 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 248/502] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:16:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 03:16:36.063674 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae5f84d-435a-4040-9b54-73e17385fcbe None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:36.127503 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:36.154102 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4595e7b1-6514-471f-9970-706cf6f0d357 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:36.166249 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae5f84d-435a-4040-9b54-73e17385fcbe None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:36.189035 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02be1841-548f-4141-91f5-1f51f15c1435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:36.189898 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be1841-548f-4141-91f5-1f51f15c1435 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:36.190181 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be1841-548f-4141-91f5-1f51f15c1435 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:36.190454 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be1841-548f-4141-91f5-1f51f15c1435 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:36.202429 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0338a989-ac78-4be8-a8d5-5b7b8073ef5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:36.203022 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338a989-ac78-4be8-a8d5-5b7b8073ef5e None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:36.203293 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338a989-ac78-4be8-a8d5-5b7b8073ef5e None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:36.203950 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338a989-ac78-4be8-a8d5-5b7b8073ef5e None admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:36.204586 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0338a989-ac78-4be8-a8d5-5b7b8073ef5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:36.205223 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0338a989-ac78-4be8-a8d5-5b7b8073ef5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:36.206552 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0338a989-ac78-4be8-a8d5-5b7b8073ef5e None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:36.218603 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 249/503] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 03:16:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:36.219664 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0338a989-ac78-4be8-a8d5-5b7b8073ef5e None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:36.271594 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02be1841-548f-4141-91f5-1f51f15c1435 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:36.273522 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02be1841-548f-4141-91f5-1f51f15c1435 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:36.278988 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:36.330467 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0338a989-ac78-4be8-a8d5-5b7b8073ef5e None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:36.354387 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:36.364792 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61102872-a9b1-4238-ac00-3fe0e8bd8ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:36.365392 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61102872-a9b1-4238-ac00-3fe0e8bd8ec5 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:36.365668 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61102872-a9b1-4238-ac00-3fe0e8bd8ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:36.366570 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61102872-a9b1-4238-ac00-3fe0e8bd8ec5 None admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:36.367257 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61102872-a9b1-4238-ac00-3fe0e8bd8ec5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:36.367585 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61102872-a9b1-4238-ac00-3fe0e8bd8ec5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:36.368938 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61102872-a9b1-4238-ac00-3fe0e8bd8ec5 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:36.376929 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 255/504] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 03:16:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 03:16:36.377801 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02be1841-548f-4141-91f5-1f51f15c1435 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:36.385068 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 250/505] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 03:16:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:36.385921 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61102872-a9b1-4238-ac00-3fe0e8bd8ec5 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:36.478153 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02be1841-548f-4141-91f5-1f51f15c1435 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:36.482208 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61102872-a9b1-4238-ac00-3fe0e8bd8ec5 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:36.493194 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:36.511933 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637af0e-e652-43d6-bae2-d6e27b5ec496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:36.512548 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637af0e-e652-43d6-bae2-d6e27b5ec496 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:36.512823 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637af0e-e652-43d6-bae2-d6e27b5ec496 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:36.513094 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637af0e-e652-43d6-bae2-d6e27b5ec496 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:36.516622 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea818079-51c9-49d8-b027-406501783f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:36.517242 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea818079-51c9-49d8-b027-406501783f89 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:36.517522 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea818079-51c9-49d8-b027-406501783f89 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:36.517795 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea818079-51c9-49d8-b027-406501783f89 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:36.523324 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c637af0e-e652-43d6-bae2-d6e27b5ec496 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:16:36.524803 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea818079-51c9-49d8-b027-406501783f89 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:36.526244 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea818079-51c9-49d8-b027-406501783f89 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:36.528058 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-c637af0e-e652-43d6-bae2-d6e27b5ec496 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 03:16:36.528058 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:36.528058 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:36.528058 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:36.528058 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:36.528058 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:36.528058 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:36.528058 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:36.528058 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:36.528058 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:36.528058 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:36.528058 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:36.528058 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:16:36.528058 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:16:36.528058 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:16:36.528058 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:16:36.529157 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:16:36.529157 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:16:36.529157 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:16:36.529157 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:16:36.529157 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:36.529157 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:36.529157 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:36.529157 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:36.529157 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:36.529157 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:36.529157 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:36.529157 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:36.529157 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:36.529157 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:36.529157 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:36.529157 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:36.532433 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:36.532433 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:36.532433 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:36.532433 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:36.532433 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:16:36.532433 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:16:36.532433 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:16:36.532433 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:16:36.532433 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:16:36.532433 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:16:36.532433 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 03:16:36.532433 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:16:36.532433 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 256/506] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Oct 4 03:16:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:36.532433 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637af0e-e652-43d6-bae2-d6e27b5ec496 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:36.539692 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-ea818079-51c9-49d8-b027-406501783f89 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 04 03:16:36.539692 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:36.539692 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:36.539692 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:36.539692 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:36.539692 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:36.539692 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:36.539692 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:36.539692 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:36.539692 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:36.539692 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:36.539692 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:36.539692 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 03:16:36.539692 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 03:16:36.539692 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 03:16:36.539692 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 03:16:36.540566 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:36.540566 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:36.540566 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 03:16:36.540566 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 03:16:36.540566 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 03:16:36.540566 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 03:16:36.540566 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:36.540566 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:36.540566 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:36.540566 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:36.540566 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:36.540566 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:36.540566 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:36.540566 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:36.540566 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:36.540566 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:36.540566 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:36.540566 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:36.541431 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:36.541431 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:36.541431 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 03:16:36.541431 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 03:16:36.541431 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 03:16:36.541431 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 03:16:36.541431 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 03:16:36.541431 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 03:16:36.541431 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 04 03:16:36.541431 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:16:36.541431 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 251/507] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 03:16:36 2022] GET /identity/v3/users/glance => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:36.541979 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea818079-51c9-49d8-b027-406501783f89 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:36.573876 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:36.635792 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637af0e-e652-43d6-bae2-d6e27b5ec496 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:36.648468 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea818079-51c9-49d8-b027-406501783f89 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:36.670358 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb7e17-2bb2-43ef-9214-5be984c8c22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:36.670979 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb7e17-2bb2-43ef-9214-5be984c8c22d None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:36.671322 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb7e17-2bb2-43ef-9214-5be984c8c22d None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:36.671633 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb7e17-2bb2-43ef-9214-5be984c8c22d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:36.682096 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c661132-0f5b-4c33-a6f9-0d907eca52e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:36.682371 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edb7e17-2bb2-43ef-9214-5be984c8c22d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:36.682704 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c661132-0f5b-4c33-a6f9-0d907eca52e9 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:36.682982 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c661132-0f5b-4c33-a6f9-0d907eca52e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:36.683252 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c661132-0f5b-4c33-a6f9-0d907eca52e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:36.683853 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edb7e17-2bb2-43ef-9214-5be984c8c22d None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:36.693469 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c661132-0f5b-4c33-a6f9-0d907eca52e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:36.695270 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c661132-0f5b-4c33-a6f9-0d907eca52e9 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:36.699417 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-5edb7e17-2bb2-43ef-9214-5be984c8c22d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:16:36.699417 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:36.699417 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:36.699417 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:36.699417 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:36.699417 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:36.699417 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:36.699417 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:36.699417 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:36.699417 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:36.699417 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:36.699417 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:36.699417 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 03:16:36.699417 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 03:16:36.699417 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 03:16:36.699417 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 03:16:36.700363 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:36.700363 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:36.700363 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:36.700363 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:36.700363 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:36.700363 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:36.700363 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:36.700363 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:36.700363 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:36.700363 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:36.700363 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:36.700363 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:36.700363 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:36.700363 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:36.700363 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:36.700363 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:36.700363 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 03:16:36.701200 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 03:16:36.701200 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:16:36.701200 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:16:36.701200 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 257/508] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:16:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:36.701424 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb7e17-2bb2-43ef-9214-5be984c8c22d None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:36.712219 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-2c661132-0f5b-4c33-a6f9-0d907eca52e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:16:36.712219 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:36.712219 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:36.712219 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:36.712219 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:36.712219 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:36.712219 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:36.712219 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:36.712219 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:36.712219 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:36.712219 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:36.712219 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:36.712219 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 03:16:36.712219 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 03:16:36.712219 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 03:16:36.712219 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 03:16:36.713285 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:36.713285 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:36.713285 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:36.713285 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:36.713285 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:36.713285 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:36.713285 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:36.713285 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:36.713285 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:36.713285 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:36.713285 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:36.713285 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:36.713285 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:36.713285 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:36.713285 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:36.713285 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:36.713285 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 03:16:36.714140 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 03:16:36.714140 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:16:36.714140 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:16:36.714140 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 252/509] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:16:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:36.714140 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c661132-0f5b-4c33-a6f9-0d907eca52e9 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:36.739679 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:36.795922 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:36.806588 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb7e17-2bb2-43ef-9214-5be984c8c22d None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:36.815370 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c661132-0f5b-4c33-a6f9-0d907eca52e9 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:36.839609 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7625cc83-4145-4dac-ba11-4fdc25b9b4de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:36.840221 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625cc83-4145-4dac-ba11-4fdc25b9b4de None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:36.840497 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625cc83-4145-4dac-ba11-4fdc25b9b4de None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:36.840767 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625cc83-4145-4dac-ba11-4fdc25b9b4de None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:36.848633 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7625cc83-4145-4dac-ba11-4fdc25b9b4de None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:36.849437 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b4d559-0828-4120-b2f6-61c14ce50824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:36.850032 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b4d559-0828-4120-b2f6-61c14ce50824 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:36.850133 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7625cc83-4145-4dac-ba11-4fdc25b9b4de None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:36.850533 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b4d559-0828-4120-b2f6-61c14ce50824 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:36.850853 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b4d559-0828-4120-b2f6-61c14ce50824 None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:36.851541 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b4d559-0828-4120-b2f6-61c14ce50824 None admin] RBAC: Adding query filter params (name=service) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:36.851854 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b4d559-0828-4120-b2f6-61c14ce50824 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:36.853246 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b4d559-0828-4120-b2f6-61c14ce50824 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:36.861028 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 253/510] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Oct 4 03:16:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:36.866441 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b4d559-0828-4120-b2f6-61c14ce50824 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:36.866532 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-7625cc83-4145-4dac-ba11-4fdc25b9b4de None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 03:16:36.866532 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:36.866532 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:36.866532 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:36.866532 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:36.866532 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:36.866532 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:36.866532 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:36.866532 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:36.866532 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:36.866532 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:36.866532 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:36.866532 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 03:16:36.866532 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 03:16:36.866532 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 03:16:36.866532 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 03:16:36.867595 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:36.867595 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:36.867595 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 03:16:36.867595 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 03:16:36.867595 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 03:16:36.867595 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 03:16:36.867595 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:36.867595 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:36.867595 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:36.867595 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:36.867595 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:36.867595 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:36.867595 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:36.867595 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:36.867595 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:36.867595 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:36.867595 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:36.867595 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:36.868481 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:36.868481 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:36.868481 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 03:16:36.868481 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 03:16:36.868481 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 03:16:36.868481 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 03:16:36.868481 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 03:16:36.868481 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 03:16:36.868481 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 03:16:36.868481 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:16:36.868481 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 258/511] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 03:16:36 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:36.868481 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7625cc83-4145-4dac-ba11-4fdc25b9b4de None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:36.950301 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:36.963981 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7625cc83-4145-4dac-ba11-4fdc25b9b4de None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:36.966291 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b4d559-0828-4120-b2f6-61c14ce50824 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:36.997685 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7e2770-b0a2-4a7d-b464-5a1685582e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:36.998277 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e2770-b0a2-4a7d-b464-5a1685582e71 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:36.998556 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e2770-b0a2-4a7d-b464-5a1685582e71 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:36.998824 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e2770-b0a2-4a7d-b464-5a1685582e71 None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:36.999451 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7e2770-b0a2-4a7d-b464-5a1685582e71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:36.999572 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d630999-90dc-4a14-a478-7b0232e8dea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:36.999780 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7e2770-b0a2-4a7d-b464-5a1685582e71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:37.000168 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d630999-90dc-4a14-a478-7b0232e8dea9 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:37.000451 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d630999-90dc-4a14-a478-7b0232e8dea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:37.000730 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d630999-90dc-4a14-a478-7b0232e8dea9 None admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:37.001132 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7e2770-b0a2-4a7d-b464-5a1685582e71 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:37.001449 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d630999-90dc-4a14-a478-7b0232e8dea9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:37.001757 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d630999-90dc-4a14-a478-7b0232e8dea9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:37.003555 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d630999-90dc-4a14-a478-7b0232e8dea9 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:37.013196 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 259/512] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 03:16:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:37.014276 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7e2770-b0a2-4a7d-b464-5a1685582e71 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:37.026800 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:37.040605 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 254/513] 10.222.0.25 () {56 vars in 1137 bytes} [Tue Oct 4 03:16:36 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:37.041515 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d630999-90dc-4a14-a478-7b0232e8dea9 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:37.114539 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7e2770-b0a2-4a7d-b464-5a1685582e71 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:37.140620 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d630999-90dc-4a14-a478-7b0232e8dea9 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:37.148567 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9b2f94-89eb-4f1a-885c-b595298e8fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:37.149162 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b2f94-89eb-4f1a-885c-b595298e8fa8 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:37.149440 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b2f94-89eb-4f1a-885c-b595298e8fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:37.149710 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b2f94-89eb-4f1a-885c-b595298e8fa8 None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:37.150337 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9b2f94-89eb-4f1a-885c-b595298e8fa8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:37.150636 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9b2f94-89eb-4f1a-885c-b595298e8fa8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:37.152014 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9b2f94-89eb-4f1a-885c-b595298e8fa8 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:37.163345 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 260/514] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 03:16:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:37.164156 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9b2f94-89eb-4f1a-885c-b595298e8fa8 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:37.175102 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b301c3-85a3-48c1-a442-f096005f2d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:37.175756 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b301c3-85a3-48c1-a442-f096005f2d67 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:37.176030 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b301c3-85a3-48c1-a442-f096005f2d67 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:37.176299 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b301c3-85a3-48c1-a442-f096005f2d67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:37.186858 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b301c3-85a3-48c1-a442-f096005f2d67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:37.188383 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b301c3-85a3-48c1-a442-f096005f2d67 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:37.190060 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:37.204527 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-08b301c3-85a3-48c1-a442-f096005f2d67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:16:37.204527 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:37.204527 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:37.204527 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:37.204527 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:37.204527 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:37.204527 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:37.204527 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:37.204527 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:37.204527 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:37.204527 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:37.204527 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:37.204527 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 03:16:37.204527 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 03:16:37.204527 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 03:16:37.204527 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 03:16:37.205404 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:37.205404 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:37.205404 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:37.205404 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:37.205404 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:37.205404 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:37.205404 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:37.205404 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:37.205404 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:37.205404 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:37.205404 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:37.205404 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:37.205404 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:37.205404 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:37.205404 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:37.205404 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:37.205404 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 03:16:37.206236 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 03:16:37.206236 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:16:37.206236 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:16:37.206236 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 255/515] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:16:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:37.206442 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b301c3-85a3-48c1-a442-f096005f2d67 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:37.238365 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:37.270278 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9b2f94-89eb-4f1a-885c-b595298e8fa8 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:37.302455 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e81e21-5e63-4e84-9c5b-9382e74ef80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:37.303046 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e81e21-5e63-4e84-9c5b-9382e74ef80e None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:37.303433 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e81e21-5e63-4e84-9c5b-9382e74ef80e None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:37.303807 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e81e21-5e63-4e84-9c5b-9382e74ef80e None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:37.304447 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e81e21-5e63-4e84-9c5b-9382e74ef80e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:37.304748 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e81e21-5e63-4e84-9c5b-9382e74ef80e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:37.306168 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e81e21-5e63-4e84-9c5b-9382e74ef80e None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:37.309038 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b301c3-85a3-48c1-a442-f096005f2d67 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:37.323425 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 261/516] 10.222.0.25 () {56 vars in 1137 bytes} [Tue Oct 4 03:16:37 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:37.324151 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e81e21-5e63-4e84-9c5b-9382e74ef80e None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:37.344359 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa087f4-6299-4a79-a957-6970d14126a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:37.344959 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa087f4-6299-4a79-a957-6970d14126a9 None admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:37.345241 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa087f4-6299-4a79-a957-6970d14126a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:37.345524 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa087f4-6299-4a79-a957-6970d14126a9 None admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:37.346164 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa087f4-6299-4a79-a957-6970d14126a9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:37.347625 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa087f4-6299-4a79-a957-6970d14126a9 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:37.369631 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 256/517] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Oct 4 03:16:37 2022] POST /identity/v3/users => generated 247 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:16:37.370438 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa087f4-6299-4a79-a957-6970d14126a9 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:37.434914 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e81e21-5e63-4e84-9c5b-9382e74ef80e None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:37.446895 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:37.468117 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:37.478127 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e720ff72-18b2-459f-a439-c69ae6d37bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:37.478874 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e720ff72-18b2-459f-a439-c69ae6d37bfd None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:37.480032 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e720ff72-18b2-459f-a439-c69ae6d37bfd None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:37.480656 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e720ff72-18b2-459f-a439-c69ae6d37bfd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:37.508241 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa087f4-6299-4a79-a957-6970d14126a9 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:37.549452 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668881d3-bd2c-4e33-9025-6b96096adaa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:37.550202 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668881d3-bd2c-4e33-9025-6b96096adaa8 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:37.550395 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668881d3-bd2c-4e33-9025-6b96096adaa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:37.550627 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668881d3-bd2c-4e33-9025-6b96096adaa8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:37.557184 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e720ff72-18b2-459f-a439-c69ae6d37bfd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:37.558654 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e720ff72-18b2-459f-a439-c69ae6d37bfd None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:37.559433 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668881d3-bd2c-4e33-9025-6b96096adaa8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:37.560447 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668881d3-bd2c-4e33-9025-6b96096adaa8 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:37.573122 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-668881d3-bd2c-4e33-9025-6b96096adaa8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 03:16:37.573122 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:37.573122 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:37.573122 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:37.573122 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:37.573122 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:37.573122 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:37.573122 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:37.573122 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:37.573122 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:37.573122 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:37.573122 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:37.573122 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 03:16:37.573122 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 03:16:37.573122 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 03:16:37.574140 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 03:16:37.574140 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:37.574140 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:37.574140 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:37.574140 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:37.574140 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:37.574140 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:37.574140 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:37.574140 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:37.574140 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:37.574140 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:37.574140 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:37.574140 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:37.574140 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:37.574140 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:37.574140 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:37.574140 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:37.575025 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 03:16:37.575025 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 03:16:37.575025 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 03:16:37.575025 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 03:16:37.575025 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 03:16:37.575025 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 03:16:37.575025 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 03:16:37.575025 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:16:37.575025 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 257/518] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 03:16:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:37.575025 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668881d3-bd2c-4e33-9025-6b96096adaa8 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:37.675473 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 262/519] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 03:16:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 03:16:37.680633 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e720ff72-18b2-459f-a439-c69ae6d37bfd None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:37.689594 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668881d3-bd2c-4e33-9025-6b96096adaa8 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:37.701284 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:37.711219 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:37.727386 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f466c255-c4d7-42e4-a607-363e47be85ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:37.727949 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f466c255-c4d7-42e4-a607-363e47be85ba None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:37.728233 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f466c255-c4d7-42e4-a607-363e47be85ba None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:37.728665 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f466c255-c4d7-42e4-a607-363e47be85ba None admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:37.729136 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f466c255-c4d7-42e4-a607-363e47be85ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:37.729442 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f466c255-c4d7-42e4-a607-363e47be85ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:37.730822 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f466c255-c4d7-42e4-a607-363e47be85ba None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:37.748275 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 258/520] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 03:16:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:37.748275 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f466c255-c4d7-42e4-a607-363e47be85ba None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:37.793081 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e720ff72-18b2-459f-a439-c69ae6d37bfd None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:37.828837 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4cfa73-948c-4a27-8e70-e31db0014ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:37.829434 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4cfa73-948c-4a27-8e70-e31db0014ac5 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:37.829716 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4cfa73-948c-4a27-8e70-e31db0014ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:37.829988 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4cfa73-948c-4a27-8e70-e31db0014ac5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:37.854254 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f466c255-c4d7-42e4-a607-363e47be85ba None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:37.893461 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b66aeb7-3463-48f1-b383-228d2452f24c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:37.894065 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b66aeb7-3463-48f1-b383-228d2452f24c None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:37.894344 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b66aeb7-3463-48f1-b383-228d2452f24c None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:37.894612 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b66aeb7-3463-48f1-b383-228d2452f24c None admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:37.895295 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b66aeb7-3463-48f1-b383-228d2452f24c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:37.895655 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b66aeb7-3463-48f1-b383-228d2452f24c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:37.897742 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b66aeb7-3463-48f1-b383-228d2452f24c None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:37.907808 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4cfa73-948c-4a27-8e70-e31db0014ac5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:37.909745 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4cfa73-948c-4a27-8e70-e31db0014ac5 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:37.916373 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 259/521] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 4 03:16:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:37.917194 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b66aeb7-3463-48f1-b383-228d2452f24c None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:37.939906 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:37.949108 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:38.021329 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b66aeb7-3463-48f1-b383-228d2452f24c None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:38.026849 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 263/522] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 03:16:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 03:16:38.026849 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4cfa73-948c-4a27-8e70-e31db0014ac5 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:38.061738 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f566fc-ac1a-43d2-857e-80c745dba176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:38.062366 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f566fc-ac1a-43d2-857e-80c745dba176 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:38.062650 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f566fc-ac1a-43d2-857e-80c745dba176 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:38.062923 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f566fc-ac1a-43d2-857e-80c745dba176 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:38.074178 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f566fc-ac1a-43d2-857e-80c745dba176 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:38.075669 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f566fc-ac1a-43d2-857e-80c745dba176 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:38.090093 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-d9f566fc-ac1a-43d2-857e-80c745dba176 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:16:38.090093 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:38.090093 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:38.090093 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:38.090093 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:38.090093 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:38.090093 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:38.090093 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:38.090093 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:38.090093 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:38.090093 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:38.090093 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:38.090093 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 03:16:38.090093 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 03:16:38.090093 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 03:16:38.090093 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 03:16:38.091014 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:38.091014 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:38.091014 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:38.091014 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:38.091014 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:38.091014 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:38.091014 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:38.091014 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:38.091014 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:38.091014 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:38.091014 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:38.091014 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:38.091014 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:38.091014 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:38.091014 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:38.091014 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:38.091014 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 03:16:38.092011 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 03:16:38.092011 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:16:38.092011 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:16:38.092011 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 260/523] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:16:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:38.092011 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f566fc-ac1a-43d2-857e-80c745dba176 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:38.136036 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4cfa73-948c-4a27-8e70-e31db0014ac5 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:38.162624 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:38.172806 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1191d0-2373-436e-a50d-c83ce1bf0a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:38.173427 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1191d0-2373-436e-a50d-c83ce1bf0a72 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:38.173704 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1191d0-2373-436e-a50d-c83ce1bf0a72 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:38.173974 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1191d0-2373-436e-a50d-c83ce1bf0a72 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:38.181681 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1191d0-2373-436e-a50d-c83ce1bf0a72 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:38.183111 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1191d0-2373-436e-a50d-c83ce1bf0a72 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:38.183713 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:38.196186 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-da1191d0-2373-436e-a50d-c83ce1bf0a72 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 04 03:16:38.196186 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:38.196186 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:38.196186 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:38.196186 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:38.196186 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:38.196186 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:38.196186 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:38.196186 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:38.196186 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:38.196186 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:38.196186 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:38.196186 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 03:16:38.196186 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 03:16:38.196186 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 03:16:38.196186 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 03:16:38.197129 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:38.197129 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:38.197129 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 03:16:38.197129 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 03:16:38.197129 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 03:16:38.197129 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 03:16:38.197129 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:38.197129 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:38.197129 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:38.197129 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:38.197129 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:38.197129 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:38.197129 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:38.197129 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:38.197129 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:38.197129 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:38.197129 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:38.197129 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:38.198022 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:38.198022 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:38.198022 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 03:16:38.198022 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 03:16:38.198022 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 03:16:38.198022 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 03:16:38.198022 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 03:16:38.198022 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 03:16:38.198022 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 04 03:16:38.198022 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:16:38.198022 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 264/524] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Oct 4 03:16:38 2022] GET /identity/v3/users/neutron => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:38.198022 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1191d0-2373-436e-a50d-c83ce1bf0a72 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:38.210574 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f566fc-ac1a-43d2-857e-80c745dba176 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:38.251164 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1125debb-39a0-47cd-a9d3-5a1d4e5b2a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:38.251782 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1125debb-39a0-47cd-a9d3-5a1d4e5b2a2b None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:38.252063 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1125debb-39a0-47cd-a9d3-5a1d4e5b2a2b None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:38.252338 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1125debb-39a0-47cd-a9d3-5a1d4e5b2a2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:38.253061 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1125debb-39a0-47cd-a9d3-5a1d4e5b2a2b None admin] RBAC: Adding query filter params (role.id=1f60934edaf04074936ff079756fc4a6, scope.project.id=80ae15e46620470b9c55fb7fe300fcb6, user.id=2c1f412befb9418fa66a2aabf475aa90) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:38.253370 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1125debb-39a0-47cd-a9d3-5a1d4e5b2a2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:38.254812 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1125debb-39a0-47cd-a9d3-5a1d4e5b2a2b None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:38.260704 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 261/525] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 03:16:38 2022] GET /identity/v3/role_assignments?user.id=2c1f412befb9418fa66a2aabf475aa90&scope.project.id=80ae15e46620470b9c55fb7fe300fcb6&role.id=1f60934edaf04074936ff079756fc4a6 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:38.261600 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1125debb-39a0-47cd-a9d3-5a1d4e5b2a2b None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:38.334387 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1191d0-2373-436e-a50d-c83ce1bf0a72 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:38.375159 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc020e8d-e21a-4948-9883-e6f00e0d8e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:38.375951 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc020e8d-e21a-4948-9883-e6f00e0d8e5e None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:38.376291 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc020e8d-e21a-4948-9883-e6f00e0d8e5e None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:38.376987 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc020e8d-e21a-4948-9883-e6f00e0d8e5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:38.388734 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc020e8d-e21a-4948-9883-e6f00e0d8e5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:38.390220 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc020e8d-e21a-4948-9883-e6f00e0d8e5e None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:38.400916 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1125debb-39a0-47cd-a9d3-5a1d4e5b2a2b None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:38.406904 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-fc020e8d-e21a-4948-9883-e6f00e0d8e5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:16:38.406904 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:38.406904 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:38.406904 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:38.406904 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:38.406904 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:38.406904 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:38.406904 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:38.406904 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:38.406904 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:38.406904 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:38.406904 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:38.406904 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 03:16:38.406904 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 03:16:38.406904 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 03:16:38.406904 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 03:16:38.408114 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:38.408114 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:38.408114 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:38.408114 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:38.408114 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:38.408114 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:38.408114 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:38.408114 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:38.408114 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:38.408114 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:38.408114 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:38.408114 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:38.408114 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:38.408114 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:38.408114 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:38.408114 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:38.408114 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 03:16:38.409047 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 03:16:38.409047 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:16:38.409047 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:16:38.409047 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 265/526] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:16:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:38.409271 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc020e8d-e21a-4948-9883-e6f00e0d8e5e None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:38.449050 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5d819a-8b95-4d1c-ae2f-cc1e210e0120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:38.450832 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d819a-8b95-4d1c-ae2f-cc1e210e0120 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:38.451262 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d819a-8b95-4d1c-ae2f-cc1e210e0120 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:38.451687 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d819a-8b95-4d1c-ae2f-cc1e210e0120 None admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:38.452461 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5d819a-8b95-4d1c-ae2f-cc1e210e0120 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:38.452771 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5d819a-8b95-4d1c-ae2f-cc1e210e0120 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:38.454135 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5d819a-8b95-4d1c-ae2f-cc1e210e0120 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:38.462890 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:38.470669 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 262/527] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 03:16:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:38.471330 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5d819a-8b95-4d1c-ae2f-cc1e210e0120 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:38.482458 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:38.522381 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc020e8d-e21a-4948-9883-e6f00e0d8e5e None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:38.557515 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f56138a-db07-4680-920d-d3873049db5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:38.558447 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f56138a-db07-4680-920d-d3873049db5c None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:38.558739 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f56138a-db07-4680-920d-d3873049db5c None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:38.559025 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f56138a-db07-4680-920d-d3873049db5c None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:38.559819 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f56138a-db07-4680-920d-d3873049db5c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:38.560137 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f56138a-db07-4680-920d-d3873049db5c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:38.561883 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f56138a-db07-4680-920d-d3873049db5c None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:38.581515 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 266/528] 10.222.0.25 () {56 vars in 1139 bytes} [Tue Oct 4 03:16:38 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:38.582352 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f56138a-db07-4680-920d-d3873049db5c None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:38.597647 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5d819a-8b95-4d1c-ae2f-cc1e210e0120 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:38.649234 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c57d03-78ed-4085-bbab-785ed5ba966c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:38.649853 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c57d03-78ed-4085-bbab-785ed5ba966c None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:38.650129 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c57d03-78ed-4085-bbab-785ed5ba966c None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:38.650396 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c57d03-78ed-4085-bbab-785ed5ba966c None admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:38.651141 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c57d03-78ed-4085-bbab-785ed5ba966c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:38.651316 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c57d03-78ed-4085-bbab-785ed5ba966c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:38.652721 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c57d03-78ed-4085-bbab-785ed5ba966c None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:38.669706 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 263/529] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 03:16:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:38.669706 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c57d03-78ed-4085-bbab-785ed5ba966c None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:38.719247 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:38.726582 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f56138a-db07-4680-920d-d3873049db5c None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:38.737422 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:38.769926 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada3efc6-a7fb-47f2-b7ba-7eddd64f0b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:38.770797 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3efc6-a7fb-47f2-b7ba-7eddd64f0b98 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:38.771261 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3efc6-a7fb-47f2-b7ba-7eddd64f0b98 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:38.772005 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3efc6-a7fb-47f2-b7ba-7eddd64f0b98 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:38.776068 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c57d03-78ed-4085-bbab-785ed5ba966c None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:38.780177 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada3efc6-a7fb-47f2-b7ba-7eddd64f0b98 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:38.781855 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada3efc6-a7fb-47f2-b7ba-7eddd64f0b98 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:38.795677 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-ada3efc6-a7fb-47f2-b7ba-7eddd64f0b98 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 03:16:38.795677 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:38.795677 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:38.795677 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:38.795677 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:38.795677 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:38.795677 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:38.795677 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:38.795677 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:38.795677 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:38.795677 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:38.795677 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:38.795677 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 03:16:38.795677 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 03:16:38.795677 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 03:16:38.796622 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 03:16:38.796622 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:38.796622 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:38.796622 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:38.796622 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:38.796622 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:38.796622 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:38.796622 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:38.796622 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:38.796622 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:38.796622 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:38.796622 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:38.796622 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:38.796622 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:38.796622 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:38.796622 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:38.796622 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:38.797460 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 03:16:38.797460 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 03:16:38.797460 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 03:16:38.797460 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 03:16:38.797460 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 03:16:38.797460 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 03:16:38.797460 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 03:16:38.797460 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:16:38.804082 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 267/530] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 03:16:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:38.804485 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada3efc6-a7fb-47f2-b7ba-7eddd64f0b98 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:38.818482 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6653d50b-af82-4aa8-bd16-fa7ee659ee9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:38.820383 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6653d50b-af82-4aa8-bd16-fa7ee659ee9c None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:38.820866 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6653d50b-af82-4aa8-bd16-fa7ee659ee9c None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:38.821340 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6653d50b-af82-4aa8-bd16-fa7ee659ee9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:38.899826 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6653d50b-af82-4aa8-bd16-fa7ee659ee9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:38.901654 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6653d50b-af82-4aa8-bd16-fa7ee659ee9c None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:38.929874 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada3efc6-a7fb-47f2-b7ba-7eddd64f0b98 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:38.967516 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda640d1-f56e-40b4-b014-6c809535504a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:38.968256 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda640d1-f56e-40b4-b014-6c809535504a None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:38.968596 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda640d1-f56e-40b4-b014-6c809535504a None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:38.968873 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda640d1-f56e-40b4-b014-6c809535504a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:38.977329 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda640d1-f56e-40b4-b014-6c809535504a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:38.978439 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:38.980300 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda640d1-f56e-40b4-b014-6c809535504a None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:38.998120 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-fda640d1-f56e-40b4-b014-6c809535504a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 03:16:38.998120 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:38.998120 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:38.998120 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:38.998120 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:38.998120 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:38.998120 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:38.998120 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:38.998120 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:38.998120 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:38.998120 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:38.998120 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:38.998120 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 03:16:38.998120 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 03:16:38.998120 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 03:16:38.999025 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 03:16:38.999025 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:38.999025 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:38.999025 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:38.999025 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:38.999025 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:38.999025 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:38.999025 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:38.999025 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:38.999025 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:38.999025 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:38.999025 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:38.999025 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:38.999025 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:38.999025 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:38.999025 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:38.999025 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:39.000062 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 03:16:39.000062 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 03:16:39.000062 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 03:16:39.000062 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 03:16:39.000062 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 03:16:39.000062 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 03:16:39.000062 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 03:16:39.000062 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:16:39.000062 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 268/531] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 03:16:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:39.000744 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda640d1-f56e-40b4-b014-6c809535504a None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:39.023474 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:39.025175 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 264/532] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 03:16:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 03:16:39.026025 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6653d50b-af82-4aa8-bd16-fa7ee659ee9c None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:39.133621 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6653d50b-af82-4aa8-bd16-fa7ee659ee9c None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:39.137348 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda640d1-f56e-40b4-b014-6c809535504a None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:39.178938 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2db455e-d5dc-43c6-a81e-af438ee9b6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:39.179124 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354b19df-d406-46a9-b505-f53d8f6f8582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:39.179555 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db455e-d5dc-43c6-a81e-af438ee9b6e3 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:39.179742 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b19df-d406-46a9-b505-f53d8f6f8582 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:39.179830 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db455e-d5dc-43c6-a81e-af438ee9b6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:39.180014 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db455e-d5dc-43c6-a81e-af438ee9b6e3 None admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:39.180281 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b19df-d406-46a9-b505-f53d8f6f8582 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:39.180652 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b19df-d406-46a9-b505-f53d8f6f8582 None admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:39.180762 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2db455e-d5dc-43c6-a81e-af438ee9b6e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:39.180995 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2db455e-d5dc-43c6-a81e-af438ee9b6e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:39.181406 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354b19df-d406-46a9-b505-f53d8f6f8582 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:39.181722 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354b19df-d406-46a9-b505-f53d8f6f8582 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:39.182416 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2db455e-d5dc-43c6-a81e-af438ee9b6e3 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:39.183150 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354b19df-d406-46a9-b505-f53d8f6f8582 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:39.199159 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 265/533] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 4 03:16:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:39.200095 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2db455e-d5dc-43c6-a81e-af438ee9b6e3 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:39.206658 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 269/534] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 4 03:16:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:39.207640 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354b19df-d406-46a9-b505-f53d8f6f8582 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:39.235027 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:39.307637 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:39.323275 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2db455e-d5dc-43c6-a81e-af438ee9b6e3 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:39.336842 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354b19df-d406-46a9-b505-f53d8f6f8582 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:39.359279 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e6bcbf-c84a-4a6b-935f-1aa7af6c45e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:39.360147 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6bcbf-c84a-4a6b-935f-1aa7af6c45e8 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:39.360658 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6bcbf-c84a-4a6b-935f-1aa7af6c45e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:39.361089 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6bcbf-c84a-4a6b-935f-1aa7af6c45e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:39.372256 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e6bcbf-c84a-4a6b-935f-1aa7af6c45e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:39.373927 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e6bcbf-c84a-4a6b-935f-1aa7af6c45e8 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:39.378149 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce86d060-5606-432e-8405-72918101c16d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:39.378749 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce86d060-5606-432e-8405-72918101c16d None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:39.379025 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce86d060-5606-432e-8405-72918101c16d None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:39.379291 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce86d060-5606-432e-8405-72918101c16d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:39.380050 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce86d060-5606-432e-8405-72918101c16d None admin] RBAC: Adding query filter params (role.id=1f60934edaf04074936ff079756fc4a6, scope.project.id=80ae15e46620470b9c55fb7fe300fcb6, user.id=f537aabf3d1040ff840b02616f839975) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:39.380338 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce86d060-5606-432e-8405-72918101c16d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:39.382728 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce86d060-5606-432e-8405-72918101c16d None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:39.390621 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-54e6bcbf-c84a-4a6b-935f-1aa7af6c45e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:16:39.390621 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:39.390621 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:39.390621 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:39.390621 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:39.390621 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:39.390621 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:39.390621 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:39.390621 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:39.390621 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:39.390621 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:39.390621 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:39.390621 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 03:16:39.390621 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 03:16:39.390621 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 03:16:39.390621 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 03:16:39.391825 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:39.391825 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:39.391825 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:39.391825 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:39.391825 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:39.391825 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:39.391825 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:39.391825 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:39.391825 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:39.391825 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:39.391825 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:39.391825 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:39.391825 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:39.391825 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:39.391825 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:39.391825 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:39.391825 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 03:16:39.392731 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 03:16:39.392731 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:16:39.392731 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:16:39.399080 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 270/536] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 03:16:39 2022] GET /identity/v3/role_assignments?user.id=f537aabf3d1040ff840b02616f839975&scope.project.id=80ae15e46620470b9c55fb7fe300fcb6&role.id=1f60934edaf04074936ff079756fc4a6 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:39.399080 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce86d060-5606-432e-8405-72918101c16d None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:39.399562 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 266/536] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:16:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:39.400751 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e6bcbf-c84a-4a6b-935f-1aa7af6c45e8 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:39.524750 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce86d060-5606-432e-8405-72918101c16d None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:39.568231 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66240b5-5c0e-45ea-9498-37056414c345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:39.568939 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66240b5-5c0e-45ea-9498-37056414c345 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:39.569316 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66240b5-5c0e-45ea-9498-37056414c345 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:39.569592 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66240b5-5c0e-45ea-9498-37056414c345 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:39.570589 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66240b5-5c0e-45ea-9498-37056414c345 None admin] RBAC: Adding query filter params (role.id=1f60934edaf04074936ff079756fc4a6, scope.project.id=80ae15e46620470b9c55fb7fe300fcb6, user.id=95be0e4e1c8641709e07b115047fb4e1) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:39.570897 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66240b5-5c0e-45ea-9498-37056414c345 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:39.572395 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66240b5-5c0e-45ea-9498-37056414c345 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:39.579362 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 271/537] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 03:16:39 2022] GET /identity/v3/role_assignments?user.id=95be0e4e1c8641709e07b115047fb4e1&scope.project.id=80ae15e46620470b9c55fb7fe300fcb6&role.id=1f60934edaf04074936ff079756fc4a6 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:39.586061 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:39.637832 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e6bcbf-c84a-4a6b-935f-1aa7af6c45e8 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:39.670950 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1623c-73cc-4c46-bc1e-6e7fca5671c5 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:39.671239 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1623c-73cc-4c46-bc1e-6e7fca5671c5 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:39.671689 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1623c-73cc-4c46-bc1e-6e7fca5671c5 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:39.673337 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 272/538] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:16:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 03:16:39.679056 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a6791-4b64-4867-a684-9bd2b471ee69 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:39.679374 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a6791-4b64-4867-a684-9bd2b471ee69 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:39.679653 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a6791-4b64-4867-a684-9bd2b471ee69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:39.689435 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547305d0-7a95-4b09-874b-c244b6afc1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:39.690450 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547305d0-7a95-4b09-874b-c244b6afc1f2 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:39.690926 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547305d0-7a95-4b09-874b-c244b6afc1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:39.691419 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547305d0-7a95-4b09-874b-c244b6afc1f2 None admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:39.692379 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547305d0-7a95-4b09-874b-c244b6afc1f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:39.692904 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547305d0-7a95-4b09-874b-c244b6afc1f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:39.694361 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:39.695601 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547305d0-7a95-4b09-874b-c244b6afc1f2 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:39.710435 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 267/539] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 03:16:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:39.712043 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-740a6791-4b64-4867-a684-9bd2b471ee69 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:16:39.713433 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-740a6791-4b64-4867-a684-9bd2b471ee69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:16:39.716032 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547305d0-7a95-4b09-874b-c244b6afc1f2 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:39.852623 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 273/540] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:16:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 03:16:39.888979 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547305d0-7a95-4b09-874b-c244b6afc1f2 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:39.935985 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85f4456-91a2-46f2-a9e6-f9269a2cf36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:39.936610 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85f4456-91a2-46f2-a9e6-f9269a2cf36c None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:39.936889 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85f4456-91a2-46f2-a9e6-f9269a2cf36c None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:39.937160 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85f4456-91a2-46f2-a9e6-f9269a2cf36c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:39.944017 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85f4456-91a2-46f2-a9e6-f9269a2cf36c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:39.945825 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85f4456-91a2-46f2-a9e6-f9269a2cf36c None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:39.947689 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:39.964112 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-a85f4456-91a2-46f2-a9e6-f9269a2cf36c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 03:16:39.964112 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:39.964112 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:39.964112 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:39.964112 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:39.964112 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:39.964112 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:39.964112 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:39.964112 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:39.964112 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:39.964112 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:39.964112 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:39.964112 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 03:16:39.964112 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 03:16:39.964112 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 03:16:39.964992 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 03:16:39.964992 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:39.964992 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:39.964992 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:39.964992 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:39.964992 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:39.964992 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:39.964992 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:39.964992 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:39.964992 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:39.964992 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:39.964992 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:39.964992 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:39.964992 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:39.964992 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:39.964992 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:39.964992 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:39.965813 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 03:16:39.965813 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 03:16:39.965813 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 03:16:39.965813 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 03:16:39.965813 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 03:16:39.965813 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 03:16:39.965813 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 03:16:39.965813 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:16:39.965813 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 268/541] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 03:16:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:39.971957 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a6791-4b64-4867-a684-9bd2b471ee69 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:40.104111 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a6791-4b64-4867-a684-9bd2b471ee69 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:40.154056 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07c970f-ceda-4b0d-943b-92260593918a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:40.154671 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c970f-ceda-4b0d-943b-92260593918a None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:40.154957 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c970f-ceda-4b0d-943b-92260593918a None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:40.155236 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c970f-ceda-4b0d-943b-92260593918a None admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:40.156029 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07c970f-ceda-4b0d-943b-92260593918a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:40.156346 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07c970f-ceda-4b0d-943b-92260593918a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:40.157800 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07c970f-ceda-4b0d-943b-92260593918a None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:40.164677 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:40.168915 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85f4456-91a2-46f2-a9e6-f9269a2cf36c None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:40.175907 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 274/542] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 4 03:16:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:16:40.183354 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07c970f-ceda-4b0d-943b-92260593918a None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:40.332255 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07c970f-ceda-4b0d-943b-92260593918a None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:40.399676 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85f4456-91a2-46f2-a9e6-f9269a2cf36c None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:40.404615 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da79c366-241d-48a9-9f7d-ecc8baf07537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:40.405833 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da79c366-241d-48a9-9f7d-ecc8baf07537 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:40.407260 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da79c366-241d-48a9-9f7d-ecc8baf07537 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:40.407836 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da79c366-241d-48a9-9f7d-ecc8baf07537 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:40.414072 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da79c366-241d-48a9-9f7d-ecc8baf07537 None admin] RBAC: Adding query filter params (role.id=1f60934edaf04074936ff079756fc4a6, scope.project.id=80ae15e46620470b9c55fb7fe300fcb6, user.id=5e43cc9523d949a1bfa3dec882f2824f) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:40.414651 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da79c366-241d-48a9-9f7d-ecc8baf07537 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:40.416364 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da79c366-241d-48a9-9f7d-ecc8baf07537 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:40.424406 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 275/543] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 03:16:40 2022] GET /identity/v3/role_assignments?user.id=5e43cc9523d949a1bfa3dec882f2824f&scope.project.id=80ae15e46620470b9c55fb7fe300fcb6&role.id=1f60934edaf04074936ff079756fc4a6 => generated 259 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:16:40.464724 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51bafb0-de5e-4e2a-a296-da0b39262600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:40.465725 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51bafb0-de5e-4e2a-a296-da0b39262600 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:40.466204 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51bafb0-de5e-4e2a-a296-da0b39262600 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:40.466666 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51bafb0-de5e-4e2a-a296-da0b39262600 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:40.483764 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51bafb0-de5e-4e2a-a296-da0b39262600 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:16:40.494114 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-d51bafb0-de5e-4e2a-a296-da0b39262600 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 03:16:40.494114 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:40.494114 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:40.494114 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:40.494114 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:40.494114 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:40.494114 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:40.494114 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:40.494114 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:40.494114 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:40.494114 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:40.494114 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:40.494114 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:16:40.494114 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:16:40.494114 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:16:40.494114 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:16:40.495072 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:16:40.495072 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:16:40.495072 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:16:40.495072 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:16:40.495072 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:40.495072 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:40.495072 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:40.495072 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:40.495072 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:40.495072 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:40.495072 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:40.495072 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:40.495072 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:40.495072 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:40.495072 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:40.495072 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:40.495901 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:40.495901 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:40.495901 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:40.495901 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:40.495901 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:16:40.495901 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:16:40.495901 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:16:40.495901 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:16:40.495901 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:16:40.495901 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:16:40.495901 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 03:16:40.495901 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:16:40.498635 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 269/544] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Oct 4 03:16:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 03:16:40.508678 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da79c366-241d-48a9-9f7d-ecc8baf07537 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:40.651333 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:40.714468 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da79c366-241d-48a9-9f7d-ecc8baf07537 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:40.752488 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586fa427-2d7e-4c21-a224-d39c23ea62fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:40.753550 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586fa427-2d7e-4c21-a224-d39c23ea62fa None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:40.754080 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586fa427-2d7e-4c21-a224-d39c23ea62fa None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:40.754576 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586fa427-2d7e-4c21-a224-d39c23ea62fa None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:40.755461 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586fa427-2d7e-4c21-a224-d39c23ea62fa None admin] RBAC: Adding query filter params (name=service) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:40.756477 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586fa427-2d7e-4c21-a224-d39c23ea62fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:40.758173 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586fa427-2d7e-4c21-a224-d39c23ea62fa None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:40.768206 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 276/545] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Oct 4 03:16:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:40.774504 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51bafb0-de5e-4e2a-a296-da0b39262600 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:40.866376 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:40.871121 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b789cba-d953-4e07-9e3f-3e819e3a6d96 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:40.872069 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b789cba-d953-4e07-9e3f-3e819e3a6d96 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:40.872544 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b789cba-d953-4e07-9e3f-3e819e3a6d96 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:40.874058 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 277/546] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:16:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:16:40.879243 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b6bed3-94e4-4a94-a301-b76e17d860b5 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:40.879524 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b6bed3-94e4-4a94-a301-b76e17d860b5 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:40.879786 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b6bed3-94e4-4a94-a301-b76e17d860b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:40.920613 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-35b6bed3-94e4-4a94-a301-b76e17d860b5 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:16:40.921151 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51bafb0-de5e-4e2a-a296-da0b39262600 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:40.921742 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-35b6bed3-94e4-4a94-a301-b76e17d860b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:16:40.959405 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead558da-1a53-428d-be72-f1d0aaff85e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:40.960740 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead558da-1a53-428d-be72-f1d0aaff85e7 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:40.961028 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead558da-1a53-428d-be72-f1d0aaff85e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:40.961304 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead558da-1a53-428d-be72-f1d0aaff85e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:40.974488 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead558da-1a53-428d-be72-f1d0aaff85e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:40.977351 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead558da-1a53-428d-be72-f1d0aaff85e7 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:40.993761 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-ead558da-1a53-428d-be72-f1d0aaff85e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:16:40.993761 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:40.993761 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:40.993761 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:40.993761 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:40.993761 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:40.993761 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:40.993761 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:40.993761 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:40.993761 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:40.993761 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:40.993761 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:40.993761 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 03:16:40.993761 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 03:16:40.993761 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 03:16:40.993761 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 03:16:40.994697 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:40.994697 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:40.994697 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:40.994697 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:40.994697 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:40.994697 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:40.994697 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:40.994697 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:40.994697 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:40.994697 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:40.994697 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:40.994697 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:40.994697 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:40.994697 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:40.994697 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:40.994697 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:40.994697 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 03:16:40.995549 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 03:16:40.995549 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:16:40.995549 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:16:40.997760 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 270/547] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:16:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:41.003552 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead558da-1a53-428d-be72-f1d0aaff85e7 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:41.106250 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 278/548] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:16:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 03:16:41.115324 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead558da-1a53-428d-be72-f1d0aaff85e7 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:41.126335 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:41.153661 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6114c2aa-4301-46c1-bf22-0345ccc4cc60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:41.154662 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114c2aa-4301-46c1-bf22-0345ccc4cc60 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:41.155138 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114c2aa-4301-46c1-bf22-0345ccc4cc60 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:41.155630 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114c2aa-4301-46c1-bf22-0345ccc4cc60 None admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:41.156479 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6114c2aa-4301-46c1-bf22-0345ccc4cc60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:41.157004 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6114c2aa-4301-46c1-bf22-0345ccc4cc60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:41.158599 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6114c2aa-4301-46c1-bf22-0345ccc4cc60 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:41.172224 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 271/549] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 03:16:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:16:41.177899 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b6bed3-94e4-4a94-a301-b76e17d860b5 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:41.234343 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:41.304105 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b6bed3-94e4-4a94-a301-b76e17d860b5 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:41.353134 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cb3c7a-d89a-4c9b-a661-dc3462ebc9b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:41.354100 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb3c7a-d89a-4c9b-a661-dc3462ebc9b5 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:41.354681 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb3c7a-d89a-4c9b-a661-dc3462ebc9b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:41.355147 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb3c7a-d89a-4c9b-a661-dc3462ebc9b5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:41.363223 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cb3c7a-d89a-4c9b-a661-dc3462ebc9b5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:41.364995 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cb3c7a-d89a-4c9b-a661-dc3462ebc9b5 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:41.376990 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-f7cb3c7a-d89a-4c9b-a661-dc3462ebc9b5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 04 03:16:41.376990 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:41.376990 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:41.376990 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:41.376990 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:41.376990 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:41.376990 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:41.376990 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:41.376990 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:41.376990 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:41.376990 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:41.376990 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:41.376990 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 03:16:41.376990 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 03:16:41.376990 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 03:16:41.376990 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 03:16:41.378452 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:41.378452 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:41.378452 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 03:16:41.378452 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 03:16:41.378452 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 03:16:41.378452 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 03:16:41.378452 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:41.378452 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:41.378452 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:41.378452 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:41.378452 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:41.378452 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:41.378452 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:41.378452 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:41.378452 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:41.378452 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:41.378452 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:41.378452 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:41.379413 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:41.379413 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:41.379413 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 03:16:41.379413 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 03:16:41.379413 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 03:16:41.379413 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 03:16:41.379413 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 03:16:41.379413 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 03:16:41.379413 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 04 03:16:41.379413 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:16:41.381959 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 279/550] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 4 03:16:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:41.387783 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6114c2aa-4301-46c1-bf22-0345ccc4cc60 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:41.486537 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cb3c7a-d89a-4c9b-a661-dc3462ebc9b5 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:41.511124 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6114c2aa-4301-46c1-bf22-0345ccc4cc60 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:41.594699 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42343bd-c15e-4618-9ad8-57c3331d5ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:41.595313 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42343bd-c15e-4618-9ad8-57c3331d5ed4 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:41.595622 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42343bd-c15e-4618-9ad8-57c3331d5ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:41.595894 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42343bd-c15e-4618-9ad8-57c3331d5ed4 None admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:41.596622 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42343bd-c15e-4618-9ad8-57c3331d5ed4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:41.596925 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42343bd-c15e-4618-9ad8-57c3331d5ed4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:41.598359 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42343bd-c15e-4618-9ad8-57c3331d5ed4 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:41.620092 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 272/551] 10.222.0.25 () {56 vars in 1135 bytes} [Tue Oct 4 03:16:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:41.629339 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42343bd-c15e-4618-9ad8-57c3331d5ed4 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:41.686128 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:41.708778 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cb3c7a-d89a-4c9b-a661-dc3462ebc9b5 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:41.738575 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:41.784833 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387c4f1e-429f-4e8a-973e-58f67e761b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:41.786397 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c4f1e-429f-4e8a-973e-58f67e761b5d None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:41.787009 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c4f1e-429f-4e8a-973e-58f67e761b5d None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:41.789590 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c4f1e-429f-4e8a-973e-58f67e761b5d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:41.809115 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387c4f1e-429f-4e8a-973e-58f67e761b5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:16:41.815292 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-387c4f1e-429f-4e8a-973e-58f67e761b5d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 03:16:41.815292 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:41.815292 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:41.815292 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:41.815292 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:41.815292 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:41.815292 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:41.815292 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:41.815292 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:41.815292 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:41.815292 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:41.815292 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:41.815292 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:16:41.815292 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:16:41.815292 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:16:41.815292 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:16:41.816610 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:16:41.816610 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:16:41.816610 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:16:41.816610 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:16:41.816610 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:41.816610 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:41.816610 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:41.816610 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:41.816610 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:41.816610 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:41.816610 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:41.816610 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:41.816610 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:41.816610 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:41.816610 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:41.816610 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:41.817633 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:41.817633 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:41.817633 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:41.817633 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:41.817633 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:16:41.817633 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:16:41.817633 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:16:41.817633 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:16:41.817633 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:16:41.817633 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:16:41.817633 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 03:16:41.817633 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:16:41.824863 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 280/552] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Oct 4 03:16:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:41.831629 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387c4f1e-429f-4e8a-973e-58f67e761b5d None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:41.835112 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42343bd-c15e-4618-9ad8-57c3331d5ed4 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:41.908694 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa52bd32-04ea-4baa-b0e6-ca9b5ce801d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:41.909395 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa52bd32-04ea-4baa-b0e6-ca9b5ce801d8 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:41.909683 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa52bd32-04ea-4baa-b0e6-ca9b5ce801d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:41.909960 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa52bd32-04ea-4baa-b0e6-ca9b5ce801d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:41.958505 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387c4f1e-429f-4e8a-973e-58f67e761b5d None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:41.997814 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a9eaf8-3a69-4665-80c4-c6c35d6538f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:41.998664 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9eaf8-3a69-4665-80c4-c6c35d6538f9 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:41.999105 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9eaf8-3a69-4665-80c4-c6c35d6538f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:41.999624 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9eaf8-3a69-4665-80c4-c6c35d6538f9 None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:42.000499 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a9eaf8-3a69-4665-80c4-c6c35d6538f9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:42.000944 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a9eaf8-3a69-4665-80c4-c6c35d6538f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:42.002625 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a9eaf8-3a69-4665-80c4-c6c35d6538f9 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:42.012712 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 281/553] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Oct 4 03:16:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:42.018504 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a9eaf8-3a69-4665-80c4-c6c35d6538f9 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:42.056239 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa52bd32-04ea-4baa-b0e6-ca9b5ce801d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:42.058577 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa52bd32-04ea-4baa-b0e6-ca9b5ce801d8 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:42.063680 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:42.093868 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:42.138968 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a9eaf8-3a69-4665-80c4-c6c35d6538f9 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:42.175644 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859cc385-c6af-4960-9d4e-b99d3fc97aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:42.176406 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859cc385-c6af-4960-9d4e-b99d3fc97aea None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:42.176689 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859cc385-c6af-4960-9d4e-b99d3fc97aea None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:42.176963 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859cc385-c6af-4960-9d4e-b99d3fc97aea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:42.183859 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 273/554] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 03:16:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 03:16:42.185765 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01826a31-54eb-4737-bfec-c562abc085f5 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:42.186060 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01826a31-54eb-4737-bfec-c562abc085f5 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:42.186338 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01826a31-54eb-4737-bfec-c562abc085f5 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:42.188104 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 274/555] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:16:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:16:42.189887 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb65ea-f81e-47a6-84eb-f17fe5416645 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:42.190396 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb65ea-f81e-47a6-84eb-f17fe5416645 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:42.190869 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb65ea-f81e-47a6-84eb-f17fe5416645 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:42.192406 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 275/556] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:16:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:16:42.193188 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eb65ea-f81e-47a6-84eb-f17fe5416645 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:42.197646 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859cc385-c6af-4960-9d4e-b99d3fc97aea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:42.199202 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859cc385-c6af-4960-9d4e-b99d3fc97aea None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:42.214994 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-859cc385-c6af-4960-9d4e-b99d3fc97aea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:16:42.214994 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:42.214994 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:42.214994 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:42.214994 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:42.214994 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:42.214994 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:42.214994 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:42.214994 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:42.214994 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:42.214994 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:42.214994 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:42.214994 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 03:16:42.214994 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 03:16:42.214994 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 03:16:42.214994 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 03:16:42.215971 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:42.215971 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:42.215971 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:42.215971 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:42.215971 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:42.215971 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:42.215971 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:42.215971 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:42.215971 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:42.215971 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:42.215971 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:42.215971 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:42.215971 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:42.215971 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:42.215971 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:42.215971 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:42.215971 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 03:16:42.216863 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 03:16:42.216863 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:16:42.216863 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:16:42.216863 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 282/557] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:16:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:42.217962 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d548f1d-04a6-4564-8ce6-54e1c035445d None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:42.218251 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d548f1d-04a6-4564-8ce6-54e1c035445d None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:42.218525 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d548f1d-04a6-4564-8ce6-54e1c035445d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:42.238432 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-6d548f1d-04a6-4564-8ce6-54e1c035445d None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:16:42.239655 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-6d548f1d-04a6-4564-8ce6-54e1c035445d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:16:42.312294 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 283/558] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:16:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 03:16:42.313513 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f0378-11d2-4878-8022-7c851f8de679 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:42.313808 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f0378-11d2-4878-8022-7c851f8de679 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:42.314085 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f0378-11d2-4878-8022-7c851f8de679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:42.324272 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eb65ea-f81e-47a6-84eb-f17fe5416645 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:42.341721 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-db5f0378-11d2-4878-8022-7c851f8de679 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:16:42.343044 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-db5f0378-11d2-4878-8022-7c851f8de679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:16:42.355244 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:42.362934 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:42.364725 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4cf152-e8f8-4d53-a7c8-4b9861c61b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:42.366072 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4cf152-e8f8-4d53-a7c8-4b9861c61b5d None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:42.366671 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4cf152-e8f8-4d53-a7c8-4b9861c61b5d None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:42.367148 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4cf152-e8f8-4d53-a7c8-4b9861c61b5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:42.379441 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4cf152-e8f8-4d53-a7c8-4b9861c61b5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:42.381989 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4cf152-e8f8-4d53-a7c8-4b9861c61b5d None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:42.401199 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-6c4cf152-e8f8-4d53-a7c8-4b9861c61b5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:16:42.401199 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:42.401199 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:42.401199 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:42.401199 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:42.401199 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:42.401199 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:42.401199 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:42.401199 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:42.401199 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:42.401199 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:42.401199 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:42.401199 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 03:16:42.401199 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 03:16:42.401199 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 03:16:42.401199 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 03:16:42.402144 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:42.402144 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:42.402144 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:42.402144 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:42.402144 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:42.402144 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:42.402144 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:42.402144 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:42.402144 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:42.402144 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:42.402144 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:42.402144 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:42.402144 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:42.402144 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:42.402144 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:42.402144 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:42.402144 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 03:16:42.403023 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 03:16:42.403023 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:16:42.403023 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:16:42.409595 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 276/559] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:16:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:42.409595 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4cf152-e8f8-4d53-a7c8-4b9861c61b5d None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:42.431955 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 284/560] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:16:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 03:16:42.433225 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5f0378-11d2-4878-8022-7c851f8de679 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:42.514731 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4cf152-e8f8-4d53-a7c8-4b9861c61b5d None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:42.575064 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67fcb61-bf9f-4a5a-8a5f-439efd0d2fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:42.576040 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67fcb61-bf9f-4a5a-8a5f-439efd0d2fd6 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:42.576540 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67fcb61-bf9f-4a5a-8a5f-439efd0d2fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:42.578135 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67fcb61-bf9f-4a5a-8a5f-439efd0d2fd6 None admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:42.578973 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67fcb61-bf9f-4a5a-8a5f-439efd0d2fd6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:42.581006 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67fcb61-bf9f-4a5a-8a5f-439efd0d2fd6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:42.583570 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67fcb61-bf9f-4a5a-8a5f-439efd0d2fd6 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:42.605087 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5f0378-11d2-4878-8022-7c851f8de679 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:42.609084 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 277/561] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 03:16:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:42.610007 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67fcb61-bf9f-4a5a-8a5f-439efd0d2fd6 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:42.650574 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db35faa7-e3ac-4460-b539-5e80e126a7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:42.651552 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35faa7-e3ac-4460-b539-5e80e126a7b1 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:42.652055 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35faa7-e3ac-4460-b539-5e80e126a7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:42.652541 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35faa7-e3ac-4460-b539-5e80e126a7b1 None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:42.653412 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db35faa7-e3ac-4460-b539-5e80e126a7b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:42.653908 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db35faa7-e3ac-4460-b539-5e80e126a7b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:42.655474 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db35faa7-e3ac-4460-b539-5e80e126a7b1 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:42.668767 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 285/562] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 03:16:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:42.674164 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db35faa7-e3ac-4460-b539-5e80e126a7b1 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:42.676069 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:42.687396 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:42.739587 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67fcb61-bf9f-4a5a-8a5f-439efd0d2fd6 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:42.783177 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653a5d64-d7bd-43a9-8839-d83555bf4057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:42.784096 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a5d64-d7bd-43a9-8839-d83555bf4057 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:42.784398 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a5d64-d7bd-43a9-8839-d83555bf4057 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:42.784676 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a5d64-d7bd-43a9-8839-d83555bf4057 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:42.799312 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653a5d64-d7bd-43a9-8839-d83555bf4057 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:16:42.804487 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db35faa7-e3ac-4460-b539-5e80e126a7b1 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:42.806391 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-653a5d64-d7bd-43a9-8839-d83555bf4057 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 03:16:42.806391 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:42.806391 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:42.806391 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:42.806391 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:42.806391 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:42.806391 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:42.806391 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:42.806391 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:42.806391 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:42.806391 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:42.806391 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:42.806391 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:16:42.806391 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:16:42.806391 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:16:42.806391 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:16:42.807277 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:16:42.807277 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:16:42.807277 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:16:42.807277 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:16:42.807277 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:42.807277 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:42.807277 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:42.807277 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:42.807277 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:42.807277 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:42.807277 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:42.807277 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:42.807277 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:42.807277 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:42.807277 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:42.807277 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:42.808146 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:42.808146 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:42.808146 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:42.808146 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:42.808146 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:16:42.808146 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:16:42.808146 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:16:42.808146 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:16:42.808146 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:16:42.808146 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:16:42.808146 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 03:16:42.808146 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:16:42.808848 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 278/563] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Oct 4 03:16:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:42.811507 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653a5d64-d7bd-43a9-8839-d83555bf4057 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:42.846893 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d51f6a6-4e92-4456-99ef-1ed27dac131f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:42.847785 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51f6a6-4e92-4456-99ef-1ed27dac131f None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:42.848320 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51f6a6-4e92-4456-99ef-1ed27dac131f None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:42.848659 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51f6a6-4e92-4456-99ef-1ed27dac131f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:42.856726 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d51f6a6-4e92-4456-99ef-1ed27dac131f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:42.858177 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d51f6a6-4e92-4456-99ef-1ed27dac131f None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:42.870668 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-0d51f6a6-4e92-4456-99ef-1ed27dac131f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 03:16:42.870668 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:42.870668 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:42.870668 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:42.870668 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:42.870668 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:42.870668 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:42.870668 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:42.870668 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:42.870668 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:42.870668 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:42.870668 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:42.870668 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 03:16:42.870668 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 03:16:42.870668 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 03:16:42.870668 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 03:16:42.871667 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:42.871667 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:42.871667 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 03:16:42.871667 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 03:16:42.871667 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 03:16:42.871667 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 03:16:42.871667 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:42.871667 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:42.871667 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:42.871667 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:42.871667 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:42.871667 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:42.871667 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:42.871667 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:42.871667 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:42.871667 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:42.871667 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:42.871667 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:42.872646 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:42.872646 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:42.872646 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 03:16:42.872646 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 03:16:42.872646 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 03:16:42.872646 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 03:16:42.872646 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 03:16:42.872646 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 03:16:42.872646 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 03:16:42.872646 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:16:42.872646 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 286/564] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Oct 4 03:16:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:42.872646 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d51f6a6-4e92-4456-99ef-1ed27dac131f None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:42.924850 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:42.928707 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653a5d64-d7bd-43a9-8839-d83555bf4057 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:42.942712 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:42.965302 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ccf4a5-224a-40cb-a17b-dc0af376bf1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:42.965939 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ccf4a5-224a-40cb-a17b-dc0af376bf1c None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:42.966221 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ccf4a5-224a-40cb-a17b-dc0af376bf1c None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:42.966493 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ccf4a5-224a-40cb-a17b-dc0af376bf1c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:42.973551 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ccf4a5-224a-40cb-a17b-dc0af376bf1c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:42.975106 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ccf4a5-224a-40cb-a17b-dc0af376bf1c None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:42.982310 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d51f6a6-4e92-4456-99ef-1ed27dac131f None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:42.987635 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-18ccf4a5-224a-40cb-a17b-dc0af376bf1c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 03:16:42.987635 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:42.987635 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:42.987635 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:42.987635 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:42.987635 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:42.987635 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:42.987635 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:42.987635 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:42.987635 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:42.987635 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:42.987635 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:42.987635 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 03:16:42.987635 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 03:16:42.987635 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 03:16:42.988607 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 03:16:42.988607 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:42.988607 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:42.988607 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:42.988607 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:42.988607 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:42.988607 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:42.988607 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:42.988607 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:42.988607 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:42.988607 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:42.988607 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:42.988607 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:42.988607 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:42.988607 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:42.988607 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:42.988607 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:42.990119 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 03:16:42.990119 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 03:16:42.990119 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 03:16:42.990119 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 03:16:42.990119 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 03:16:42.990119 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 03:16:42.990119 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 03:16:42.990119 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:16:42.990119 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 279/565] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 03:16:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:42.990119 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ccf4a5-224a-40cb-a17b-dc0af376bf1c None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:43.025269 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33de679f-ee9c-48fa-ae54-78eea15b0316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:43.025871 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de679f-ee9c-48fa-ae54-78eea15b0316 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:43.026146 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de679f-ee9c-48fa-ae54-78eea15b0316 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:43.026412 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de679f-ee9c-48fa-ae54-78eea15b0316 None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:43.027070 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33de679f-ee9c-48fa-ae54-78eea15b0316 None admin] RBAC: Adding query filter params (name=service) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:43.027369 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33de679f-ee9c-48fa-ae54-78eea15b0316 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:43.028839 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33de679f-ee9c-48fa-ae54-78eea15b0316 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:43.036978 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 287/566] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Oct 4 03:16:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:43.038566 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33de679f-ee9c-48fa-ae54-78eea15b0316 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:43.110625 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ccf4a5-224a-40cb-a17b-dc0af376bf1c None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:43.141546 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33de679f-ee9c-48fa-ae54-78eea15b0316 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:43.144185 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088e2073-a2d9-406f-b527-c1da07d45ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:43.144798 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e2073-a2d9-406f-b527-c1da07d45ee1 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:43.145073 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e2073-a2d9-406f-b527-c1da07d45ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:43.145348 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e2073-a2d9-406f-b527-c1da07d45ee1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:43.155249 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088e2073-a2d9-406f-b527-c1da07d45ee1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:16:43.160355 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-088e2073-a2d9-406f-b527-c1da07d45ee1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 03:16:43.160355 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:43.160355 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:43.160355 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:43.160355 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:43.160355 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:43.160355 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:43.160355 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:43.160355 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:43.160355 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:43.160355 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:43.160355 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:43.160355 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:16:43.160355 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:16:43.160355 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:16:43.160355 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:16:43.161280 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:16:43.161280 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:16:43.161280 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:16:43.161280 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:16:43.161280 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:43.161280 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:43.161280 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:43.161280 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:43.161280 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:43.161280 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:43.161280 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:43.161280 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:43.161280 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:43.161280 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:43.161280 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:43.161280 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:43.162100 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:43.162100 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:43.162100 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:43.162100 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:43.162100 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:16:43.162100 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:16:43.162100 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:16:43.162100 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:16:43.162100 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:16:43.162100 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:16:43.162100 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 03:16:43.162100 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:16:43.162100 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 280/567] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Oct 4 03:16:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:43.163297 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088e2073-a2d9-406f-b527-c1da07d45ee1 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:43.170907 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:43.179983 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1258e0d-bd6c-4eb8-bbee-4dd146164f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:43.180585 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1258e0d-bd6c-4eb8-bbee-4dd146164f2c None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:43.180868 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1258e0d-bd6c-4eb8-bbee-4dd146164f2c None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:43.181146 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1258e0d-bd6c-4eb8-bbee-4dd146164f2c None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:43.181984 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1258e0d-bd6c-4eb8-bbee-4dd146164f2c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:43.182293 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1258e0d-bd6c-4eb8-bbee-4dd146164f2c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:43.183752 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1258e0d-bd6c-4eb8-bbee-4dd146164f2c None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:43.185001 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:43.201481 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 288/568] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Oct 4 03:16:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:43.202515 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1258e0d-bd6c-4eb8-bbee-4dd146164f2c None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:43.265185 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088e2073-a2d9-406f-b527-c1da07d45ee1 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:43.298238 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2684c4-5f11-4b59-81c8-e4acdbc4a589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:43.298836 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2684c4-5f11-4b59-81c8-e4acdbc4a589 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:43.299119 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2684c4-5f11-4b59-81c8-e4acdbc4a589 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:43.299402 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2684c4-5f11-4b59-81c8-e4acdbc4a589 None admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:43.300118 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2684c4-5f11-4b59-81c8-e4acdbc4a589 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:43.300423 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2684c4-5f11-4b59-81c8-e4acdbc4a589 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:43.301854 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2684c4-5f11-4b59-81c8-e4acdbc4a589 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:43.303114 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1258e0d-bd6c-4eb8-bbee-4dd146164f2c None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:43.314374 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 281/569] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 4 03:16:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:43.315562 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115c915-a791-4edd-852a-8b631a6a618a None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:43.315849 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115c915-a791-4edd-852a-8b631a6a618a None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:43.316123 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115c915-a791-4edd-852a-8b631a6a618a None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:43.317311 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 282/570] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:16:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:16:43.318001 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f115c915-a791-4edd-852a-8b631a6a618a None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:43.343627 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245dd70f-68fc-4aa6-b9a5-56605c707d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:43.344480 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245dd70f-68fc-4aa6-b9a5-56605c707d52 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:43.344759 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245dd70f-68fc-4aa6-b9a5-56605c707d52 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:43.345033 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245dd70f-68fc-4aa6-b9a5-56605c707d52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:43.355335 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245dd70f-68fc-4aa6-b9a5-56605c707d52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:43.356790 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245dd70f-68fc-4aa6-b9a5-56605c707d52 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:43.371097 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-245dd70f-68fc-4aa6-b9a5-56605c707d52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:16:43.371097 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:43.371097 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:43.371097 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:43.371097 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:43.371097 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:43.371097 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:43.371097 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:43.371097 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:43.371097 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:43.371097 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:43.371097 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:43.371097 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 03:16:43.371097 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 03:16:43.371097 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 03:16:43.371097 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 03:16:43.372229 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:43.372229 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:43.372229 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:43.372229 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:43.372229 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:43.372229 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:43.372229 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:43.372229 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:43.372229 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:43.372229 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:43.372229 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:43.372229 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:43.372229 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:43.372229 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:43.372229 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:43.372229 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:43.372229 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 03:16:43.373460 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 03:16:43.373460 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:16:43.373460 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:16:43.373460 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 289/571] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:16:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:43.373460 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245dd70f-68fc-4aa6-b9a5-56605c707d52 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:43.402889 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:43.414811 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:43.423440 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f115c915-a791-4edd-852a-8b631a6a618a None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:43.456196 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f3679-3e02-4eb3-8739-9ba92387a087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:43.456879 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f3679-3e02-4eb3-8739-9ba92387a087 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:43.457234 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f3679-3e02-4eb3-8739-9ba92387a087 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:43.457513 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f3679-3e02-4eb3-8739-9ba92387a087 None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:43.458171 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9f3679-3e02-4eb3-8739-9ba92387a087 None admin] RBAC: Adding query filter params (name=service) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:43.458492 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9f3679-3e02-4eb3-8739-9ba92387a087 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:43.460395 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9f3679-3e02-4eb3-8739-9ba92387a087 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:43.468116 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 283/572] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Oct 4 03:16:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:43.468888 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f3679-3e02-4eb3-8739-9ba92387a087 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:43.477578 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245dd70f-68fc-4aa6-b9a5-56605c707d52 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:43.512758 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e170e027-2fa5-4d04-a7f6-cf7de5e9a6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:43.513387 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e170e027-2fa5-4d04-a7f6-cf7de5e9a6c9 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:43.513677 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e170e027-2fa5-4d04-a7f6-cf7de5e9a6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:43.513952 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e170e027-2fa5-4d04-a7f6-cf7de5e9a6c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:43.524435 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e170e027-2fa5-4d04-a7f6-cf7de5e9a6c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:43.525875 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e170e027-2fa5-4d04-a7f6-cf7de5e9a6c9 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:43.541878 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-e170e027-2fa5-4d04-a7f6-cf7de5e9a6c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:16:43.541878 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:43.541878 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:43.541878 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:43.541878 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:43.541878 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:43.541878 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:43.541878 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:43.541878 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:43.541878 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:43.541878 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:43.541878 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:43.541878 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 03:16:43.541878 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 03:16:43.541878 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 03:16:43.541878 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 03:16:43.543009 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:43.543009 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:43.543009 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:43.543009 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:43.543009 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:43.543009 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:43.543009 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:43.543009 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:43.543009 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:43.543009 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:43.543009 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:43.543009 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:43.543009 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:43.543009 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:43.543009 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:43.543009 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:43.543009 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 03:16:43.544065 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 03:16:43.544065 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:16:43.544065 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:16:43.544065 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 290/573] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:16:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:43.544670 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b57f1-1445-4396-8fc1-70d2daaf7d27 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:43.544954 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b57f1-1445-4396-8fc1-70d2daaf7d27 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:43.545227 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b57f1-1445-4396-8fc1-70d2daaf7d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:43.563403 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-f35b57f1-1445-4396-8fc1-70d2daaf7d27 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:16:43.564624 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-f35b57f1-1445-4396-8fc1-70d2daaf7d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:16:43.570137 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f3679-3e02-4eb3-8739-9ba92387a087 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:43.602968 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d276fbe7-6dc5-4be1-a18b-8c072cd333c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:43.603599 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d276fbe7-6dc5-4be1-a18b-8c072cd333c8 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:43.603883 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d276fbe7-6dc5-4be1-a18b-8c072cd333c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:43.604159 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d276fbe7-6dc5-4be1-a18b-8c072cd333c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:43.604874 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d276fbe7-6dc5-4be1-a18b-8c072cd333c8 None admin] RBAC: Adding query filter params (role.id=1f60934edaf04074936ff079756fc4a6, scope.project.id=80ae15e46620470b9c55fb7fe300fcb6, user.id=1d8da6bacc8f432e8f48bb99c7aede11) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:43.605181 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d276fbe7-6dc5-4be1-a18b-8c072cd333c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:43.606596 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d276fbe7-6dc5-4be1-a18b-8c072cd333c8 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:43.611831 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 284/574] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 03:16:43 2022] GET /identity/v3/role_assignments?user.id=1d8da6bacc8f432e8f48bb99c7aede11&scope.project.id=80ae15e46620470b9c55fb7fe300fcb6&role.id=1f60934edaf04074936ff079756fc4a6 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:43.612598 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d276fbe7-6dc5-4be1-a18b-8c072cd333c8 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:43.622356 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:43.663520 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 291/575] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:16:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 03:16:43.663520 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35b57f1-1445-4396-8fc1-70d2daaf7d27 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:43.681482 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:43.760190 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d276fbe7-6dc5-4be1-a18b-8c072cd333c8 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:43.783986 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35b57f1-1445-4396-8fc1-70d2daaf7d27 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:43.806092 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0613094b-6987-47fa-b973-deed1158abd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:43.807023 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0613094b-6987-47fa-b973-deed1158abd7 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:43.807504 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0613094b-6987-47fa-b973-deed1158abd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:43.807789 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0613094b-6987-47fa-b973-deed1158abd7 None admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:43.808426 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0613094b-6987-47fa-b973-deed1158abd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:43.808730 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0613094b-6987-47fa-b973-deed1158abd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:43.810090 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0613094b-6987-47fa-b973-deed1158abd7 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:43.827672 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72f735d-0b0b-45f9-a03e-138c797dacf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:43.827872 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 285/576] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 03:16:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:43.828345 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f735d-0b0b-45f9-a03e-138c797dacf5 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:43.828540 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0613094b-6987-47fa-b973-deed1158abd7 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:43.828638 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f735d-0b0b-45f9-a03e-138c797dacf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:43.828969 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f735d-0b0b-45f9-a03e-138c797dacf5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:43.842257 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72f735d-0b0b-45f9-a03e-138c797dacf5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:43.844292 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72f735d-0b0b-45f9-a03e-138c797dacf5 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:43.864331 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-f72f735d-0b0b-45f9-a03e-138c797dacf5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:16:43.864331 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:43.864331 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:43.864331 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:43.864331 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:43.864331 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:43.864331 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:43.864331 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:43.864331 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:43.864331 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:43.864331 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:43.864331 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:43.864331 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 03:16:43.864331 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 03:16:43.864331 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 03:16:43.864331 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 03:16:43.865315 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:43.865315 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:43.865315 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:43.865315 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:43.865315 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:43.865315 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:43.865315 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:43.865315 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:43.865315 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:43.865315 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:43.865315 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:43.865315 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:43.865315 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:43.865315 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:43.865315 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:43.865315 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:43.865315 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 03:16:43.866742 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 03:16:43.866742 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:16:43.866742 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:16:43.866742 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 292/577] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:16:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:43.866742 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72f735d-0b0b-45f9-a03e-138c797dacf5 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:43.900796 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:43.937295 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0613094b-6987-47fa-b973-deed1158abd7 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:43.957902 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:43.973758 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a08a2e2-9030-4fba-9402-4db8d99b8b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:43.974365 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a08a2e2-9030-4fba-9402-4db8d99b8b50 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:43.974629 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a08a2e2-9030-4fba-9402-4db8d99b8b50 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:43.975460 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a08a2e2-9030-4fba-9402-4db8d99b8b50 None admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:43.976317 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a08a2e2-9030-4fba-9402-4db8d99b8b50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:43.976621 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a08a2e2-9030-4fba-9402-4db8d99b8b50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:43.978036 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a08a2e2-9030-4fba-9402-4db8d99b8b50 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:43.990400 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 286/578] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 03:16:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:43.991262 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a08a2e2-9030-4fba-9402-4db8d99b8b50 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:43.998600 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72f735d-0b0b-45f9-a03e-138c797dacf5 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:44.035345 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d96041-58cf-490d-a142-fab473a65789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:44.036007 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d96041-58cf-490d-a142-fab473a65789 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:44.036287 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d96041-58cf-490d-a142-fab473a65789 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:44.036563 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d96041-58cf-490d-a142-fab473a65789 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:44.044391 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d96041-58cf-490d-a142-fab473a65789 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:44.045830 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d96041-58cf-490d-a142-fab473a65789 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:44.057514 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-a9d96041-58cf-490d-a142-fab473a65789 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 03:16:44.057514 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:44.057514 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:44.057514 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:44.057514 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:44.057514 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:44.057514 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:44.057514 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:44.057514 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:44.057514 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:44.057514 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:44.057514 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:44.057514 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 03:16:44.057514 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 03:16:44.057514 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 03:16:44.057514 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 03:16:44.058625 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:44.058625 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:44.058625 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 03:16:44.058625 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 03:16:44.058625 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 03:16:44.058625 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 03:16:44.058625 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:44.058625 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:44.058625 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:44.058625 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:44.058625 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:44.058625 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:44.058625 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:44.058625 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:44.058625 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:44.058625 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:44.058625 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:44.058625 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:44.059816 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:44.059816 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:44.059816 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 03:16:44.059816 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 03:16:44.059816 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 03:16:44.059816 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 03:16:44.059816 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 03:16:44.059816 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 03:16:44.059816 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 03:16:44.059816 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:16:44.063376 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 293/579] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 03:16:43 2022] GET /identity/v3/users/cinder => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:44.064242 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d96041-58cf-490d-a142-fab473a65789 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:44.103652 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a08a2e2-9030-4fba-9402-4db8d99b8b50 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:44.132825 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:44.144075 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbef81d-7a7e-4fff-a85a-4fbbdab43a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:44.144954 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbef81d-7a7e-4fff-a85a-4fbbdab43a14 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:44.145492 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbef81d-7a7e-4fff-a85a-4fbbdab43a14 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:44.145928 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbef81d-7a7e-4fff-a85a-4fbbdab43a14 None admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:44.147220 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbef81d-7a7e-4fff-a85a-4fbbdab43a14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:44.147800 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbef81d-7a7e-4fff-a85a-4fbbdab43a14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:44.149364 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbef81d-7a7e-4fff-a85a-4fbbdab43a14 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:44.166380 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 287/580] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 03:16:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:44.166380 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbef81d-7a7e-4fff-a85a-4fbbdab43a14 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:44.185331 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d96041-58cf-490d-a142-fab473a65789 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:44.219320 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:44.225656 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbf650f-2229-4b3f-af7b-8782f3b4ca76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:44.226277 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf650f-2229-4b3f-af7b-8782f3b4ca76 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:44.226555 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf650f-2229-4b3f-af7b-8782f3b4ca76 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:44.226823 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf650f-2229-4b3f-af7b-8782f3b4ca76 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:44.238883 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbf650f-2229-4b3f-af7b-8782f3b4ca76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:16:44.244994 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-8cbf650f-2229-4b3f-af7b-8782f3b4ca76 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 03:16:44.244994 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:44.244994 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:44.244994 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:44.244994 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:44.244994 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:44.244994 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:44.244994 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:44.244994 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:44.244994 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:44.244994 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:44.244994 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:44.244994 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:16:44.244994 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:16:44.244994 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:16:44.244994 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:16:44.245913 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:16:44.245913 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:16:44.245913 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:16:44.245913 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:16:44.245913 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:44.245913 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:44.245913 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:44.245913 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:44.245913 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:44.245913 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:44.245913 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:44.245913 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:44.245913 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:44.245913 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:44.245913 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:44.245913 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:44.246841 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:44.246841 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:44.246841 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:44.246841 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:44.246841 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:16:44.246841 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:16:44.246841 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:16:44.246841 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:16:44.246841 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:16:44.246841 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:16:44.246841 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 03:16:44.246841 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:16:44.246841 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 294/581] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Oct 4 03:16:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:44.247592 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbf650f-2229-4b3f-af7b-8782f3b4ca76 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:44.272913 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbef81d-7a7e-4fff-a85a-4fbbdab43a14 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:44.310994 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61482183-ee88-4527-8316-dd09be25bdc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:44.311660 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61482183-ee88-4527-8316-dd09be25bdc9 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:44.311941 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61482183-ee88-4527-8316-dd09be25bdc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:44.312218 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61482183-ee88-4527-8316-dd09be25bdc9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:44.320315 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61482183-ee88-4527-8316-dd09be25bdc9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:44.321753 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61482183-ee88-4527-8316-dd09be25bdc9 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:44.337245 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-61482183-ee88-4527-8316-dd09be25bdc9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 03:16:44.337245 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:44.337245 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:44.337245 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:44.337245 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:44.337245 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:44.337245 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:44.337245 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:44.337245 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:44.337245 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:44.337245 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:44.337245 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:44.337245 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 03:16:44.337245 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 03:16:44.337245 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 03:16:44.338307 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 03:16:44.338307 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:44.338307 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:44.338307 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:44.338307 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:44.338307 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:44.338307 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:44.338307 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:44.338307 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:44.338307 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:44.338307 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:44.338307 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:44.338307 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:44.338307 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:44.338307 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:44.338307 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:44.338307 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:44.339452 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 03:16:44.339452 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 03:16:44.339452 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 03:16:44.339452 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 03:16:44.339452 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 03:16:44.339452 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 03:16:44.339452 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 03:16:44.339452 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:16:44.343506 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 288/582] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 03:16:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:44.344472 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61482183-ee88-4527-8316-dd09be25bdc9 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:44.362135 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbf650f-2229-4b3f-af7b-8782f3b4ca76 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:44.394749 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:44.401320 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fc27ec-93f0-43f9-b239-53db76591634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:44.401923 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc27ec-93f0-43f9-b239-53db76591634 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:44.402204 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc27ec-93f0-43f9-b239-53db76591634 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:44.402474 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc27ec-93f0-43f9-b239-53db76591634 None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:44.403657 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fc27ec-93f0-43f9-b239-53db76591634 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:44.403993 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fc27ec-93f0-43f9-b239-53db76591634 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:44.405420 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fc27ec-93f0-43f9-b239-53db76591634 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:44.429357 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 295/583] 10.222.0.25 () {56 vars in 1137 bytes} [Tue Oct 4 03:16:44 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:44.429357 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fc27ec-93f0-43f9-b239-53db76591634 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:44.456866 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61482183-ee88-4527-8316-dd09be25bdc9 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:44.481184 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:44.492864 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3ff1ae-b3fb-44ba-888f-fe0c589dae37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:44.493488 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3ff1ae-b3fb-44ba-888f-fe0c589dae37 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:44.493770 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3ff1ae-b3fb-44ba-888f-fe0c589dae37 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:44.494048 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3ff1ae-b3fb-44ba-888f-fe0c589dae37 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:44.501666 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3ff1ae-b3fb-44ba-888f-fe0c589dae37 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:44.503098 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3ff1ae-b3fb-44ba-888f-fe0c589dae37 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:44.514854 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-ad3ff1ae-b3fb-44ba-888f-fe0c589dae37 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 04 03:16:44.514854 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:44.514854 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:44.514854 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:44.514854 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:44.514854 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:44.514854 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:44.514854 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:44.514854 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:44.514854 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:44.514854 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:44.514854 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:44.514854 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 03:16:44.514854 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 03:16:44.514854 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 03:16:44.514854 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 03:16:44.516055 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:44.516055 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:44.516055 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 03:16:44.516055 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 03:16:44.516055 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 03:16:44.516055 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 03:16:44.516055 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:44.516055 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:44.516055 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:44.516055 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:44.516055 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:44.516055 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:44.516055 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:44.516055 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:44.516055 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:44.516055 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:44.516055 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:44.516055 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:44.517171 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:44.517171 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:44.517171 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 03:16:44.517171 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 03:16:44.517171 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 03:16:44.517171 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 03:16:44.517171 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 03:16:44.517171 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 03:16:44.517171 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 04 03:16:44.517171 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:16:44.520773 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 289/584] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 03:16:44 2022] GET /identity/v3/users/glance => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:44.521715 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3ff1ae-b3fb-44ba-888f-fe0c589dae37 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:44.539862 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fc27ec-93f0-43f9-b239-53db76591634 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:44.578097 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af4c910-ddd3-4399-9137-5dab4ffcc1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:44.579166 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af4c910-ddd3-4399-9137-5dab4ffcc1ef None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:44.579446 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af4c910-ddd3-4399-9137-5dab4ffcc1ef None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:44.579902 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af4c910-ddd3-4399-9137-5dab4ffcc1ef None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:44.580557 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af4c910-ddd3-4399-9137-5dab4ffcc1ef None admin] RBAC: Adding query filter params (name=service) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:44.580861 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af4c910-ddd3-4399-9137-5dab4ffcc1ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:44.582230 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af4c910-ddd3-4399-9137-5dab4ffcc1ef None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:44.591968 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 296/585] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Oct 4 03:16:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:44.592732 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af4c910-ddd3-4399-9137-5dab4ffcc1ef None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:44.632654 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3ff1ae-b3fb-44ba-888f-fe0c589dae37 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:44.644160 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:44.677037 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc78e59-136a-4207-928d-72519e298629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:44.677990 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc78e59-136a-4207-928d-72519e298629 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:44.678862 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc78e59-136a-4207-928d-72519e298629 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:44.679143 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc78e59-136a-4207-928d-72519e298629 None admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:44.679997 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc78e59-136a-4207-928d-72519e298629 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:44.680255 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc78e59-136a-4207-928d-72519e298629 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:44.681686 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc78e59-136a-4207-928d-72519e298629 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:44.693469 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 290/586] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 4 03:16:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:44.694159 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc78e59-136a-4207-928d-72519e298629 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:44.713919 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af4c910-ddd3-4399-9137-5dab4ffcc1ef None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:44.729698 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:44.753393 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6b4860-0b6b-483b-bb42-ed85f19ca473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:44.754174 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b4860-0b6b-483b-bb42-ed85f19ca473 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:44.754456 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b4860-0b6b-483b-bb42-ed85f19ca473 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:44.755051 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b4860-0b6b-483b-bb42-ed85f19ca473 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:44.766442 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6b4860-0b6b-483b-bb42-ed85f19ca473 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:44.767918 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6b4860-0b6b-483b-bb42-ed85f19ca473 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:44.782007 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-8a6b4860-0b6b-483b-bb42-ed85f19ca473 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:16:44.782007 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:44.782007 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:44.782007 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:44.782007 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:44.782007 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:44.782007 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:44.782007 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:44.782007 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:44.782007 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:44.782007 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:44.782007 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:44.782007 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 03:16:44.782007 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 03:16:44.782007 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 03:16:44.782007 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 03:16:44.782948 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:44.782948 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:44.782948 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:44.782948 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:44.782948 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:44.782948 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:44.782948 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:44.782948 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:44.782948 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:44.782948 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:44.782948 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:44.782948 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:44.782948 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:44.782948 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:44.782948 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:44.782948 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:44.782948 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 03:16:44.784229 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 03:16:44.784229 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:16:44.784229 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:16:44.784229 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 297/587] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:16:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:44.784229 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6b4860-0b6b-483b-bb42-ed85f19ca473 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:44.805924 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc78e59-136a-4207-928d-72519e298629 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:44.843458 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1739ff35-8d4a-443c-b5ab-767248b76522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:44.844246 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739ff35-8d4a-443c-b5ab-767248b76522 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:44.844537 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739ff35-8d4a-443c-b5ab-767248b76522 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:44.844828 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739ff35-8d4a-443c-b5ab-767248b76522 None admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:44.845540 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1739ff35-8d4a-443c-b5ab-767248b76522 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:44.845849 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1739ff35-8d4a-443c-b5ab-767248b76522 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:44.847268 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1739ff35-8d4a-443c-b5ab-767248b76522 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:44.867855 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 291/588] 10.222.0.25 () {56 vars in 1137 bytes} [Tue Oct 4 03:16:44 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:44.869505 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1739ff35-8d4a-443c-b5ab-767248b76522 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:44.893430 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6b4860-0b6b-483b-bb42-ed85f19ca473 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:44.896233 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:44.937794 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff84a07b-c82a-4301-bd37-953f9e95f70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:44.938950 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84a07b-c82a-4301-bd37-953f9e95f70c None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:44.939410 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84a07b-c82a-4301-bd37-953f9e95f70c None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:44.939876 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84a07b-c82a-4301-bd37-953f9e95f70c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:44.953297 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff84a07b-c82a-4301-bd37-953f9e95f70c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:44.955064 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff84a07b-c82a-4301-bd37-953f9e95f70c None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:44.972984 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-ff84a07b-c82a-4301-bd37-953f9e95f70c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:16:44.972984 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:44.972984 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:44.972984 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:44.972984 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:44.972984 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:44.972984 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:44.972984 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:44.972984 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:44.972984 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:44.972984 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:44.972984 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:44.972984 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 03:16:44.972984 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 03:16:44.972984 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 03:16:44.972984 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 03:16:44.974181 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:44.974181 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:44.974181 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:44.974181 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:44.974181 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:44.974181 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:44.974181 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:44.974181 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:44.974181 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:44.974181 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:44.974181 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:44.974181 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:44.974181 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:44.974181 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:44.974181 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:44.974181 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:44.974181 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 03:16:44.975129 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 03:16:44.975129 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:16:44.975129 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:16:44.975129 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 298/589] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:16:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:44.975129 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff84a07b-c82a-4301-bd37-953f9e95f70c None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:44.981221 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1739ff35-8d4a-443c-b5ab-767248b76522 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:45.000513 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:45.016918 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0853ebfe-1c12-422d-942c-e28c53cf065e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:45.017568 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0853ebfe-1c12-422d-942c-e28c53cf065e None admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:45.017852 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0853ebfe-1c12-422d-942c-e28c53cf065e None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:45.018126 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0853ebfe-1c12-422d-942c-e28c53cf065e None admin] PATH_INFO: `/v3/projects/80ae15e46620470b9c55fb7fe300fcb6/users/2c1f412befb9418fa66a2aabf475aa90/roles/1f60934edaf04074936ff079756fc4a6` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:45.032664 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0853ebfe-1c12-422d-942c-e28c53cf065e None admin] RBAC: Authorizing `identity:create_grant(project_id=80ae15e46620470b9c55fb7fe300fcb6, user_id=2c1f412befb9418fa66a2aabf475aa90, role_id=1f60934edaf04074936ff079756fc4a6)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:45.034113 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0853ebfe-1c12-422d-942c-e28c53cf065e None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:45.047958 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 292/590] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Oct 4 03:16:44 2022] PUT /identity/v3/projects/80ae15e46620470b9c55fb7fe300fcb6/users/2c1f412befb9418fa66a2aabf475aa90/roles/1f60934edaf04074936ff079756fc4a6 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:16:45.048741 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0853ebfe-1c12-422d-942c-e28c53cf065e None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:45.112654 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff84a07b-c82a-4301-bd37-953f9e95f70c None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:45.157337 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca83081-2d3a-4896-af39-712be5b917cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:45.158608 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca83081-2d3a-4896-af39-712be5b917cb None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:45.159080 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca83081-2d3a-4896-af39-712be5b917cb None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:45.159553 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca83081-2d3a-4896-af39-712be5b917cb None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:45.160524 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca83081-2d3a-4896-af39-712be5b917cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:45.161011 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca83081-2d3a-4896-af39-712be5b917cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:45.163290 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca83081-2d3a-4896-af39-712be5b917cb None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:45.173341 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:45.181341 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 299/591] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 03:16:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:45.182515 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca83081-2d3a-4896-af39-712be5b917cb None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:45.223355 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0853ebfe-1c12-422d-942c-e28c53cf065e None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:45.272038 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5777d32-ef1a-4f52-b347-53bdf90d8465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:45.272038 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5777d32-ef1a-4f52-b347-53bdf90d8465 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:45.272038 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5777d32-ef1a-4f52-b347-53bdf90d8465 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:45.272038 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5777d32-ef1a-4f52-b347-53bdf90d8465 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:45.281941 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:45.285671 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5777d32-ef1a-4f52-b347-53bdf90d8465 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:45.287196 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5777d32-ef1a-4f52-b347-53bdf90d8465 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:45.304022 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-e5777d32-ef1a-4f52-b347-53bdf90d8465 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:16:45.304022 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:45.304022 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:45.304022 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:45.304022 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:45.304022 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:45.304022 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:45.304022 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:45.304022 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:45.304022 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:45.304022 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:45.304022 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:45.304022 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 03:16:45.304022 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 03:16:45.304022 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 03:16:45.304022 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 03:16:45.305018 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:45.305018 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:45.305018 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:45.305018 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:45.305018 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:45.305018 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:45.305018 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:45.305018 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:45.305018 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:45.305018 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:45.305018 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:45.305018 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:45.305018 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:45.305018 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:45.305018 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:45.305018 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:45.305018 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 03:16:45.305908 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 03:16:45.305908 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:16:45.305908 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:16:45.309734 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 293/592] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:16:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:45.310783 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5777d32-ef1a-4f52-b347-53bdf90d8465 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:45.313781 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca83081-2d3a-4896-af39-712be5b917cb None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:45.352648 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e20869e-f2ba-4ac2-9464-020a5a181fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:45.353715 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20869e-f2ba-4ac2-9464-020a5a181fab None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:45.354317 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20869e-f2ba-4ac2-9464-020a5a181fab None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:45.354815 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20869e-f2ba-4ac2-9464-020a5a181fab None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:45.355799 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e20869e-f2ba-4ac2-9464-020a5a181fab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:45.356305 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e20869e-f2ba-4ac2-9464-020a5a181fab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:45.358037 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e20869e-f2ba-4ac2-9464-020a5a181fab None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:45.371355 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 300/593] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 03:16:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:45.372991 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e20869e-f2ba-4ac2-9464-020a5a181fab None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:45.422664 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5777d32-ef1a-4f52-b347-53bdf90d8465 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:45.452683 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:45.463018 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e92acc-6038-4279-b791-b9be3b668909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:45.463695 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e92acc-6038-4279-b791-b9be3b668909 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:45.463981 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e92acc-6038-4279-b791-b9be3b668909 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:45.464256 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e92acc-6038-4279-b791-b9be3b668909 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:45.471390 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e92acc-6038-4279-b791-b9be3b668909 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:45.472968 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e92acc-6038-4279-b791-b9be3b668909 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:45.485451 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-f7e92acc-6038-4279-b791-b9be3b668909 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 03:16:45.485451 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:45.485451 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:45.485451 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:45.485451 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:45.485451 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:45.485451 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:45.485451 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:45.485451 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:45.485451 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:45.485451 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:45.485451 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:45.485451 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 03:16:45.485451 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 03:16:45.485451 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 03:16:45.486353 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 03:16:45.486353 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:45.486353 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:45.486353 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:45.486353 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:45.486353 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:45.486353 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:45.486353 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:45.486353 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:45.486353 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:45.486353 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:45.486353 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:45.486353 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:45.486353 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:45.486353 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:45.486353 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:45.486353 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:45.487237 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 03:16:45.487237 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 03:16:45.487237 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 03:16:45.487237 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 03:16:45.487237 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 03:16:45.487237 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 03:16:45.487237 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 03:16:45.487237 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:16:45.487237 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 294/594] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 03:16:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:45.488203 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e92acc-6038-4279-b791-b9be3b668909 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:45.492554 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e20869e-f2ba-4ac2-9464-020a5a181fab None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:45.532852 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219cb111-953b-44fc-bf98-87f53399ce1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:45.533813 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219cb111-953b-44fc-bf98-87f53399ce1b None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:45.534298 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219cb111-953b-44fc-bf98-87f53399ce1b None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:45.534794 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219cb111-953b-44fc-bf98-87f53399ce1b None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:45.535679 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219cb111-953b-44fc-bf98-87f53399ce1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:45.536183 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219cb111-953b-44fc-bf98-87f53399ce1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:45.538462 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219cb111-953b-44fc-bf98-87f53399ce1b None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:45.541329 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:45.553274 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 301/595] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 03:16:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:45.554760 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219cb111-953b-44fc-bf98-87f53399ce1b None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:45.602554 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e92acc-6038-4279-b791-b9be3b668909 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:45.645228 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d05de2-e6a8-43a9-8a4c-763eb3e220e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:45.645932 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d05de2-e6a8-43a9-8a4c-763eb3e220e3 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:45.646137 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d05de2-e6a8-43a9-8a4c-763eb3e220e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:45.646416 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d05de2-e6a8-43a9-8a4c-763eb3e220e3 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:45.655009 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d05de2-e6a8-43a9-8a4c-763eb3e220e3 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:45.656494 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d05de2-e6a8-43a9-8a4c-763eb3e220e3 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:45.667926 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-83d05de2-e6a8-43a9-8a4c-763eb3e220e3 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 04 03:16:45.667926 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:45.667926 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:45.667926 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:45.667926 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:45.667926 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:45.667926 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:45.667926 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:45.667926 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:45.667926 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:45.667926 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:45.667926 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:45.667926 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 03:16:45.667926 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 03:16:45.667926 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 03:16:45.667926 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 03:16:45.668890 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:45.668890 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:45.668890 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 03:16:45.668890 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 03:16:45.668890 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 03:16:45.668890 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 03:16:45.668890 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:45.668890 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:45.668890 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:45.668890 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:45.668890 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:45.668890 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:45.668890 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:45.668890 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:45.668890 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:45.668890 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:45.668890 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:45.668890 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:45.669832 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:45.669832 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:45.669832 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 03:16:45.669832 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 03:16:45.669832 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 03:16:45.669832 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 03:16:45.669832 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 03:16:45.669832 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 03:16:45.669832 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 04 03:16:45.669832 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:16:45.669832 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 295/596] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Oct 4 03:16:45 2022] GET /identity/v3/users/neutron => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:45.674221 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219cb111-953b-44fc-bf98-87f53399ce1b None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:45.674342 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d05de2-e6a8-43a9-8a4c-763eb3e220e3 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:45.715537 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e0a61e-eb11-4a43-bb0b-536ab38dc4ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:45.716331 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e0a61e-eb11-4a43-bb0b-536ab38dc4ec None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:45.716712 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e0a61e-eb11-4a43-bb0b-536ab38dc4ec None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:45.717105 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e0a61e-eb11-4a43-bb0b-536ab38dc4ec None admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:45.717923 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e0a61e-eb11-4a43-bb0b-536ab38dc4ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:45.718337 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e0a61e-eb11-4a43-bb0b-536ab38dc4ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:45.720081 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e0a61e-eb11-4a43-bb0b-536ab38dc4ec None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:45.727049 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:45.735281 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 302/597] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 4 03:16:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:45.736906 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e0a61e-eb11-4a43-bb0b-536ab38dc4ec None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:45.785639 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d05de2-e6a8-43a9-8a4c-763eb3e220e3 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:45.800915 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:45.823285 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4115a650-f5a6-4921-9283-a71474657d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:45.823953 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4115a650-f5a6-4921-9283-a71474657d75 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:45.824235 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4115a650-f5a6-4921-9283-a71474657d75 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:45.824511 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4115a650-f5a6-4921-9283-a71474657d75 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:45.832452 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4115a650-f5a6-4921-9283-a71474657d75 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:45.834659 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4115a650-f5a6-4921-9283-a71474657d75 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:45.846990 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-4115a650-f5a6-4921-9283-a71474657d75 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 03:16:45.846990 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:45.846990 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:45.846990 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:45.846990 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:45.846990 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:45.846990 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:45.846990 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:45.846990 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:45.846990 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:45.846990 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:45.846990 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:45.846990 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 03:16:45.846990 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 03:16:45.846990 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 03:16:45.847926 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 03:16:45.847926 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:45.847926 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:45.847926 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:45.847926 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:45.847926 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:45.847926 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:45.847926 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:45.847926 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:45.847926 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:45.847926 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:45.847926 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:45.847926 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:45.847926 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:45.847926 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:45.847926 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:45.847926 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:45.848838 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 03:16:45.848838 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 03:16:45.848838 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 03:16:45.848838 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 03:16:45.848838 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 03:16:45.848838 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 03:16:45.848838 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 03:16:45.848838 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:16:45.849260 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e0a61e-eb11-4a43-bb0b-536ab38dc4ec None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:45.851652 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 296/598] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 03:16:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:45.852457 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4115a650-f5a6-4921-9283-a71474657d75 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:45.885127 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa888c11-55ed-4da3-955a-1429d347149f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:45.885845 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa888c11-55ed-4da3-955a-1429d347149f None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:45.886184 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa888c11-55ed-4da3-955a-1429d347149f None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:45.886459 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa888c11-55ed-4da3-955a-1429d347149f None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:45.887174 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa888c11-55ed-4da3-955a-1429d347149f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:45.887475 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa888c11-55ed-4da3-955a-1429d347149f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:45.888906 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa888c11-55ed-4da3-955a-1429d347149f None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:45.908199 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 303/599] 10.222.0.25 () {56 vars in 1139 bytes} [Tue Oct 4 03:16:45 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:45.909237 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44cd82b-b705-47d5-969e-35e5a503def0 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:45.909517 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44cd82b-b705-47d5-969e-35e5a503def0 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:45.909785 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44cd82b-b705-47d5-969e-35e5a503def0 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:45.915342 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 304/600] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:16:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:16:45.916176 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44cd82b-b705-47d5-969e-35e5a503def0 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:45.966324 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4115a650-f5a6-4921-9283-a71474657d75 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:45.973999 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:46.003933 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bd5148-8c87-4273-9f3a-02e37f901408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:46.004570 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bd5148-8c87-4273-9f3a-02e37f901408 None admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:46.004818 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bd5148-8c87-4273-9f3a-02e37f901408 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:46.005093 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bd5148-8c87-4273-9f3a-02e37f901408 None admin] PATH_INFO: `/v3/projects/80ae15e46620470b9c55fb7fe300fcb6/users/f537aabf3d1040ff840b02616f839975/roles/1f60934edaf04074936ff079756fc4a6` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:46.021753 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bd5148-8c87-4273-9f3a-02e37f901408 None admin] RBAC: Authorizing `identity:create_grant(project_id=80ae15e46620470b9c55fb7fe300fcb6, user_id=f537aabf3d1040ff840b02616f839975, role_id=1f60934edaf04074936ff079756fc4a6)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:46.023217 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bd5148-8c87-4273-9f3a-02e37f901408 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:46.026877 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44cd82b-b705-47d5-969e-35e5a503def0 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:46.038002 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 297/601] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Oct 4 03:16:45 2022] PUT /identity/v3/projects/80ae15e46620470b9c55fb7fe300fcb6/users/f537aabf3d1040ff840b02616f839975/roles/1f60934edaf04074936ff079756fc4a6 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:16:46.039086 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bd5148-8c87-4273-9f3a-02e37f901408 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:46.044870 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:46.068334 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248a6ada-567b-4567-b189-d625523a408c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:46.069573 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a6ada-567b-4567-b189-d625523a408c None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:46.070092 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a6ada-567b-4567-b189-d625523a408c None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:46.070405 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a6ada-567b-4567-b189-d625523a408c None admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:46.071116 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248a6ada-567b-4567-b189-d625523a408c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:46.071472 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248a6ada-567b-4567-b189-d625523a408c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:46.073045 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248a6ada-567b-4567-b189-d625523a408c None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:46.092383 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 305/602] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 4 03:16:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:46.092383 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff8d19c-0d06-45a0-b398-d9c9496908cf None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:46.092383 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff8d19c-0d06-45a0-b398-d9c9496908cf None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:46.092383 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff8d19c-0d06-45a0-b398-d9c9496908cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:46.111520 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-0ff8d19c-0d06-45a0-b398-d9c9496908cf None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:16:46.113101 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-0ff8d19c-0d06-45a0-b398-d9c9496908cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:16:46.196811 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bd5148-8c87-4273-9f3a-02e37f901408 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:46.199718 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 306/603] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:16:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 03:16:46.200786 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff8d19c-0d06-45a0-b398-d9c9496908cf None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:46.252656 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44974c9b-202e-493e-ade4-c52aa963a37c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:46.253286 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44974c9b-202e-493e-ade4-c52aa963a37c None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:46.253570 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44974c9b-202e-493e-ade4-c52aa963a37c None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:46.253845 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44974c9b-202e-493e-ade4-c52aa963a37c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:46.265603 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44974c9b-202e-493e-ade4-c52aa963a37c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:46.266822 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44974c9b-202e-493e-ade4-c52aa963a37c None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:46.283096 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-44974c9b-202e-493e-ade4-c52aa963a37c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:16:46.283096 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:46.283096 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:46.283096 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:46.283096 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:46.283096 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:46.283096 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:46.283096 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:46.283096 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:46.283096 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:46.283096 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:46.283096 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:46.283096 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 03:16:46.283096 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 03:16:46.283096 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 03:16:46.283096 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 03:16:46.284386 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:46.284386 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:46.284386 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:46.284386 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:46.284386 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:46.284386 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:46.284386 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:46.284386 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:46.284386 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:46.284386 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:46.284386 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:46.284386 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:46.284386 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:46.284386 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:46.284386 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:46.284386 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:46.284386 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 03:16:46.285679 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 03:16:46.285679 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:16:46.285679 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:16:46.285679 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 298/604] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:16:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:46.290575 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44974c9b-202e-493e-ade4-c52aa963a37c None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:46.310488 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:46.327734 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff8d19c-0d06-45a0-b398-d9c9496908cf None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:46.330331 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:46.367960 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedc8563-fb93-4c4e-aba4-b7acbd615b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:46.368854 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc8563-fb93-4c4e-aba4-b7acbd615b27 None admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:46.369127 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc8563-fb93-4c4e-aba4-b7acbd615b27 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:46.369635 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc8563-fb93-4c4e-aba4-b7acbd615b27 None admin] PATH_INFO: `/v3/projects/80ae15e46620470b9c55fb7fe300fcb6/users/95be0e4e1c8641709e07b115047fb4e1/roles/1f60934edaf04074936ff079756fc4a6` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:46.392168 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedc8563-fb93-4c4e-aba4-b7acbd615b27 None admin] RBAC: Authorizing `identity:create_grant(project_id=80ae15e46620470b9c55fb7fe300fcb6, user_id=95be0e4e1c8641709e07b115047fb4e1, role_id=1f60934edaf04074936ff079756fc4a6)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:46.394354 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedc8563-fb93-4c4e-aba4-b7acbd615b27 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:46.420379 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 307/605] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Oct 4 03:16:46 2022] PUT /identity/v3/projects/80ae15e46620470b9c55fb7fe300fcb6/users/95be0e4e1c8641709e07b115047fb4e1/roles/1f60934edaf04074936ff079756fc4a6 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:16:46.471014 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44974c9b-202e-493e-ade4-c52aa963a37c None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:46.525620 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedc8563-fb93-4c4e-aba4-b7acbd615b27 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:46.526418 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c510fff-4a8d-4089-8f17-e98e26eb6efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:46.527043 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c510fff-4a8d-4089-8f17-e98e26eb6efa None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:46.527326 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c510fff-4a8d-4089-8f17-e98e26eb6efa None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:46.527642 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c510fff-4a8d-4089-8f17-e98e26eb6efa None admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:46.528299 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c510fff-4a8d-4089-8f17-e98e26eb6efa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:46.528605 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c510fff-4a8d-4089-8f17-e98e26eb6efa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:46.529977 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c510fff-4a8d-4089-8f17-e98e26eb6efa None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:46.553683 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 299/606] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 03:16:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:46.559419 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c510fff-4a8d-4089-8f17-e98e26eb6efa None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:46.702737 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:46.707996 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedc8563-fb93-4c4e-aba4-b7acbd615b27 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:46.761671 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c510fff-4a8d-4089-8f17-e98e26eb6efa None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:46.763876 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e530e181-349d-49df-91dc-fce2fa435dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:46.764698 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530e181-349d-49df-91dc-fce2fa435dc3 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:46.765144 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530e181-349d-49df-91dc-fce2fa435dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:46.765576 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530e181-349d-49df-91dc-fce2fa435dc3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:46.779040 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e530e181-349d-49df-91dc-fce2fa435dc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:16:46.784139 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-e530e181-349d-49df-91dc-fce2fa435dc3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 03:16:46.784139 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:46.784139 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:46.784139 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:46.784139 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:46.784139 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:46.784139 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:46.784139 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:46.784139 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:46.784139 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:46.784139 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:46.784139 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:46.784139 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:16:46.784139 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:16:46.784139 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:16:46.784139 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:16:46.785319 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:16:46.785319 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:16:46.785319 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:16:46.785319 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:16:46.785319 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:46.785319 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:46.785319 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:46.785319 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:46.785319 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:46.785319 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:46.785319 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:46.785319 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:46.785319 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:46.785319 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:46.785319 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:46.785319 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:46.786410 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:46.786410 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:46.786410 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:46.786410 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:46.786410 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:16:46.786410 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:16:46.786410 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:16:46.786410 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:16:46.786410 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:16:46.786410 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:16:46.786410 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 03:16:46.786410 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:16:46.789285 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 308/607] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Oct 4 03:16:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 03:16:46.795154 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e530e181-349d-49df-91dc-fce2fa435dc3 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:46.804048 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e9d695-c0cc-4437-95cb-57febe678321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:46.804708 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9d695-c0cc-4437-95cb-57febe678321 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:46.804994 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9d695-c0cc-4437-95cb-57febe678321 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:46.805272 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9d695-c0cc-4437-95cb-57febe678321 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:46.813710 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:46.818467 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e9d695-c0cc-4437-95cb-57febe678321 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:46.818467 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e9d695-c0cc-4437-95cb-57febe678321 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:46.840645 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-15e9d695-c0cc-4437-95cb-57febe678321 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 03:16:46.840645 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:46.840645 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:46.840645 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:46.840645 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:46.840645 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:46.840645 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:46.840645 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:46.840645 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:46.840645 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:46.840645 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:46.840645 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:46.840645 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 03:16:46.840645 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 03:16:46.840645 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 03:16:46.841807 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 03:16:46.841807 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:46.841807 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:46.841807 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:46.841807 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:46.841807 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:46.841807 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:46.841807 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:46.841807 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:46.841807 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:46.841807 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:46.841807 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:46.841807 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:46.841807 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:46.841807 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:46.841807 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:46.841807 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:46.842998 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 03:16:46.842998 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 03:16:46.842998 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 03:16:46.842998 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 03:16:46.842998 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 03:16:46.842998 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 03:16:46.842998 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 03:16:46.842998 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:16:46.847341 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 300/608] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 03:16:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 03:16:46.853705 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e9d695-c0cc-4437-95cb-57febe678321 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:46.989292 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e530e181-349d-49df-91dc-fce2fa435dc3 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:47.037128 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e9d695-c0cc-4437-95cb-57febe678321 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:47.059701 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f99a67-669b-4498-a508-652e3e60735e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:47.060702 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f99a67-669b-4498-a508-652e3e60735e None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:47.061140 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f99a67-669b-4498-a508-652e3e60735e None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:47.061570 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f99a67-669b-4498-a508-652e3e60735e None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:47.062392 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f99a67-669b-4498-a508-652e3e60735e None admin] RBAC: Adding query filter params (name=service) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:47.062854 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f99a67-669b-4498-a508-652e3e60735e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:47.064405 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f99a67-669b-4498-a508-652e3e60735e None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:47.074262 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 309/609] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Oct 4 03:16:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:47.079776 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f99a67-669b-4498-a508-652e3e60735e None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:47.102923 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:47.119583 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d219b6-4ddc-4402-8579-1d28022e9b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:47.120192 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d219b6-4ddc-4402-8579-1d28022e9b91 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:47.120473 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d219b6-4ddc-4402-8579-1d28022e9b91 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:47.120745 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d219b6-4ddc-4402-8579-1d28022e9b91 None admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:47.121436 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d219b6-4ddc-4402-8579-1d28022e9b91 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:47.121740 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d219b6-4ddc-4402-8579-1d28022e9b91 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:47.123164 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d219b6-4ddc-4402-8579-1d28022e9b91 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:47.158177 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 301/610] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 4 03:16:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:16:47.164877 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d219b6-4ddc-4402-8579-1d28022e9b91 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:47.169839 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:47.189790 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f99a67-669b-4498-a508-652e3e60735e None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:47.225686 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0744f69b-4935-482f-9b18-bc8559654e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:47.226319 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0744f69b-4935-482f-9b18-bc8559654e47 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:47.226602 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0744f69b-4935-482f-9b18-bc8559654e47 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:47.226876 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0744f69b-4935-482f-9b18-bc8559654e47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:47.238625 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0744f69b-4935-482f-9b18-bc8559654e47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:47.240337 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0744f69b-4935-482f-9b18-bc8559654e47 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:47.255945 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-0744f69b-4935-482f-9b18-bc8559654e47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:16:47.255945 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:47.255945 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:47.255945 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:47.255945 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:47.255945 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:47.255945 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:47.255945 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:47.255945 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:47.255945 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:47.255945 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:47.255945 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:47.255945 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 03:16:47.255945 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 03:16:47.255945 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 03:16:47.255945 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 03:16:47.257084 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:47.257084 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:47.257084 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:47.257084 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:47.257084 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:47.257084 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:47.257084 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:47.257084 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:47.257084 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:47.257084 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:47.257084 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:47.257084 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:47.257084 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:47.257084 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:47.257084 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:47.257084 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:47.257084 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 03:16:47.258322 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 03:16:47.258322 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:16:47.258322 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:16:47.258322 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 310/611] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:16:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 03:16:47.262955 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0744f69b-4935-482f-9b18-bc8559654e47 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:47.383325 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0744f69b-4935-482f-9b18-bc8559654e47 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:47.416625 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:47.420625 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c0a73-bbc7-433d-98bf-b8e97c1f62e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:47.421309 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c0a73-bbc7-433d-98bf-b8e97c1f62e8 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:47.421701 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c0a73-bbc7-433d-98bf-b8e97c1f62e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:47.422115 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c0a73-bbc7-433d-98bf-b8e97c1f62e8 None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:47.422836 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395c0a73-bbc7-433d-98bf-b8e97c1f62e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:47.423216 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395c0a73-bbc7-433d-98bf-b8e97c1f62e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:47.424990 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395c0a73-bbc7-433d-98bf-b8e97c1f62e8 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:47.438896 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 311/612] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 03:16:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:47.444425 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c0a73-bbc7-433d-98bf-b8e97c1f62e8 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:47.445929 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d219b6-4ddc-4402-8579-1d28022e9b91 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:47.508862 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e70c367-1d90-45dc-a821-de0ff5f52278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:47.509739 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e70c367-1d90-45dc-a821-de0ff5f52278 None admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:47.510095 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e70c367-1d90-45dc-a821-de0ff5f52278 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:47.510447 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e70c367-1d90-45dc-a821-de0ff5f52278 None admin] PATH_INFO: `/v3/projects/80ae15e46620470b9c55fb7fe300fcb6/users/5e43cc9523d949a1bfa3dec882f2824f/roles/1f60934edaf04074936ff079756fc4a6` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:47.526913 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e70c367-1d90-45dc-a821-de0ff5f52278 None admin] RBAC: Authorizing `identity:create_grant(project_id=80ae15e46620470b9c55fb7fe300fcb6, user_id=5e43cc9523d949a1bfa3dec882f2824f, role_id=1f60934edaf04074936ff079756fc4a6)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:47.528486 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e70c367-1d90-45dc-a821-de0ff5f52278 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:47.544827 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 302/613] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Oct 4 03:16:47 2022] PUT /identity/v3/projects/80ae15e46620470b9c55fb7fe300fcb6/users/5e43cc9523d949a1bfa3dec882f2824f/roles/1f60934edaf04074936ff079756fc4a6 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:16:47.546317 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b9609-6877-4e78-a012-18630e07222b None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:47.547221 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b9609-6877-4e78-a012-18630e07222b None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:47.547625 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b9609-6877-4e78-a012-18630e07222b None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:47.549848 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 303/614] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:16:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:16:47.555912 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce4643-9219-49bc-a8e3-6e3566211cf8 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:47.556295 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce4643-9219-49bc-a8e3-6e3566211cf8 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:47.557013 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce4643-9219-49bc-a8e3-6e3566211cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:47.562230 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c0a73-bbc7-433d-98bf-b8e97c1f62e8 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:47.597478 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-61ce4643-9219-49bc-a8e3-6e3566211cf8 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:16:47.601884 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-61ce4643-9219-49bc-a8e3-6e3566211cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:16:47.639944 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c64366-0dae-4ccb-b23f-1d04b52a0c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:47.640600 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c64366-0dae-4ccb-b23f-1d04b52a0c69 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:47.640951 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c64366-0dae-4ccb-b23f-1d04b52a0c69 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:47.641282 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c64366-0dae-4ccb-b23f-1d04b52a0c69 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:47.657921 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c64366-0dae-4ccb-b23f-1d04b52a0c69 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:47.660724 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c64366-0dae-4ccb-b23f-1d04b52a0c69 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:47.684241 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:47.688210 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-25c64366-0dae-4ccb-b23f-1d04b52a0c69 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 04 03:16:47.688210 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:47.688210 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:47.688210 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:47.688210 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:47.688210 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:47.688210 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:47.688210 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:47.688210 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:47.688210 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:47.688210 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:47.688210 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:47.688210 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 03:16:47.688210 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 03:16:47.688210 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 03:16:47.688210 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 03:16:47.689453 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:47.689453 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:47.689453 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 03:16:47.689453 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 03:16:47.689453 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 03:16:47.689453 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 03:16:47.689453 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:47.689453 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:47.689453 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:47.689453 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:47.689453 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:47.689453 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:47.689453 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:47.689453 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:47.689453 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:47.689453 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:47.689453 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:47.689453 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:47.691681 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:47.691681 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:47.691681 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 03:16:47.691681 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 03:16:47.691681 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 03:16:47.691681 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 03:16:47.691681 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 03:16:47.691681 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 03:16:47.691681 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 04 03:16:47.691681 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:16:47.698654 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 312/615] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 4 03:16:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 03:16:47.701844 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c64366-0dae-4ccb-b23f-1d04b52a0c69 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:47.749727 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 304/616] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:16:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 03:16:47.773927 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:47.831126 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c64366-0dae-4ccb-b23f-1d04b52a0c69 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:47.866549 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c924dff7-5322-487f-9fd3-ad18badd2dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:47.867201 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c924dff7-5322-487f-9fd3-ad18badd2dba None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:47.867499 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c924dff7-5322-487f-9fd3-ad18badd2dba None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:47.867781 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c924dff7-5322-487f-9fd3-ad18badd2dba None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:47.868501 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c924dff7-5322-487f-9fd3-ad18badd2dba None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:47.868806 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c924dff7-5322-487f-9fd3-ad18badd2dba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:47.870230 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c924dff7-5322-487f-9fd3-ad18badd2dba None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:47.888910 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 313/617] 10.222.0.25 () {56 vars in 1135 bytes} [Tue Oct 4 03:16:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:47.894660 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce4643-9219-49bc-a8e3-6e3566211cf8 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:48.029026 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce4643-9219-49bc-a8e3-6e3566211cf8 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:48.066418 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c924dff7-5322-487f-9fd3-ad18badd2dba None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:48.075519 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edfe599-0193-48ec-875e-8a1e998373c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:48.075519 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edfe599-0193-48ec-875e-8a1e998373c5 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:48.075913 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edfe599-0193-48ec-875e-8a1e998373c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:48.076092 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edfe599-0193-48ec-875e-8a1e998373c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:48.088056 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edfe599-0193-48ec-875e-8a1e998373c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:48.089509 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edfe599-0193-48ec-875e-8a1e998373c5 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:48.106389 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-6edfe599-0193-48ec-875e-8a1e998373c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:16:48.106389 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:48.106389 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:48.106389 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:48.106389 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:48.106389 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:48.106389 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:48.106389 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:48.106389 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:48.106389 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:48.106389 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:48.106389 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:48.106389 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 03:16:48.106389 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 03:16:48.106389 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 03:16:48.106389 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 03:16:48.107362 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:48.107362 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:48.107362 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:48.107362 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:48.107362 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:48.107362 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:48.107362 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:48.107362 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:48.107362 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:48.107362 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:48.107362 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:48.107362 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:48.107362 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:48.107362 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:48.107362 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:48.107362 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:48.107362 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 03:16:48.108908 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 03:16:48.108908 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:16:48.108908 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:16:48.108908 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 305/618] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:16:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:48.113370 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edfe599-0193-48ec-875e-8a1e998373c5 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:48.139435 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:48.262322 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c924dff7-5322-487f-9fd3-ad18badd2dba None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:48.270144 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:48.282770 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edfe599-0193-48ec-875e-8a1e998373c5 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:48.300455 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31575aa-c249-4710-9750-d874b33c5c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:48.301088 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31575aa-c249-4710-9750-d874b33c5c87 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:48.301371 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31575aa-c249-4710-9750-d874b33c5c87 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:48.301641 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31575aa-c249-4710-9750-d874b33c5c87 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:48.321252 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31575aa-c249-4710-9750-d874b33c5c87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:16:48.326010 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-c31575aa-c249-4710-9750-d874b33c5c87 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 03:16:48.326010 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:48.326010 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:48.326010 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:48.326010 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:48.326010 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:48.326010 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:48.326010 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:48.326010 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:48.326010 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:48.326010 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:48.326010 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:48.326010 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:16:48.326010 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:16:48.326010 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:16:48.326010 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:16:48.328336 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:16:48.328336 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:16:48.328336 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:16:48.328336 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:16:48.328336 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:48.328336 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:48.328336 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:48.328336 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:48.328336 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:48.328336 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:48.328336 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:48.328336 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:48.328336 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:48.328336 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:48.328336 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:48.328336 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:48.330393 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:48.330393 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:48.330393 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:48.330393 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:48.330393 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:16:48.330393 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:16:48.330393 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:16:48.330393 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:16:48.330393 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:16:48.330393 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:16:48.330393 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 03:16:48.330393 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:16:48.330393 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 314/619] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Oct 4 03:16:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 03:16:48.337730 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31575aa-c249-4710-9750-d874b33c5c87 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:48.351585 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d6028f-d299-465b-8e76-9bce8a87cb5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:48.352203 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d6028f-d299-465b-8e76-9bce8a87cb5f None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:48.352484 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d6028f-d299-465b-8e76-9bce8a87cb5f None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:48.352756 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d6028f-d299-465b-8e76-9bce8a87cb5f None admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:48.353784 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d6028f-d299-465b-8e76-9bce8a87cb5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:48.354100 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d6028f-d299-465b-8e76-9bce8a87cb5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:48.355552 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d6028f-d299-465b-8e76-9bce8a87cb5f None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:48.369223 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 306/620] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 03:16:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:16:48.375251 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d6028f-d299-465b-8e76-9bce8a87cb5f None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:48.536456 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:48.542416 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31575aa-c249-4710-9750-d874b33c5c87 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:48.577367 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d6028f-d299-465b-8e76-9bce8a87cb5f None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:48.621677 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45894aab-f916-4116-be06-5a51d71d0d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:48.622341 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45894aab-f916-4116-be06-5a51d71d0d80 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:48.622631 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45894aab-f916-4116-be06-5a51d71d0d80 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:48.622902 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45894aab-f916-4116-be06-5a51d71d0d80 None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:48.623600 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45894aab-f916-4116-be06-5a51d71d0d80 None admin] RBAC: Adding query filter params (name=service) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:48.623909 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45894aab-f916-4116-be06-5a51d71d0d80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:48.625293 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45894aab-f916-4116-be06-5a51d71d0d80 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:48.629941 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abd7a67-cb1c-452a-a2bd-88ae0d2ef263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:48.630573 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abd7a67-cb1c-452a-a2bd-88ae0d2ef263 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:48.630852 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abd7a67-cb1c-452a-a2bd-88ae0d2ef263 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:48.631279 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abd7a67-cb1c-452a-a2bd-88ae0d2ef263 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:48.638574 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abd7a67-cb1c-452a-a2bd-88ae0d2ef263 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:48.640043 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abd7a67-cb1c-452a-a2bd-88ae0d2ef263 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:48.647835 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 315/621] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Oct 4 03:16:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:48.652217 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-5abd7a67-cb1c-452a-a2bd-88ae0d2ef263 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 03:16:48.652217 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:48.652217 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:48.652217 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:48.652217 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:48.652217 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:48.652217 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:48.652217 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:48.652217 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:48.652217 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:48.652217 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:48.652217 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:48.652217 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 03:16:48.652217 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 03:16:48.652217 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 03:16:48.654291 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 03:16:48.654291 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:48.654291 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:48.654291 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:48.654291 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:48.654291 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:48.654291 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:48.654291 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:48.654291 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:48.654291 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:48.654291 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:48.654291 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:48.654291 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:48.654291 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:48.654291 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:48.654291 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:48.654291 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:48.656622 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 03:16:48.656622 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 03:16:48.656622 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 03:16:48.656622 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 03:16:48.656622 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 03:16:48.656622 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 03:16:48.656622 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 03:16:48.656622 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:16:48.657628 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45894aab-f916-4116-be06-5a51d71d0d80 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:48.657791 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 307/622] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 03:16:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 03:16:48.664515 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abd7a67-cb1c-452a-a2bd-88ae0d2ef263 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:48.690651 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:48.772346 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45894aab-f916-4116-be06-5a51d71d0d80 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:48.775840 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abd7a67-cb1c-452a-a2bd-88ae0d2ef263 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:48.812489 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110c0513-35f6-42a8-9338-a6fb3ed57a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:48.813030 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c0513-35f6-42a8-9338-a6fb3ed57a78 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:48.813353 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c0513-35f6-42a8-9338-a6fb3ed57a78 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:48.813625 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c0513-35f6-42a8-9338-a6fb3ed57a78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:48.820472 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2c69d4-1ccf-4df1-ab60-cf35dacd0510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:48.821218 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c69d4-1ccf-4df1-ab60-cf35dacd0510 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:48.822171 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c69d4-1ccf-4df1-ab60-cf35dacd0510 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:48.822514 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c69d4-1ccf-4df1-ab60-cf35dacd0510 None admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:48.823791 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2c69d4-1ccf-4df1-ab60-cf35dacd0510 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:48.824170 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2c69d4-1ccf-4df1-ab60-cf35dacd0510 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:48.825278 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110c0513-35f6-42a8-9338-a6fb3ed57a78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:48.826003 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2c69d4-1ccf-4df1-ab60-cf35dacd0510 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:48.826756 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110c0513-35f6-42a8-9338-a6fb3ed57a78 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:48.835953 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:48.844730 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 308/623] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 4 03:16:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:48.846469 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b7999-214e-4a04-8c18-3bfebb032799 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:48.847108 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b7999-214e-4a04-8c18-3bfebb032799 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:48.847476 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b7999-214e-4a04-8c18-3bfebb032799 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:48.847634 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-110c0513-35f6-42a8-9338-a6fb3ed57a78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:16:48.847634 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:48.847634 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:48.847634 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:48.847634 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:48.847634 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:48.847634 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:48.847634 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:48.847634 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:48.847634 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:48.847634 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:48.847634 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:48.847634 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 03:16:48.847634 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 03:16:48.847634 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 03:16:48.847634 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 03:16:48.848738 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:48.848738 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:48.848738 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:48.848738 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:48.848738 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:48.848738 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:48.848738 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:48.848738 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:48.848738 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:48.848738 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:48.848738 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:48.848738 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:48.848738 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:48.848738 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:48.848738 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:48.848738 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:48.848738 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 03:16:48.850576 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 03:16:48.850576 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:16:48.850576 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:16:48.852353 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 316/625] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:16:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 03:16:48.853353 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110c0513-35f6-42a8-9338-a6fb3ed57a78 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:48.855752 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 309/625] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:16:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:16:48.857062 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2f3ef-399b-4778-ada4-f810f8b37913 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:48.857421 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2f3ef-399b-4778-ada4-f810f8b37913 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:48.857765 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2f3ef-399b-4778-ada4-f810f8b37913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:48.875692 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-a6b2f3ef-399b-4778-ada4-f810f8b37913 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:16:48.877006 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-a6b2f3ef-399b-4778-ada4-f810f8b37913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:16:48.943123 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:48.955978 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 310/626] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:16:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 03:16:48.957006 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b2f3ef-399b-4778-ada4-f810f8b37913 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:48.965101 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110c0513-35f6-42a8-9338-a6fb3ed57a78 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:49.001852 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe3f340-92c4-460f-935f-4882a2f71a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:49.002960 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3f340-92c4-460f-935f-4882a2f71a37 None admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:49.003524 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3f340-92c4-460f-935f-4882a2f71a37 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:49.004019 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3f340-92c4-460f-935f-4882a2f71a37 None admin] PATH_INFO: `/v3/projects/80ae15e46620470b9c55fb7fe300fcb6/users/1d8da6bacc8f432e8f48bb99c7aede11/roles/1f60934edaf04074936ff079756fc4a6` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:49.020081 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe3f340-92c4-460f-935f-4882a2f71a37 None admin] RBAC: Authorizing `identity:create_grant(project_id=80ae15e46620470b9c55fb7fe300fcb6, user_id=1d8da6bacc8f432e8f48bb99c7aede11, role_id=1f60934edaf04074936ff079756fc4a6)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:49.022058 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe3f340-92c4-460f-935f-4882a2f71a37 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:49.043131 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 317/627] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Oct 4 03:16:48 2022] PUT /identity/v3/projects/80ae15e46620470b9c55fb7fe300fcb6/users/1d8da6bacc8f432e8f48bb99c7aede11/roles/1f60934edaf04074936ff079756fc4a6 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:16:49.118865 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b2f3ef-399b-4778-ada4-f810f8b37913 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:49.166274 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:49.172948 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5235ff-aba6-4886-86e0-77c0538794e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:49.177318 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5235ff-aba6-4886-86e0-77c0538794e5 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:49.177318 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5235ff-aba6-4886-86e0-77c0538794e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:49.177318 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5235ff-aba6-4886-86e0-77c0538794e5 None admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:49.177318 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5235ff-aba6-4886-86e0-77c0538794e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:49.177318 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5235ff-aba6-4886-86e0-77c0538794e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:49.177318 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5235ff-aba6-4886-86e0-77c0538794e5 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:49.194604 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 311/628] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 03:16:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:49.201683 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe3f340-92c4-460f-935f-4882a2f71a37 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:49.275664 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a44328-8890-4938-952b-448a4b6c1047 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:49.276033 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a44328-8890-4938-952b-448a4b6c1047 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:49.276208 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a44328-8890-4938-952b-448a4b6c1047 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:49.277767 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 312/629] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:16:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 03:16:49.287004 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e5c85-5e73-4ec7-a62a-cf5371d53b31 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:49.287344 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e5c85-5e73-4ec7-a62a-cf5371d53b31 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:49.287647 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e5c85-5e73-4ec7-a62a-cf5371d53b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:49.314407 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-285e5c85-5e73-4ec7-a62a-cf5371d53b31 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:16:49.316237 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-285e5c85-5e73-4ec7-a62a-cf5371d53b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:16:49.325605 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe3f340-92c4-460f-935f-4882a2f71a37 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:49.358033 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:49.367225 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f522322-1d61-4fcf-88dc-e1b7bb55ba87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:49.367891 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f522322-1d61-4fcf-88dc-e1b7bb55ba87 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:49.368174 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f522322-1d61-4fcf-88dc-e1b7bb55ba87 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:49.368448 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f522322-1d61-4fcf-88dc-e1b7bb55ba87 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:49.377583 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f522322-1d61-4fcf-88dc-e1b7bb55ba87 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:49.378961 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f522322-1d61-4fcf-88dc-e1b7bb55ba87 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:49.392348 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-9f522322-1d61-4fcf-88dc-e1b7bb55ba87 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 03:16:49.392348 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:49.392348 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:49.392348 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:49.392348 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:49.392348 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:49.392348 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:49.392348 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:49.392348 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:49.392348 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:49.392348 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:49.392348 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:49.392348 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 03:16:49.392348 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 03:16:49.392348 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 03:16:49.392348 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 03:16:49.393323 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:49.393323 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:49.393323 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 03:16:49.393323 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 03:16:49.393323 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 03:16:49.393323 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 03:16:49.393323 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:49.393323 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:49.393323 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:49.393323 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:49.393323 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:49.393323 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:49.393323 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:49.393323 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:49.393323 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:49.393323 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:49.393323 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:49.393323 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:49.394266 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:49.394266 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:49.394266 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 03:16:49.394266 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 03:16:49.394266 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 03:16:49.394266 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 03:16:49.394266 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 03:16:49.394266 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 03:16:49.394266 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 03:16:49.394266 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:16:49.394266 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 318/630] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Oct 4 03:16:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:49.394879 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f522322-1d61-4fcf-88dc-e1b7bb55ba87 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:49.406969 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 313/631] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:16:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 03:16:49.408522 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285e5c85-5e73-4ec7-a62a-cf5371d53b31 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:49.513286 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f522322-1d61-4fcf-88dc-e1b7bb55ba87 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:49.540163 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285e5c85-5e73-4ec7-a62a-cf5371d53b31 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:49.552682 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999bdb1e-eddd-47be-89ad-34945e356d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:49.554439 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999bdb1e-eddd-47be-89ad-34945e356d80 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:49.555146 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999bdb1e-eddd-47be-89ad-34945e356d80 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:49.555584 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999bdb1e-eddd-47be-89ad-34945e356d80 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:49.562348 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:49.570620 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999bdb1e-eddd-47be-89ad-34945e356d80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:16:49.577605 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-999bdb1e-eddd-47be-89ad-34945e356d80 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 03:16:49.577605 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:49.577605 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:49.577605 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:49.577605 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:49.577605 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:49.577605 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:49.577605 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:49.577605 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:49.577605 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:49.577605 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:49.577605 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:49.577605 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:16:49.577605 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:16:49.577605 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:16:49.577605 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:16:49.578703 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:16:49.578703 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:16:49.578703 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:16:49.578703 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:16:49.578703 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:49.578703 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:49.578703 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:49.578703 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:49.578703 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:49.578703 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:49.578703 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:49.578703 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:49.578703 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:49.578703 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:49.578703 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:49.578703 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:49.579763 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:49.579763 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:49.579763 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:49.579763 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:49.579763 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:16:49.579763 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:16:49.579763 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:16:49.579763 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:16:49.579763 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:16:49.579763 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:16:49.579763 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 03:16:49.579763 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:16:49.580561 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1823d865-90e3-4d0f-ad50-d245daeced79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:49.581250 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1823d865-90e3-4d0f-ad50-d245daeced79 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:49.581631 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1823d865-90e3-4d0f-ad50-d245daeced79 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:49.581972 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1823d865-90e3-4d0f-ad50-d245daeced79 None admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:49.582713 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 319/632] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Oct 4 03:16:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:49.582813 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1823d865-90e3-4d0f-ad50-d245daeced79 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:49.586237 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1823d865-90e3-4d0f-ad50-d245daeced79 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:49.586237 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1823d865-90e3-4d0f-ad50-d245daeced79 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:49.591523 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999bdb1e-eddd-47be-89ad-34945e356d80 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:49.604840 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 314/633] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Oct 4 03:16:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:49.610316 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1823d865-90e3-4d0f-ad50-d245daeced79 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:49.680270 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:49.764685 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1823d865-90e3-4d0f-ad50-d245daeced79 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:49.795472 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999bdb1e-eddd-47be-89ad-34945e356d80 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:49.817344 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d337c5-f5f1-412c-bbab-46670f8a4ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:49.817952 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d337c5-f5f1-412c-bbab-46670f8a4ceb None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:49.818225 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d337c5-f5f1-412c-bbab-46670f8a4ceb None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:49.819360 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d337c5-f5f1-412c-bbab-46670f8a4ceb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:49.837095 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1897bf-8d76-4e46-9fb5-f355a9a65d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:49.837706 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1897bf-8d76-4e46-9fb5-f355a9a65d30 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:49.837983 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1897bf-8d76-4e46-9fb5-f355a9a65d30 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:49.838386 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1897bf-8d76-4e46-9fb5-f355a9a65d30 None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:49.839026 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1897bf-8d76-4e46-9fb5-f355a9a65d30 None admin] RBAC: Adding query filter params (name=service) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:49.839440 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1897bf-8d76-4e46-9fb5-f355a9a65d30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:49.840831 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1897bf-8d76-4e46-9fb5-f355a9a65d30 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:49.852075 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 320/634] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Oct 4 03:16:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:16:49.852905 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1897bf-8d76-4e46-9fb5-f355a9a65d30 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:49.880668 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:49.906607 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d337c5-f5f1-412c-bbab-46670f8a4ceb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:49.907988 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d337c5-f5f1-412c-bbab-46670f8a4ceb None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:49.982497 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1897bf-8d76-4e46-9fb5-f355a9a65d30 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:49.999281 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:50.029030 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4d5f51-c124-44da-87a9-44b56d27ec86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:50.029663 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d5f51-c124-44da-87a9-44b56d27ec86 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:50.029948 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d5f51-c124-44da-87a9-44b56d27ec86 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:50.030227 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d5f51-c124-44da-87a9-44b56d27ec86 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:50.037803 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 315/635] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 03:16:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 04 03:16:50.038914 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d337c5-f5f1-412c-bbab-46670f8a4ceb None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:50.049900 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4d5f51-c124-44da-87a9-44b56d27ec86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:16:50.055970 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-ff4d5f51-c124-44da-87a9-44b56d27ec86 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 03:16:50.055970 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:50.055970 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:50.055970 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:50.055970 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:50.055970 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:50.055970 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:50.055970 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:50.055970 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:50.055970 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:50.055970 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:50.055970 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:50.055970 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:16:50.055970 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:16:50.055970 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:16:50.055970 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:16:50.056930 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:16:50.056930 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:16:50.056930 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:16:50.056930 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:16:50.056930 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:50.056930 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:50.056930 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:50.056930 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:50.056930 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:50.056930 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:50.056930 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:50.056930 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:50.056930 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:50.056930 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:50.056930 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:50.056930 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:50.057778 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:50.057778 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:50.057778 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:50.057778 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:50.057778 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:16:50.057778 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:16:50.057778 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:16:50.057778 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:16:50.057778 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:16:50.057778 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:16:50.057778 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 03:16:50.057778 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:16:50.060401 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 321/636] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Oct 4 03:16:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:50.061413 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4d5f51-c124-44da-87a9-44b56d27ec86 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:50.129029 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:50.152183 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d337c5-f5f1-412c-bbab-46670f8a4ceb None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:50.184623 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4d5f51-c124-44da-87a9-44b56d27ec86 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:50.187898 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf42408-7aeb-47e0-a74a-a14f607d70f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:50.188179 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf42408-7aeb-47e0-a74a-a14f607d70f2 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:50.188468 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf42408-7aeb-47e0-a74a-a14f607d70f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:50.188742 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf42408-7aeb-47e0-a74a-a14f607d70f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:50.199364 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf42408-7aeb-47e0-a74a-a14f607d70f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:50.200828 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf42408-7aeb-47e0-a74a-a14f607d70f2 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:50.216363 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-baf42408-7aeb-47e0-a74a-a14f607d70f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:16:50.216363 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:50.216363 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:50.216363 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:50.216363 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:50.216363 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:50.216363 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:50.216363 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:50.216363 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:50.216363 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:50.216363 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:50.216363 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:50.216363 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 03:16:50.216363 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 03:16:50.216363 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 03:16:50.216363 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 03:16:50.217387 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:50.217387 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:50.217387 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:50.217387 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:50.217387 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:50.217387 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:50.217387 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:50.217387 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:50.217387 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:50.217387 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:50.217387 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:50.217387 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:50.217387 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:50.217387 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:50.217387 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:50.217387 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:50.217387 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 03:16:50.218275 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 03:16:50.218275 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:16:50.218275 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:16:50.218275 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 316/637] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:16:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:50.218928 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf42408-7aeb-47e0-a74a-a14f607d70f2 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:50.227080 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbdfc3e-ef57-404c-94c7-7412632e2d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:50.228192 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbdfc3e-ef57-404c-94c7-7412632e2d2e None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:50.228831 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbdfc3e-ef57-404c-94c7-7412632e2d2e None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:50.229316 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbdfc3e-ef57-404c-94c7-7412632e2d2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:50.246267 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbdfc3e-ef57-404c-94c7-7412632e2d2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:50.248294 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbdfc3e-ef57-404c-94c7-7412632e2d2e None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:50.265448 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-efbdfc3e-ef57-404c-94c7-7412632e2d2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:16:50.265448 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:50.265448 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:50.265448 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:50.265448 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:50.265448 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:50.265448 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:50.265448 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:50.265448 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:50.265448 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:50.265448 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:50.265448 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:50.265448 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 03:16:50.265448 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 03:16:50.265448 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 03:16:50.265448 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 03:16:50.266473 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:50.266473 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:50.266473 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:50.266473 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:50.266473 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:50.266473 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:50.266473 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:50.266473 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:50.266473 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:50.266473 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:50.266473 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:50.266473 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:50.266473 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:50.266473 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:50.266473 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:50.266473 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:50.266473 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 03:16:50.267387 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 03:16:50.267387 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:16:50.267387 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:16:50.269313 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 322/638] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:16:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:50.270282 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbdfc3e-ef57-404c-94c7-7412632e2d2e None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:50.305037 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:50.349206 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf42408-7aeb-47e0-a74a-a14f607d70f2 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:50.378478 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:50.385728 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c710de-ece4-4938-96a9-1d944a5fb800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:50.386333 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c710de-ece4-4938-96a9-1d944a5fb800 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:50.386620 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c710de-ece4-4938-96a9-1d944a5fb800 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:50.386897 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c710de-ece4-4938-96a9-1d944a5fb800 None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:50.387592 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c710de-ece4-4938-96a9-1d944a5fb800 None admin] RBAC: Adding query filter params (name=service) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:50.387903 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c710de-ece4-4938-96a9-1d944a5fb800 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:50.393422 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbdfc3e-ef57-404c-94c7-7412632e2d2e None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:50.393746 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c710de-ece4-4938-96a9-1d944a5fb800 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:50.407572 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 317/639] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Oct 4 03:16:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:50.407572 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c710de-ece4-4938-96a9-1d944a5fb800 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:50.436678 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5026cab-6437-45b8-b719-0fcab439d2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:50.437488 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5026cab-6437-45b8-b719-0fcab439d2db None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:50.437933 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5026cab-6437-45b8-b719-0fcab439d2db None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:50.438219 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5026cab-6437-45b8-b719-0fcab439d2db None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:50.438884 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5026cab-6437-45b8-b719-0fcab439d2db None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:50.439191 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5026cab-6437-45b8-b719-0fcab439d2db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:50.440585 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5026cab-6437-45b8-b719-0fcab439d2db None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:50.453367 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 323/640] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 03:16:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:50.458685 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033f40f-a7ae-4e76-b051-ee9e7bc495e7 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:50.459559 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033f40f-a7ae-4e76-b051-ee9e7bc495e7 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:50.459854 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033f40f-a7ae-4e76-b051-ee9e7bc495e7 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:50.465215 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 324/641] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:16:50 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:16:50.465837 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d033f40f-a7ae-4e76-b051-ee9e7bc495e7 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:50.523213 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c710de-ece4-4938-96a9-1d944a5fb800 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:50.558011 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd14f051-4caa-4943-bf21-7fab6c689622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:50.559153 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd14f051-4caa-4943-bf21-7fab6c689622 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:50.559624 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd14f051-4caa-4943-bf21-7fab6c689622 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:50.559888 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:50.560333 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd14f051-4caa-4943-bf21-7fab6c689622 None admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:50.562994 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd14f051-4caa-4943-bf21-7fab6c689622 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:50.562994 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd14f051-4caa-4943-bf21-7fab6c689622 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:50.565196 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd14f051-4caa-4943-bf21-7fab6c689622 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:50.582708 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 318/642] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 03:16:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:50.582708 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd14f051-4caa-4943-bf21-7fab6c689622 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:50.584788 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d033f40f-a7ae-4e76-b051-ee9e7bc495e7 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:50.630103 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8623b8a-26da-45aa-b21d-ff3170e8613a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:50.630728 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8623b8a-26da-45aa-b21d-ff3170e8613a None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:50.631096 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8623b8a-26da-45aa-b21d-ff3170e8613a None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:50.631373 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8623b8a-26da-45aa-b21d-ff3170e8613a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:50.638690 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:50.647718 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8623b8a-26da-45aa-b21d-ff3170e8613a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:50.649154 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8623b8a-26da-45aa-b21d-ff3170e8613a None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:50.666583 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-b8623b8a-26da-45aa-b21d-ff3170e8613a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:16:50.666583 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:50.666583 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:50.666583 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:50.666583 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:50.666583 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:50.666583 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:50.666583 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:50.666583 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:50.666583 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:50.666583 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:50.666583 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:50.666583 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 03:16:50.666583 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 03:16:50.666583 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 03:16:50.666583 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 03:16:50.667636 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:50.667636 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:50.667636 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:50.667636 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:50.667636 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:50.667636 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:50.667636 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:50.667636 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:50.667636 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:50.667636 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:50.667636 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:50.667636 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:50.667636 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:50.667636 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:50.667636 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:50.667636 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:50.667636 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 03:16:50.668561 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 03:16:50.668561 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:16:50.668561 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:16:50.668561 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 325/643] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:16:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:50.669687 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff13db-0462-4633-93c1-07a197d10dd2 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:50.669973 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff13db-0462-4633-93c1-07a197d10dd2 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:50.670241 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff13db-0462-4633-93c1-07a197d10dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:50.690151 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-c3ff13db-0462-4633-93c1-07a197d10dd2 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:16:50.691272 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-c3ff13db-0462-4633-93c1-07a197d10dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:16:50.693619 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd14f051-4caa-4943-bf21-7fab6c689622 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:50.729207 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa17ecc-d4e1-4fb4-a21e-2ce1655f5516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:50.729450 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa17ecc-d4e1-4fb4-a21e-2ce1655f5516 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:50.729547 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa17ecc-d4e1-4fb4-a21e-2ce1655f5516 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:50.729822 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa17ecc-d4e1-4fb4-a21e-2ce1655f5516 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:50.736912 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa17ecc-d4e1-4fb4-a21e-2ce1655f5516 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:50.738336 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa17ecc-d4e1-4fb4-a21e-2ce1655f5516 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:50.750112 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-0fa17ecc-d4e1-4fb4-a21e-2ce1655f5516 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 03:16:50.750112 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:50.750112 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:50.750112 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:50.750112 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:50.750112 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:50.750112 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:50.750112 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:50.750112 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:50.750112 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:50.750112 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:50.750112 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:50.750112 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 03:16:50.750112 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 03:16:50.750112 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 03:16:50.750112 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 03:16:50.751066 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:50.751066 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:50.751066 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 03:16:50.751066 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 03:16:50.751066 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 03:16:50.751066 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 03:16:50.751066 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:50.751066 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:50.751066 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:50.751066 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:50.751066 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:50.751066 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:50.751066 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:50.751066 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:50.751066 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:50.751066 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:50.751066 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:50.751066 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:50.752197 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:50.752197 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:50.752197 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 03:16:50.752197 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 03:16:50.752197 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 03:16:50.752197 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 03:16:50.752197 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 03:16:50.752197 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 03:16:50.752197 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 03:16:50.752197 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:16:50.752197 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 319/644] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 03:16:50 2022] GET /identity/v3/users/cinder => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:50.752197 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa17ecc-d4e1-4fb4-a21e-2ce1655f5516 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:50.767850 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 326/645] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:16:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 03:16:50.768616 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ff13db-0462-4633-93c1-07a197d10dd2 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:50.838775 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:50.876239 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ff13db-0462-4633-93c1-07a197d10dd2 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:50.906681 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa17ecc-d4e1-4fb4-a21e-2ce1655f5516 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:50.920213 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:50.923327 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db21d91-47c4-4207-8496-d309bd7f6079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:50.924483 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db21d91-47c4-4207-8496-d309bd7f6079 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:50.924985 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db21d91-47c4-4207-8496-d309bd7f6079 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:50.926330 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db21d91-47c4-4207-8496-d309bd7f6079 None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:50.927195 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db21d91-47c4-4207-8496-d309bd7f6079 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:50.928275 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db21d91-47c4-4207-8496-d309bd7f6079 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:50.930536 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db21d91-47c4-4207-8496-d309bd7f6079 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:50.944790 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674db858-84b4-468c-a832-a31af1584a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:50.945618 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674db858-84b4-468c-a832-a31af1584a8e None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:50.945894 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674db858-84b4-468c-a832-a31af1584a8e None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:50.946166 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674db858-84b4-468c-a832-a31af1584a8e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:50.948446 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 327/646] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 03:16:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:50.949484 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db21d91-47c4-4207-8496-d309bd7f6079 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:50.957619 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674db858-84b4-468c-a832-a31af1584a8e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:50.959723 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674db858-84b4-468c-a832-a31af1584a8e None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:50.971985 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-674db858-84b4-468c-a832-a31af1584a8e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 03:16:50.971985 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:50.971985 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:50.971985 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:50.971985 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:50.971985 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:50.971985 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:50.971985 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:50.971985 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:50.971985 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:50.971985 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:50.971985 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:50.971985 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 03:16:50.971985 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 03:16:50.971985 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 03:16:50.972932 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 03:16:50.972932 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:50.972932 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:50.972932 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:50.972932 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:50.972932 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:50.972932 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:50.972932 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:50.972932 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:50.972932 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:50.972932 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:50.972932 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:50.972932 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:50.972932 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:50.972932 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:50.972932 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:50.972932 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:50.973820 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 03:16:50.973820 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 03:16:50.973820 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 03:16:50.973820 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 03:16:50.973820 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 03:16:50.973820 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 03:16:50.973820 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 03:16:50.973820 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:16:50.978339 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 320/647] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 03:16:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:50.979533 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674db858-84b4-468c-a832-a31af1584a8e None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:51.082049 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db21d91-47c4-4207-8496-d309bd7f6079 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:51.085912 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674db858-84b4-468c-a832-a31af1584a8e None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:51.109565 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:51.120001 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec855015-0966-483b-8b5b-ee142ad5a5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:51.120595 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec855015-0966-483b-8b5b-ee142ad5a5ed None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:51.120870 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec855015-0966-483b-8b5b-ee142ad5a5ed None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:51.121136 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec855015-0966-483b-8b5b-ee142ad5a5ed None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:51.121449 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9926ef-a7dc-44a3-a23d-d73076ccd069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:51.121852 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec855015-0966-483b-8b5b-ee142ad5a5ed None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:51.122068 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9926ef-a7dc-44a3-a23d-d73076ccd069 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:51.122165 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec855015-0966-483b-8b5b-ee142ad5a5ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:51.122347 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9926ef-a7dc-44a3-a23d-d73076ccd069 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:51.122620 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9926ef-a7dc-44a3-a23d-d73076ccd069 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:51.123647 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec855015-0966-483b-8b5b-ee142ad5a5ed None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:51.130774 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9926ef-a7dc-44a3-a23d-d73076ccd069 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:51.132396 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9926ef-a7dc-44a3-a23d-d73076ccd069 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:51.147124 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 328/648] 10.222.0.25 () {56 vars in 1137 bytes} [Tue Oct 4 03:16:50 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:51.147124 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec855015-0966-483b-8b5b-ee142ad5a5ed None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:51.148222 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-1f9926ef-a7dc-44a3-a23d-d73076ccd069 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 04 03:16:51.148222 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:51.148222 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:51.148222 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:51.148222 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:51.148222 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:51.148222 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:51.148222 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:51.148222 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:51.148222 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:51.148222 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:51.148222 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:51.148222 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 03:16:51.148222 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 03:16:51.148222 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 03:16:51.148222 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 03:16:51.149135 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:51.149135 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:51.149135 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 03:16:51.149135 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 03:16:51.149135 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 03:16:51.149135 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 03:16:51.149135 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:51.149135 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:51.149135 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:51.149135 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:51.149135 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:51.149135 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:51.149135 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:51.149135 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:51.149135 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:51.149135 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:51.149135 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:51.149135 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:51.150072 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:51.150072 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:51.150072 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 03:16:51.150072 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 03:16:51.150072 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 03:16:51.150072 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 03:16:51.150072 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 03:16:51.150072 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 03:16:51.150072 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 04 03:16:51.150072 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:16:51.150072 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 321/649] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 03:16:50 2022] GET /identity/v3/users/glance => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:51.150072 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9926ef-a7dc-44a3-a23d-d73076ccd069 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:51.181859 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:51.259177 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec855015-0966-483b-8b5b-ee142ad5a5ed None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:51.260307 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9926ef-a7dc-44a3-a23d-d73076ccd069 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:51.295806 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f682a7-572d-415d-8656-163abb4017ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:51.296429 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f682a7-572d-415d-8656-163abb4017ff None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:51.296712 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f682a7-572d-415d-8656-163abb4017ff None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:51.296987 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f682a7-572d-415d-8656-163abb4017ff None admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:51.297690 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f682a7-572d-415d-8656-163abb4017ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:51.297998 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f682a7-572d-415d-8656-163abb4017ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:51.299517 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f682a7-572d-415d-8656-163abb4017ff None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:51.300658 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708fbdd6-2ab6-4e6e-9328-9799ba50b9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:51.301540 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708fbdd6-2ab6-4e6e-9328-9799ba50b9c1 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:51.302018 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708fbdd6-2ab6-4e6e-9328-9799ba50b9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:51.302511 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708fbdd6-2ab6-4e6e-9328-9799ba50b9c1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:51.312849 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 329/650] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 4 03:16:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:51.314060 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f682a7-572d-415d-8656-163abb4017ff None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:51.320312 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708fbdd6-2ab6-4e6e-9328-9799ba50b9c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:16:51.327047 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-708fbdd6-2ab6-4e6e-9328-9799ba50b9c1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 03:16:51.327047 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:51.327047 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:51.327047 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:51.327047 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:51.327047 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:51.327047 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:51.327047 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:51.327047 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:51.327047 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:51.327047 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:51.327047 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:51.327047 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:16:51.327047 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:16:51.327047 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:16:51.327047 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:16:51.328065 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:16:51.328065 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:16:51.328065 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:16:51.328065 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:16:51.328065 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:51.328065 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:51.328065 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:51.328065 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:51.328065 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:51.328065 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:51.328065 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:51.328065 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:51.328065 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:51.328065 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:51.328065 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:51.328065 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:51.328886 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:51.328886 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:51.328886 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:51.328886 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:51.328886 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:16:51.328886 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:16:51.328886 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:16:51.328886 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:16:51.328886 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:16:51.328886 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:16:51.328886 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 03:16:51.328886 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:16:51.330283 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 322/651] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Oct 4 03:16:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:51.331125 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708fbdd6-2ab6-4e6e-9328-9799ba50b9c1 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:51.369302 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:51.425960 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f682a7-572d-415d-8656-163abb4017ff None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:51.430036 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:51.438875 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708fbdd6-2ab6-4e6e-9328-9799ba50b9c1 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:51.462404 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e519a7-14ec-44ae-bfb4-4da54df4c735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:51.463005 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e519a7-14ec-44ae-bfb4-4da54df4c735 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:51.463282 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e519a7-14ec-44ae-bfb4-4da54df4c735 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:51.463579 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e519a7-14ec-44ae-bfb4-4da54df4c735 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:51.473243 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc56fe55-eef7-4e73-b9da-15dc424ca77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:51.473834 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc56fe55-eef7-4e73-b9da-15dc424ca77e None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:51.474130 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc56fe55-eef7-4e73-b9da-15dc424ca77e None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:51.474401 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc56fe55-eef7-4e73-b9da-15dc424ca77e None admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:51.475797 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc56fe55-eef7-4e73-b9da-15dc424ca77e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:51.476104 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc56fe55-eef7-4e73-b9da-15dc424ca77e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:51.477511 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc56fe55-eef7-4e73-b9da-15dc424ca77e None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:51.494512 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 323/652] 10.222.0.25 () {56 vars in 1137 bytes} [Tue Oct 4 03:16:51 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:51.495290 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc56fe55-eef7-4e73-b9da-15dc424ca77e None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:51.530441 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e519a7-14ec-44ae-bfb4-4da54df4c735 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:51.531837 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e519a7-14ec-44ae-bfb4-4da54df4c735 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:51.575970 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:51.594324 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc56fe55-eef7-4e73-b9da-15dc424ca77e None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:51.629286 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30d7dea-01ba-4df9-982a-71a5a87e3b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:51.629895 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d7dea-01ba-4df9-982a-71a5a87e3b53 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:51.632815 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d7dea-01ba-4df9-982a-71a5a87e3b53 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:51.632815 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d7dea-01ba-4df9-982a-71a5a87e3b53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:51.632815 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30d7dea-01ba-4df9-982a-71a5a87e3b53 None admin] RBAC: Adding query filter params (role.id=1f60934edaf04074936ff079756fc4a6, scope.project.id=80ae15e46620470b9c55fb7fe300fcb6, user.id=2c1f412befb9418fa66a2aabf475aa90) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:51.632815 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30d7dea-01ba-4df9-982a-71a5a87e3b53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:51.633143 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30d7dea-01ba-4df9-982a-71a5a87e3b53 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:51.638763 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 330/653] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 03:16:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 03:16:51.638763 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e519a7-14ec-44ae-bfb4-4da54df4c735 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:51.639543 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 324/654] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 03:16:51 2022] GET /identity/v3/role_assignments?user.id=2c1f412befb9418fa66a2aabf475aa90&scope.project.id=80ae15e46620470b9c55fb7fe300fcb6&role.id=1f60934edaf04074936ff079756fc4a6 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:51.642269 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc5492-2b7b-4a75-b5ad-836fc28331b3 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:51.642269 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc5492-2b7b-4a75-b5ad-836fc28331b3 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:51.642269 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc5492-2b7b-4a75-b5ad-836fc28331b3 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:51.648013 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 325/655] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:16:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:16:51.648483 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc5492-2b7b-4a75-b5ad-836fc28331b3 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:51.677244 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:51.748175 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e519a7-14ec-44ae-bfb4-4da54df4c735 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:51.782820 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc5492-2b7b-4a75-b5ad-836fc28331b3 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:51.784155 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fadd24b-1955-4abd-8a1e-e8fad2efe2c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:51.784774 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fadd24b-1955-4abd-8a1e-e8fad2efe2c3 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:51.785059 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fadd24b-1955-4abd-8a1e-e8fad2efe2c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:51.785326 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fadd24b-1955-4abd-8a1e-e8fad2efe2c3 None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:51.785996 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fadd24b-1955-4abd-8a1e-e8fad2efe2c3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:51.786292 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fadd24b-1955-4abd-8a1e-e8fad2efe2c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:51.787895 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fadd24b-1955-4abd-8a1e-e8fad2efe2c3 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:51.796607 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 331/656] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Oct 4 03:16:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:51.797465 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fadd24b-1955-4abd-8a1e-e8fad2efe2c3 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:51.809323 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:51.835833 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9839ccad-62d2-42f9-9c51-923d6c4d4629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:51.836452 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839ccad-62d2-42f9-9c51-923d6c4d4629 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:51.836736 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839ccad-62d2-42f9-9c51-923d6c4d4629 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:51.837313 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839ccad-62d2-42f9-9c51-923d6c4d4629 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:51.915609 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9839ccad-62d2-42f9-9c51-923d6c4d4629 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:51.917148 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9839ccad-62d2-42f9-9c51-923d6c4d4629 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:51.924230 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fadd24b-1955-4abd-8a1e-e8fad2efe2c3 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:51.932748 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:51.965982 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b98139-5c50-42ba-8600-24c5d5136ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:51.966741 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b98139-5c50-42ba-8600-24c5d5136ab6 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:51.967026 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b98139-5c50-42ba-8600-24c5d5136ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:51.967409 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b98139-5c50-42ba-8600-24c5d5136ab6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:51.980659 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b98139-5c50-42ba-8600-24c5d5136ab6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:51.982149 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b98139-5c50-42ba-8600-24c5d5136ab6 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:51.999017 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-29b98139-5c50-42ba-8600-24c5d5136ab6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:16:51.999017 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:51.999017 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:51.999017 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:51.999017 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:51.999017 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:51.999017 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:51.999017 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:51.999017 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:51.999017 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:51.999017 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:51.999017 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:51.999017 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 03:16:51.999017 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 03:16:51.999017 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 03:16:51.999017 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 03:16:52.000171 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:52.000171 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:52.000171 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:52.000171 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:52.000171 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:52.000171 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:52.000171 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:52.000171 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:52.000171 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:52.000171 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:52.000171 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:52.000171 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:52.000171 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:52.000171 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:52.000171 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:52.000171 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:52.000171 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 03:16:52.001095 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 03:16:52.001095 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:16:52.001095 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:16:52.001095 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 332/657] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:16:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:52.002015 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16272de-d3ba-4e5e-9449-abe12483c93d None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:52.002015 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16272de-d3ba-4e5e-9449-abe12483c93d None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:52.002178 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16272de-d3ba-4e5e-9449-abe12483c93d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:52.020347 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-a16272de-d3ba-4e5e-9449-abe12483c93d None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:16:52.021734 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-a16272de-d3ba-4e5e-9449-abe12483c93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:16:52.024422 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 326/658] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 03:16:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 03:16:52.025602 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9839ccad-62d2-42f9-9c51-923d6c4d4629 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:52.084175 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:52.111632 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 333/659] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:16:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 03:16:52.112789 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16272de-d3ba-4e5e-9449-abe12483c93d None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:52.143903 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9839ccad-62d2-42f9-9c51-923d6c4d4629 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:52.163827 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:52.196403 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676d8162-24e6-45d4-84ef-8177650577e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:52.197287 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d8162-24e6-45d4-84ef-8177650577e3 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:52.197570 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d8162-24e6-45d4-84ef-8177650577e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:52.197841 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d8162-24e6-45d4-84ef-8177650577e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:52.211982 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676d8162-24e6-45d4-84ef-8177650577e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:52.214308 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676d8162-24e6-45d4-84ef-8177650577e3 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:52.235525 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-676d8162-24e6-45d4-84ef-8177650577e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:16:52.235525 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:52.235525 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:52.235525 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:52.235525 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:52.235525 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:52.235525 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:52.235525 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:52.235525 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:52.235525 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:52.235525 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:52.235525 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:52.235525 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 03:16:52.235525 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 03:16:52.235525 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 03:16:52.235525 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 03:16:52.236737 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:52.236737 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:52.236737 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:52.236737 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:52.236737 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:52.236737 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:52.236737 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:52.236737 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:52.236737 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:52.236737 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:52.236737 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:52.236737 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:52.236737 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:52.236737 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:52.236737 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:52.236737 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:52.236737 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 03:16:52.237633 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 03:16:52.237633 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:16:52.237633 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:16:52.237633 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 327/660] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:16:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:52.238126 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676d8162-24e6-45d4-84ef-8177650577e3 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:52.239309 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16272de-d3ba-4e5e-9449-abe12483c93d None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:52.281569 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9005fa6-7156-4750-9013-0fb3ca2895e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:52.282179 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9005fa6-7156-4750-9013-0fb3ca2895e1 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:52.282460 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9005fa6-7156-4750-9013-0fb3ca2895e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:52.282732 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9005fa6-7156-4750-9013-0fb3ca2895e1 None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:52.283369 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9005fa6-7156-4750-9013-0fb3ca2895e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:52.283699 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9005fa6-7156-4750-9013-0fb3ca2895e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:52.285044 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9005fa6-7156-4750-9013-0fb3ca2895e1 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:52.306430 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 334/661] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 03:16:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:52.307784 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9005fa6-7156-4750-9013-0fb3ca2895e1 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:52.361364 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676d8162-24e6-45d4-84ef-8177650577e3 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:52.376562 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:52.398868 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c2f28-4f01-42c6-9da8-7724f7a92c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:52.399530 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c2f28-4f01-42c6-9da8-7724f7a92c30 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:52.399811 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c2f28-4f01-42c6-9da8-7724f7a92c30 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:52.400088 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c2f28-4f01-42c6-9da8-7724f7a92c30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:52.411784 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054c2f28-4f01-42c6-9da8-7724f7a92c30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:52.414044 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054c2f28-4f01-42c6-9da8-7724f7a92c30 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:52.429050 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-054c2f28-4f01-42c6-9da8-7724f7a92c30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:16:52.429050 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:52.429050 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:52.429050 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:52.429050 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:52.429050 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:52.429050 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:52.429050 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:52.429050 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:52.429050 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:52.429050 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:52.429050 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:52.429050 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 03:16:52.429050 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 03:16:52.429050 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 03:16:52.429050 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 03:16:52.430020 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:52.430020 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:52.430020 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:52.430020 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:52.430020 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:52.430020 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:52.430020 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:52.430020 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:52.430020 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:52.430020 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:52.430020 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:52.430020 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:52.430020 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:52.430020 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:52.430020 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:52.430020 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:52.430020 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 03:16:52.430909 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 03:16:52.430909 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:16:52.430909 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:16:52.430909 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 328/662] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:16:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:52.430909 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c2f28-4f01-42c6-9da8-7724f7a92c30 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:52.438457 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9005fa6-7156-4750-9013-0fb3ca2895e1 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:52.456301 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:52.475347 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dc4fb3-acbd-4d10-94c4-ef478fb9dfba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:52.475979 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc4fb3-acbd-4d10-94c4-ef478fb9dfba None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:52.476265 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc4fb3-acbd-4d10-94c4-ef478fb9dfba None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:52.476542 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc4fb3-acbd-4d10-94c4-ef478fb9dfba None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:52.477174 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dc4fb3-acbd-4d10-94c4-ef478fb9dfba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:52.477476 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dc4fb3-acbd-4d10-94c4-ef478fb9dfba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:52.478835 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dc4fb3-acbd-4d10-94c4-ef478fb9dfba None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:52.491155 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 335/663] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 03:16:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:52.492008 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dc4fb3-acbd-4d10-94c4-ef478fb9dfba None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:52.550219 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c2f28-4f01-42c6-9da8-7724f7a92c30 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:52.597351 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bce269-34ca-4e4c-a302-f18267093092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:52.597949 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bce269-34ca-4e4c-a302-f18267093092 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:52.598235 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bce269-34ca-4e4c-a302-f18267093092 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:52.598509 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bce269-34ca-4e4c-a302-f18267093092 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:52.606401 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bce269-34ca-4e4c-a302-f18267093092 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:52.607894 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bce269-34ca-4e4c-a302-f18267093092 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:52.614351 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dc4fb3-acbd-4d10-94c4-ef478fb9dfba None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:52.620559 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-48bce269-34ca-4e4c-a302-f18267093092 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 03:16:52.620559 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:52.620559 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:52.620559 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:52.620559 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:52.620559 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:52.620559 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:52.620559 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:52.620559 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:52.620559 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:52.620559 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:52.620559 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:52.620559 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 03:16:52.620559 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 03:16:52.620559 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 03:16:52.621619 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 03:16:52.621619 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:52.621619 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:52.621619 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:52.621619 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:52.621619 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:52.621619 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:52.621619 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:52.621619 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:52.621619 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:52.621619 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:52.621619 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:52.621619 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:52.621619 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:52.621619 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:52.621619 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:52.621619 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:52.622735 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 03:16:52.622735 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 03:16:52.622735 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 03:16:52.622735 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 03:16:52.622735 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 03:16:52.622735 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 03:16:52.622735 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 03:16:52.622735 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:16:52.629102 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 329/664] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 03:16:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:52.629102 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bce269-34ca-4e4c-a302-f18267093092 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:52.639415 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:52.671130 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6388d8c2-1019-4b4a-b438-f12f089bcf9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:52.671994 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6388d8c2-1019-4b4a-b438-f12f089bcf9f None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:52.672379 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6388d8c2-1019-4b4a-b438-f12f089bcf9f None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:52.672941 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6388d8c2-1019-4b4a-b438-f12f089bcf9f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:52.686266 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6388d8c2-1019-4b4a-b438-f12f089bcf9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:16:52.692515 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-6388d8c2-1019-4b4a-b438-f12f089bcf9f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 03:16:52.692515 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:52.692515 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:52.692515 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:52.692515 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:52.692515 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:52.692515 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:52.692515 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:52.692515 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:52.692515 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:52.692515 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:52.692515 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:52.692515 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:16:52.692515 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:16:52.692515 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:16:52.692515 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:16:52.694256 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:16:52.694256 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:16:52.694256 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:16:52.694256 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:16:52.694256 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:52.694256 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:52.694256 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:52.694256 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:52.694256 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:52.694256 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:52.694256 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:52.694256 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:52.694256 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:52.694256 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:52.694256 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:52.694256 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:52.695595 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:52.695595 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:52.695595 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:52.695595 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:52.695595 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:16:52.695595 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:16:52.695595 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:16:52.695595 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:16:52.695595 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:16:52.695595 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:16:52.695595 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 03:16:52.695595 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:16:52.696775 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 336/665] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Oct 4 03:16:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:52.697962 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6388d8c2-1019-4b4a-b438-f12f089bcf9f None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:52.747815 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:52.778185 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bce269-34ca-4e4c-a302-f18267093092 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:52.818710 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6388d8c2-1019-4b4a-b438-f12f089bcf9f None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:52.821817 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c10e289-08f1-42b8-9666-51edf88beda7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:52.822456 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10e289-08f1-42b8-9666-51edf88beda7 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:52.822741 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10e289-08f1-42b8-9666-51edf88beda7 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:52.823011 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10e289-08f1-42b8-9666-51edf88beda7 None admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:52.824348 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c10e289-08f1-42b8-9666-51edf88beda7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:52.824661 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c10e289-08f1-42b8-9666-51edf88beda7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:52.826030 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c10e289-08f1-42b8-9666-51edf88beda7 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:52.838002 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 330/666] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 03:16:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:52.843224 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c10e289-08f1-42b8-9666-51edf88beda7 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:52.873510 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aca280-794a-4b01-a7e3-2d22ca8a3965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:52.875101 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aca280-794a-4b01-a7e3-2d22ca8a3965 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:52.875387 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aca280-794a-4b01-a7e3-2d22ca8a3965 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:52.876112 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aca280-794a-4b01-a7e3-2d22ca8a3965 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:52.892259 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aca280-794a-4b01-a7e3-2d22ca8a3965 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:52.894827 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aca280-794a-4b01-a7e3-2d22ca8a3965 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:52.916780 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-f9aca280-794a-4b01-a7e3-2d22ca8a3965 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 04 03:16:52.916780 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:52.916780 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:52.916780 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:52.916780 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:52.916780 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:52.916780 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:52.916780 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:52.916780 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:52.916780 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:52.916780 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:52.916780 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:52.916780 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 03:16:52.916780 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 03:16:52.916780 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 03:16:52.916780 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 03:16:52.917933 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:52.917933 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:52.917933 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 03:16:52.917933 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 03:16:52.917933 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 03:16:52.917933 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 03:16:52.917933 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:52.917933 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:52.917933 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:52.917933 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:52.917933 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:52.917933 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:52.917933 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:52.917933 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:52.917933 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:52.917933 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:52.917933 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:52.917933 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:52.919184 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:52.919184 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:52.919184 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 03:16:52.919184 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 03:16:52.919184 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 03:16:52.919184 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 03:16:52.919184 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 03:16:52.919184 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 03:16:52.919184 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 04 03:16:52.919184 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:16:52.919184 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 337/667] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Oct 4 03:16:52 2022] GET /identity/v3/users/neutron => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:52.919841 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aca280-794a-4b01-a7e3-2d22ca8a3965 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:52.952278 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:52.969834 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c10e289-08f1-42b8-9666-51edf88beda7 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:53.016567 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c978224-70df-4ac9-b2e9-3733c2c75414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:53.017437 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c978224-70df-4ac9-b2e9-3733c2c75414 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:53.017913 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c978224-70df-4ac9-b2e9-3733c2c75414 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:53.018324 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c978224-70df-4ac9-b2e9-3733c2c75414 None admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:53.019152 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c978224-70df-4ac9-b2e9-3733c2c75414 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:53.019645 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c978224-70df-4ac9-b2e9-3733c2c75414 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:53.021557 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c978224-70df-4ac9-b2e9-3733c2c75414 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:53.028937 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:53.035114 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 331/668] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 4 03:16:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:53.035937 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c978224-70df-4ac9-b2e9-3733c2c75414 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:53.044959 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aca280-794a-4b01-a7e3-2d22ca8a3965 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:53.079824 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e189107-954f-474e-9cb6-ce050377a881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:53.080433 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e189107-954f-474e-9cb6-ce050377a881 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:53.080713 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e189107-954f-474e-9cb6-ce050377a881 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:53.080986 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e189107-954f-474e-9cb6-ce050377a881 None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:53.081640 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e189107-954f-474e-9cb6-ce050377a881 None admin] RBAC: Adding query filter params (name=service) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:53.081944 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e189107-954f-474e-9cb6-ce050377a881 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:53.083304 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e189107-954f-474e-9cb6-ce050377a881 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:53.092212 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 338/669] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Oct 4 03:16:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:53.093012 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e189107-954f-474e-9cb6-ce050377a881 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:53.147805 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c978224-70df-4ac9-b2e9-3733c2c75414 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:53.180809 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311b4527-1c66-448f-b751-4a0835354657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:53.181431 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b4527-1c66-448f-b751-4a0835354657 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:53.181715 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b4527-1c66-448f-b751-4a0835354657 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:53.181988 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b4527-1c66-448f-b751-4a0835354657 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:53.188801 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311b4527-1c66-448f-b751-4a0835354657 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:53.190230 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311b4527-1c66-448f-b751-4a0835354657 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:53.197571 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:53.201882 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-311b4527-1c66-448f-b751-4a0835354657 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 03:16:53.201882 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:53.201882 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:53.201882 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:53.201882 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:53.201882 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:53.201882 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:53.201882 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:53.201882 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:53.201882 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:53.201882 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:53.201882 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:53.201882 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 03:16:53.201882 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 03:16:53.201882 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 03:16:53.202751 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 03:16:53.202751 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:53.202751 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:53.202751 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:53.202751 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:53.202751 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:53.202751 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:53.202751 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:53.202751 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:53.202751 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:53.202751 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:53.202751 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:53.202751 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:53.202751 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:53.202751 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:53.202751 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:53.202751 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:53.203723 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 03:16:53.203723 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 03:16:53.203723 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 03:16:53.203723 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 03:16:53.203723 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 03:16:53.203723 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 03:16:53.203723 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 03:16:53.203723 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:16:53.203723 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 332/670] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 03:16:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:53.204611 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311b4527-1c66-448f-b751-4a0835354657 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:53.214899 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e189107-954f-474e-9cb6-ce050377a881 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:53.251974 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cb3625-7214-4a77-9192-2da6d9ab17df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:53.252580 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb3625-7214-4a77-9192-2da6d9ab17df None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:53.252865 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb3625-7214-4a77-9192-2da6d9ab17df None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:53.253140 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb3625-7214-4a77-9192-2da6d9ab17df None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:53.253869 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cb3625-7214-4a77-9192-2da6d9ab17df None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:53.254175 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cb3625-7214-4a77-9192-2da6d9ab17df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:53.255625 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cb3625-7214-4a77-9192-2da6d9ab17df None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:53.268522 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:53.275399 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 339/671] 10.222.0.25 () {56 vars in 1139 bytes} [Tue Oct 4 03:16:53 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:53.276268 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cb3625-7214-4a77-9192-2da6d9ab17df None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:53.314190 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311b4527-1c66-448f-b751-4a0835354657 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:53.350893 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3540e4f2-db1d-4059-a9df-d89378357450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:53.351508 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3540e4f2-db1d-4059-a9df-d89378357450 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:53.351792 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3540e4f2-db1d-4059-a9df-d89378357450 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:53.352058 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3540e4f2-db1d-4059-a9df-d89378357450 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:53.352772 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3540e4f2-db1d-4059-a9df-d89378357450 None admin] RBAC: Adding query filter params (role.id=1f60934edaf04074936ff079756fc4a6, scope.project.id=80ae15e46620470b9c55fb7fe300fcb6, user.id=f537aabf3d1040ff840b02616f839975) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:53.353079 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3540e4f2-db1d-4059-a9df-d89378357450 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:53.354595 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3540e4f2-db1d-4059-a9df-d89378357450 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:53.360526 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 333/672] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 03:16:53 2022] GET /identity/v3/role_assignments?user.id=f537aabf3d1040ff840b02616f839975&scope.project.id=80ae15e46620470b9c55fb7fe300fcb6&role.id=1f60934edaf04074936ff079756fc4a6 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:53.361207 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3540e4f2-db1d-4059-a9df-d89378357450 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:53.410861 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cb3625-7214-4a77-9192-2da6d9ab17df None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:53.452988 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f750811-4e8d-4253-ba7b-ad0f776aca6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:53.453637 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f750811-4e8d-4253-ba7b-ad0f776aca6b None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:53.453913 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f750811-4e8d-4253-ba7b-ad0f776aca6b None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:53.454212 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f750811-4e8d-4253-ba7b-ad0f776aca6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:53.466514 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f750811-4e8d-4253-ba7b-ad0f776aca6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:53.468008 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f750811-4e8d-4253-ba7b-ad0f776aca6b None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:53.478483 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:53.485721 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-7f750811-4e8d-4253-ba7b-ad0f776aca6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:16:53.485721 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:53.485721 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:53.485721 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:53.485721 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:53.485721 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:53.485721 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:53.485721 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:53.485721 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:53.485721 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:53.485721 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:53.485721 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:53.485721 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 03:16:53.485721 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 03:16:53.485721 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 03:16:53.485721 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 03:16:53.486726 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:53.486726 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:53.486726 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:53.486726 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:53.486726 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:53.486726 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:53.486726 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:53.486726 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:53.486726 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:53.486726 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:53.486726 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:53.486726 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:53.486726 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:53.486726 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:53.486726 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:53.486726 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:53.486726 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 03:16:53.487637 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 03:16:53.487637 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:16:53.487637 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:16:53.488297 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 340/673] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:16:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:53.489266 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f750811-4e8d-4253-ba7b-ad0f776aca6b None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:53.507999 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3540e4f2-db1d-4059-a9df-d89378357450 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:53.536976 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:53.551030 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6493c13-8610-4c4b-8c3d-127720528e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:53.552000 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6493c13-8610-4c4b-8c3d-127720528e9e None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:53.552515 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6493c13-8610-4c4b-8c3d-127720528e9e None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:53.553560 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6493c13-8610-4c4b-8c3d-127720528e9e None admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:53.554537 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6493c13-8610-4c4b-8c3d-127720528e9e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:53.555063 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6493c13-8610-4c4b-8c3d-127720528e9e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:53.556738 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6493c13-8610-4c4b-8c3d-127720528e9e None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:53.570546 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 334/674] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 4 03:16:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:53.576390 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6493c13-8610-4c4b-8c3d-127720528e9e None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:53.605766 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f750811-4e8d-4253-ba7b-ad0f776aca6b None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:53.649180 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830182f1-d901-4c06-8805-12a886ee78aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:53.649834 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830182f1-d901-4c06-8805-12a886ee78aa None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:53.650150 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830182f1-d901-4c06-8805-12a886ee78aa None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:53.650490 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830182f1-d901-4c06-8805-12a886ee78aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:53.699298 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6493c13-8610-4c4b-8c3d-127720528e9e None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:53.717864 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:53.720955 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830182f1-d901-4c06-8805-12a886ee78aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:53.722613 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830182f1-d901-4c06-8805-12a886ee78aa None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:53.742763 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad508d6-a4ff-43f0-9d9b-291835d94bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:53.743381 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad508d6-a4ff-43f0-9d9b-291835d94bde None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:53.743695 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad508d6-a4ff-43f0-9d9b-291835d94bde None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:53.744003 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad508d6-a4ff-43f0-9d9b-291835d94bde None admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:53.744623 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad508d6-a4ff-43f0-9d9b-291835d94bde None admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:53.744928 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad508d6-a4ff-43f0-9d9b-291835d94bde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:53.746484 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad508d6-a4ff-43f0-9d9b-291835d94bde None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:53.764351 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 335/675] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 03:16:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:53.765331 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad508d6-a4ff-43f0-9d9b-291835d94bde None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:53.820929 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:53.840946 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 341/676] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 03:16:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 03:16:53.842477 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830182f1-d901-4c06-8805-12a886ee78aa None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:53.891391 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad508d6-a4ff-43f0-9d9b-291835d94bde None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:53.933105 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949d090b-55f1-4acd-ae27-c4774b635586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:53.933796 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d090b-55f1-4acd-ae27-c4774b635586 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:53.934173 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d090b-55f1-4acd-ae27-c4774b635586 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:53.934425 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d090b-55f1-4acd-ae27-c4774b635586 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:53.935143 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949d090b-55f1-4acd-ae27-c4774b635586 None admin] RBAC: Adding query filter params (role.id=1f60934edaf04074936ff079756fc4a6, scope.project.id=80ae15e46620470b9c55fb7fe300fcb6, user.id=95be0e4e1c8641709e07b115047fb4e1) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:53.935445 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949d090b-55f1-4acd-ae27-c4774b635586 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:53.936896 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949d090b-55f1-4acd-ae27-c4774b635586 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:53.942828 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 336/677] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 03:16:53 2022] GET /identity/v3/role_assignments?user.id=95be0e4e1c8641709e07b115047fb4e1&scope.project.id=80ae15e46620470b9c55fb7fe300fcb6&role.id=1f60934edaf04074936ff079756fc4a6 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:53.944325 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949d090b-55f1-4acd-ae27-c4774b635586 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:53.972814 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:53.976950 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830182f1-d901-4c06-8805-12a886ee78aa None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:54.028093 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d75f93-b006-4f47-92c8-d5815559d595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:54.029404 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d75f93-b006-4f47-92c8-d5815559d595 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:54.029998 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d75f93-b006-4f47-92c8-d5815559d595 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:54.030485 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d75f93-b006-4f47-92c8-d5815559d595 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:54.041164 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d75f93-b006-4f47-92c8-d5815559d595 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:54.043042 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d75f93-b006-4f47-92c8-d5815559d595 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:54.058232 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-b3d75f93-b006-4f47-92c8-d5815559d595 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 04 03:16:54.058232 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:54.058232 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:54.058232 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:54.058232 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:54.058232 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:54.058232 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:54.058232 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:54.058232 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:54.058232 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:54.058232 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:54.058232 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:54.058232 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 03:16:54.058232 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 03:16:54.058232 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 03:16:54.058232 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 03:16:54.059269 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:54.059269 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:54.059269 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 03:16:54.059269 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 03:16:54.059269 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 03:16:54.059269 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 03:16:54.059269 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:54.059269 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:54.059269 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:54.059269 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:54.059269 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:54.059269 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:54.059269 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:54.059269 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:54.059269 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:54.059269 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:54.059269 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:54.059269 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:54.060274 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:54.060274 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:54.060274 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 03:16:54.060274 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 03:16:54.060274 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 03:16:54.060274 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 03:16:54.060274 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 03:16:54.060274 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 03:16:54.060274 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 04 03:16:54.060274 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:16:54.067317 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 342/678] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 4 03:16:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:54.067317 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e058f-4ab4-425f-80a4-6e41c1f49c50 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:54.067317 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e058f-4ab4-425f-80a4-6e41c1f49c50 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:54.067317 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e058f-4ab4-425f-80a4-6e41c1f49c50 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:54.067317 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 343/679] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:16:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:16:54.069143 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2e058f-4ab4-425f-80a4-6e41c1f49c50 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:54.096189 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949d090b-55f1-4acd-ae27-c4774b635586 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:54.105365 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:54.144879 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450425fe-8a66-49d9-8152-9dcc67f822a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:54.145868 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450425fe-8a66-49d9-8152-9dcc67f822a1 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:54.146395 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450425fe-8a66-49d9-8152-9dcc67f822a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:54.147309 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450425fe-8a66-49d9-8152-9dcc67f822a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:54.160979 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450425fe-8a66-49d9-8152-9dcc67f822a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:54.162290 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450425fe-8a66-49d9-8152-9dcc67f822a1 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:54.183343 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-450425fe-8a66-49d9-8152-9dcc67f822a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:16:54.183343 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:54.183343 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:54.183343 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:54.183343 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:54.183343 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:54.183343 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:54.183343 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:54.183343 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:54.183343 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:54.183343 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:54.183343 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:54.183343 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 03:16:54.183343 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 03:16:54.183343 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 03:16:54.183343 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 03:16:54.184554 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:54.184554 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:54.184554 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:54.184554 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:54.184554 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:54.184554 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:54.184554 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:54.184554 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:54.184554 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:54.184554 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:54.184554 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:54.184554 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:54.184554 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:54.184554 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:54.184554 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:54.184554 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:54.184554 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 03:16:54.185827 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 03:16:54.185827 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:16:54.185827 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:16:54.185827 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 337/680] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:16:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:54.186117 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f513a9a-e18e-4f5a-9003-0642eb91a14f None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:54.186248 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f513a9a-e18e-4f5a-9003-0642eb91a14f None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:54.186525 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f513a9a-e18e-4f5a-9003-0642eb91a14f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:54.209451 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-2f513a9a-e18e-4f5a-9003-0642eb91a14f None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:16:54.211070 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-2f513a9a-e18e-4f5a-9003-0642eb91a14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:16:54.215384 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2e058f-4ab4-425f-80a4-6e41c1f49c50 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:54.262354 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40abdfe-aba7-4b55-a606-891581ca8af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:54.262886 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40abdfe-aba7-4b55-a606-891581ca8af9 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:54.263164 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40abdfe-aba7-4b55-a606-891581ca8af9 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:54.263434 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40abdfe-aba7-4b55-a606-891581ca8af9 None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:54.264179 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40abdfe-aba7-4b55-a606-891581ca8af9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:54.264481 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40abdfe-aba7-4b55-a606-891581ca8af9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:54.266335 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40abdfe-aba7-4b55-a606-891581ca8af9 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:54.292119 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 344/681] 10.222.0.25 () {56 vars in 1135 bytes} [Tue Oct 4 03:16:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:54.297698 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40abdfe-aba7-4b55-a606-891581ca8af9 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:54.300586 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 338/682] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:16:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 03:16:54.301652 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f513a9a-e18e-4f5a-9003-0642eb91a14f None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:54.329873 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:54.423006 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:54.448547 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f513a9a-e18e-4f5a-9003-0642eb91a14f None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:54.492828 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40abdfe-aba7-4b55-a606-891581ca8af9 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:54.513282 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7de01fd-c74c-46cf-af04-e8022cad05f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:54.513823 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de01fd-c74c-46cf-af04-e8022cad05f7 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:54.514112 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de01fd-c74c-46cf-af04-e8022cad05f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:54.514383 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de01fd-c74c-46cf-af04-e8022cad05f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:54.558354 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ecf012-b47a-489f-ac92-87a9ce265db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:54.558969 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ecf012-b47a-489f-ac92-87a9ce265db9 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:54.559254 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ecf012-b47a-489f-ac92-87a9ce265db9 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:54.559557 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ecf012-b47a-489f-ac92-87a9ce265db9 None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:54.560260 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ecf012-b47a-489f-ac92-87a9ce265db9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:54.560568 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ecf012-b47a-489f-ac92-87a9ce265db9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:54.561953 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ecf012-b47a-489f-ac92-87a9ce265db9 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:54.592667 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 345/683] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 03:16:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:54.597808 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ecf012-b47a-489f-ac92-87a9ce265db9 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:54.624273 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7de01fd-c74c-46cf-af04-e8022cad05f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:54.625721 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7de01fd-c74c-46cf-af04-e8022cad05f7 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:54.719546 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:54.739124 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 339/684] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 03:16:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 03:16:54.743228 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:54.744326 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7de01fd-c74c-46cf-af04-e8022cad05f7 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:54.752412 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ecf012-b47a-489f-ac92-87a9ce265db9 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:54.791041 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ab46e2-e12e-4d23-a02e-4d6b4aeac651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:54.791616 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab46e2-e12e-4d23-a02e-4d6b4aeac651 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:54.791903 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab46e2-e12e-4d23-a02e-4d6b4aeac651 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:54.792175 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab46e2-e12e-4d23-a02e-4d6b4aeac651 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:54.799347 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ab46e2-e12e-4d23-a02e-4d6b4aeac651 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:54.800807 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ab46e2-e12e-4d23-a02e-4d6b4aeac651 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:54.813529 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-c1ab46e2-e12e-4d23-a02e-4d6b4aeac651 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 03:16:54.813529 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:54.813529 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:54.813529 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:54.813529 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:54.813529 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:54.813529 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:54.813529 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:54.813529 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:54.813529 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:54.813529 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:54.813529 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:54.813529 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 03:16:54.813529 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 03:16:54.813529 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 03:16:54.814447 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 03:16:54.814447 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:54.814447 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:54.814447 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:54.814447 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:54.814447 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:54.814447 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:54.814447 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:54.814447 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:54.814447 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:54.814447 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:54.814447 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:54.814447 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:54.814447 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:54.814447 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:54.814447 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:54.814447 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:54.815331 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 03:16:54.815331 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 03:16:54.815331 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 03:16:54.815331 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 03:16:54.815331 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 03:16:54.815331 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 03:16:54.815331 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 03:16:54.815331 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:16:54.815331 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 346/685] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 03:16:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 03:16:54.815865 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ab46e2-e12e-4d23-a02e-4d6b4aeac651 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:54.855116 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7de01fd-c74c-46cf-af04-e8022cad05f7 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:54.891323 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d309c803-cf1f-4ece-8c94-df883e5c7021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:54.891983 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309c803-cf1f-4ece-8c94-df883e5c7021 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:54.892267 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309c803-cf1f-4ece-8c94-df883e5c7021 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:54.892545 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309c803-cf1f-4ece-8c94-df883e5c7021 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:54.903999 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d309c803-cf1f-4ece-8c94-df883e5c7021 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:16:54.908783 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-d309c803-cf1f-4ece-8c94-df883e5c7021 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 03:16:54.908783 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:54.908783 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:54.908783 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:54.908783 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:54.908783 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:54.908783 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:54.908783 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:54.908783 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:54.908783 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:54.908783 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:54.908783 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:54.908783 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:16:54.908783 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:16:54.908783 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:16:54.908783 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:16:54.910922 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:16:54.910922 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:16:54.910922 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:16:54.910922 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:16:54.910922 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:54.910922 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:54.910922 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:54.910922 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:54.910922 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:54.910922 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:54.910922 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:54.910922 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:54.910922 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:54.910922 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:54.910922 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:54.910922 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:54.913074 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:54.913074 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:54.913074 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:54.913074 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:54.913074 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:16:54.913074 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:16:54.913074 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:16:54.913074 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:16:54.913074 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:16:54.913074 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:16:54.913074 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 03:16:54.913074 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:16:54.913074 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 340/686] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 4 03:16:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:54.913074 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d309c803-cf1f-4ece-8c94-df883e5c7021 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:54.924830 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ab46e2-e12e-4d23-a02e-4d6b4aeac651 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:54.962242 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812a9c08-c8ef-4d4b-a909-52b4632becad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:54.962871 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a9c08-c8ef-4d4b-a909-52b4632becad None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:54.963152 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a9c08-c8ef-4d4b-a909-52b4632becad None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:54.963427 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a9c08-c8ef-4d4b-a909-52b4632becad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:54.964583 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:54.970809 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:54.976741 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812a9c08-c8ef-4d4b-a909-52b4632becad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:54.978166 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812a9c08-c8ef-4d4b-a909-52b4632becad None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:54.993580 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-812a9c08-c8ef-4d4b-a909-52b4632becad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:16:54.993580 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:54.993580 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:54.993580 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:54.993580 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:54.993580 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:54.993580 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:54.993580 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:54.993580 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:54.993580 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:54.993580 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:54.993580 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:54.993580 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 03:16:54.993580 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 03:16:54.993580 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 03:16:54.993580 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 03:16:54.994805 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:54.994805 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:54.994805 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:54.994805 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:54.994805 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:54.994805 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:54.994805 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:54.994805 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:54.994805 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:54.994805 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:54.994805 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:54.994805 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:54.994805 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:54.994805 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:54.994805 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:54.994805 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:54.994805 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 03:16:54.995908 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 03:16:54.995908 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:16:54.995908 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:16:54.999359 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 347/687] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:16:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:55.000241 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812a9c08-c8ef-4d4b-a909-52b4632becad None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:55.024614 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d309c803-cf1f-4ece-8c94-df883e5c7021 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:55.062520 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d96508-3662-4ac2-8ae3-31df919a0463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:55.063367 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d96508-3662-4ac2-8ae3-31df919a0463 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:55.063862 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d96508-3662-4ac2-8ae3-31df919a0463 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:55.064286 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d96508-3662-4ac2-8ae3-31df919a0463 None admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:55.065125 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d96508-3662-4ac2-8ae3-31df919a0463 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:55.065592 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d96508-3662-4ac2-8ae3-31df919a0463 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:55.067176 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d96508-3662-4ac2-8ae3-31df919a0463 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:55.080704 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 341/688] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 4 03:16:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:55.081778 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d96508-3662-4ac2-8ae3-31df919a0463 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:55.111933 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812a9c08-c8ef-4d4b-a909-52b4632becad None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:55.148953 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5911df52-cc60-4081-ab5d-bdcd6a332ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:55.149555 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911df52-cc60-4081-ab5d-bdcd6a332ca0 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:55.149836 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911df52-cc60-4081-ab5d-bdcd6a332ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:55.150108 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911df52-cc60-4081-ab5d-bdcd6a332ca0 None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:55.150775 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5911df52-cc60-4081-ab5d-bdcd6a332ca0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:55.151062 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5911df52-cc60-4081-ab5d-bdcd6a332ca0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:55.152453 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5911df52-cc60-4081-ab5d-bdcd6a332ca0 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:55.161217 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 348/689] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 03:16:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:55.162723 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5911df52-cc60-4081-ab5d-bdcd6a332ca0 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:55.193324 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d96508-3662-4ac2-8ae3-31df919a0463 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:55.203826 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:55.224266 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:55.245097 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46fbfdd-cac8-433c-afcf-b3158d484370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:55.245885 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46fbfdd-cac8-433c-afcf-b3158d484370 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:55.246235 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46fbfdd-cac8-433c-afcf-b3158d484370 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:55.246574 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46fbfdd-cac8-433c-afcf-b3158d484370 None admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:55.247561 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46fbfdd-cac8-433c-afcf-b3158d484370 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:55.247957 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46fbfdd-cac8-433c-afcf-b3158d484370 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:55.250270 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46fbfdd-cac8-433c-afcf-b3158d484370 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:55.271136 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 342/690] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 03:16:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:55.272344 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46fbfdd-cac8-433c-afcf-b3158d484370 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:55.291721 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5911df52-cc60-4081-ab5d-bdcd6a332ca0 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:55.332522 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9762b3-2c7b-420a-8d8c-dcb68bce85c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:55.333474 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9762b3-2c7b-420a-8d8c-dcb68bce85c0 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:55.334183 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9762b3-2c7b-420a-8d8c-dcb68bce85c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:55.334741 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9762b3-2c7b-420a-8d8c-dcb68bce85c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:55.335724 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9762b3-2c7b-420a-8d8c-dcb68bce85c0 None admin] RBAC: Adding query filter params (role.id=1f60934edaf04074936ff079756fc4a6, scope.project.id=80ae15e46620470b9c55fb7fe300fcb6, user.id=5e43cc9523d949a1bfa3dec882f2824f) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:55.336245 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9762b3-2c7b-420a-8d8c-dcb68bce85c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:55.338421 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9762b3-2c7b-420a-8d8c-dcb68bce85c0 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:55.346162 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 349/691] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 03:16:55 2022] GET /identity/v3/role_assignments?user.id=5e43cc9523d949a1bfa3dec882f2824f&scope.project.id=80ae15e46620470b9c55fb7fe300fcb6&role.id=1f60934edaf04074936ff079756fc4a6 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:55.347472 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9762b3-2c7b-420a-8d8c-dcb68bce85c0 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:55.405654 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46fbfdd-cac8-433c-afcf-b3158d484370 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:55.480210 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a3ee2c-72ec-4e1b-8aff-cd1ef92293db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:55.482447 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3ee2c-72ec-4e1b-8aff-cd1ef92293db None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:55.482977 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3ee2c-72ec-4e1b-8aff-cd1ef92293db None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:55.483662 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3ee2c-72ec-4e1b-8aff-cd1ef92293db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:55.503244 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a3ee2c-72ec-4e1b-8aff-cd1ef92293db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:55.505841 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a3ee2c-72ec-4e1b-8aff-cd1ef92293db None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:55.508276 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9762b3-2c7b-420a-8d8c-dcb68bce85c0 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:55.541489 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-f7a3ee2c-72ec-4e1b-8aff-cd1ef92293db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:16:55.541489 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:55.541489 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:55.541489 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:55.541489 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:55.541489 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:55.541489 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:55.541489 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:55.541489 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:55.541489 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:55.541489 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:55.541489 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:55.541489 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 03:16:55.541489 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 03:16:55.541489 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 03:16:55.541489 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 03:16:55.542577 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:55.542577 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:55.542577 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:55.542577 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:55.542577 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:55.542577 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:55.542577 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:55.542577 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:55.542577 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:55.542577 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:55.542577 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:55.542577 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:55.542577 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:55.542577 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:55.542577 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:55.542577 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:55.542577 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 03:16:55.543457 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 03:16:55.543457 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:16:55.543457 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:16:55.545559 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 343/692] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:16:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:55.551141 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a3ee2c-72ec-4e1b-8aff-cd1ef92293db None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:55.554138 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:55.581823 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb0ba24-56ae-4749-8ac7-f002d4649383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:55.582505 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb0ba24-56ae-4749-8ac7-f002d4649383 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:55.582833 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb0ba24-56ae-4749-8ac7-f002d4649383 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:55.583050 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb0ba24-56ae-4749-8ac7-f002d4649383 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:55.592259 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb0ba24-56ae-4749-8ac7-f002d4649383 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:55.593445 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:55.593710 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb0ba24-56ae-4749-8ac7-f002d4649383 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:55.610804 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-9eb0ba24-56ae-4749-8ac7-f002d4649383 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 03:16:55.610804 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:55.610804 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:55.610804 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:55.610804 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:55.610804 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:55.610804 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:55.610804 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:55.610804 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:55.610804 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:55.610804 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:55.610804 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:55.610804 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 03:16:55.610804 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 03:16:55.610804 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 03:16:55.611769 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 03:16:55.611769 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:55.611769 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:55.611769 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:55.611769 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:55.611769 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:55.611769 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:55.611769 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:55.611769 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:55.611769 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:55.611769 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:55.611769 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:55.611769 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:55.611769 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:55.611769 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:55.611769 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:55.611769 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:55.613057 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 03:16:55.613057 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 03:16:55.613057 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 03:16:55.613057 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 03:16:55.613057 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 03:16:55.613057 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 03:16:55.613057 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 03:16:55.613057 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:16:55.613057 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 350/693] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 03:16:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:55.620999 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb0ba24-56ae-4749-8ac7-f002d4649383 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:55.714775 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a3ee2c-72ec-4e1b-8aff-cd1ef92293db None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:55.778466 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb0ba24-56ae-4749-8ac7-f002d4649383 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:55.784159 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43790bc-666b-4fdb-a3c5-058369c8b161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:55.784750 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43790bc-666b-4fdb-a3c5-058369c8b161 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:55.785026 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43790bc-666b-4fdb-a3c5-058369c8b161 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:55.785296 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43790bc-666b-4fdb-a3c5-058369c8b161 None admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:55.785936 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43790bc-666b-4fdb-a3c5-058369c8b161 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:55.786236 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43790bc-666b-4fdb-a3c5-058369c8b161 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:55.788598 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43790bc-666b-4fdb-a3c5-058369c8b161 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:55.819656 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 344/694] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 03:16:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:55.823982 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43790bc-666b-4fdb-a3c5-058369c8b161 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:55.847212 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccb7c86-0a1d-43b8-a69f-d5ba81d64b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:55.848225 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb7c86-0a1d-43b8-a69f-d5ba81d64b2e None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:55.848728 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb7c86-0a1d-43b8-a69f-d5ba81d64b2e None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:55.849237 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb7c86-0a1d-43b8-a69f-d5ba81d64b2e None admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:55.850711 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccb7c86-0a1d-43b8-a69f-d5ba81d64b2e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:55.851273 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccb7c86-0a1d-43b8-a69f-d5ba81d64b2e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:55.852946 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccb7c86-0a1d-43b8-a69f-d5ba81d64b2e None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:55.867368 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 351/695] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 4 03:16:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:55.868980 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe946ac-c419-40f5-94cf-4a85d273a182 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:55.869467 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe946ac-c419-40f5-94cf-4a85d273a182 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:55.869964 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe946ac-c419-40f5-94cf-4a85d273a182 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:55.871644 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 352/696] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:16:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:16:55.880435 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bebb2a-cfd8-4beb-9cbd-b8d286f83c89 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:55.880435 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bebb2a-cfd8-4beb-9cbd-b8d286f83c89 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:55.880435 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bebb2a-cfd8-4beb-9cbd-b8d286f83c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:55.897061 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-77bebb2a-cfd8-4beb-9cbd-b8d286f83c89 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:16:55.898614 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-77bebb2a-cfd8-4beb-9cbd-b8d286f83c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:16:55.916882 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:55.936354 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:55.941081 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43790bc-666b-4fdb-a3c5-058369c8b161 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:55.983551 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 353/697] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:16:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 03:16:55.983551 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bebb2a-cfd8-4beb-9cbd-b8d286f83c89 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:55.998999 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2803a3e8-28a5-49cc-a4a9-11c46f3c5f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:56.001167 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803a3e8-28a5-49cc-a4a9-11c46f3c5f9b None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:56.001600 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803a3e8-28a5-49cc-a4a9-11c46f3c5f9b None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:56.002716 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803a3e8-28a5-49cc-a4a9-11c46f3c5f9b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:56.019564 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2803a3e8-28a5-49cc-a4a9-11c46f3c5f9b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:56.022535 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2803a3e8-28a5-49cc-a4a9-11c46f3c5f9b None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:56.042193 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-2803a3e8-28a5-49cc-a4a9-11c46f3c5f9b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 03:16:56.042193 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:56.042193 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:56.042193 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:56.042193 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:56.042193 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:56.042193 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:56.042193 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:56.042193 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:56.042193 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:56.042193 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:56.042193 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:56.042193 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 03:16:56.042193 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 03:16:56.042193 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 03:16:56.042193 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 03:16:56.043361 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:56.043361 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:56.043361 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 03:16:56.043361 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 03:16:56.043361 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 03:16:56.043361 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 03:16:56.043361 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:56.043361 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:56.043361 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:56.043361 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:56.043361 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:56.043361 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:56.043361 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:56.043361 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:56.043361 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:56.043361 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:56.043361 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:56.043361 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:56.044431 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:56.044431 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:56.044431 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 03:16:56.044431 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 03:16:56.044431 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 03:16:56.044431 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 03:16:56.044431 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 03:16:56.044431 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 03:16:56.044431 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 03:16:56.044431 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:16:56.054208 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 345/698] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Oct 4 03:16:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:56.059218 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2803a3e8-28a5-49cc-a4a9-11c46f3c5f9b None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:56.133241 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bebb2a-cfd8-4beb-9cbd-b8d286f83c89 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:56.173109 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2739b854-d0a7-49da-8611-a61ef8f23bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:56.173954 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2739b854-d0a7-49da-8611-a61ef8f23bd7 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:56.174530 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2739b854-d0a7-49da-8611-a61ef8f23bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:56.175009 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2739b854-d0a7-49da-8611-a61ef8f23bd7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:56.175935 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2739b854-d0a7-49da-8611-a61ef8f23bd7 None admin] RBAC: Adding query filter params (role.id=1f60934edaf04074936ff079756fc4a6, scope.project.id=80ae15e46620470b9c55fb7fe300fcb6, user.id=1d8da6bacc8f432e8f48bb99c7aede11) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:56.176408 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2739b854-d0a7-49da-8611-a61ef8f23bd7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:56.178152 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2739b854-d0a7-49da-8611-a61ef8f23bd7 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:56.184751 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 354/699] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 03:16:55 2022] GET /identity/v3/role_assignments?user.id=1d8da6bacc8f432e8f48bb99c7aede11&scope.project.id=80ae15e46620470b9c55fb7fe300fcb6&role.id=1f60934edaf04074936ff079756fc4a6 => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:56.238217 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2803a3e8-28a5-49cc-a4a9-11c46f3c5f9b None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:56.285459 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393b9708-504a-4ab5-94d1-928d656aee86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:56.286099 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b9708-504a-4ab5-94d1-928d656aee86 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:56.286380 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b9708-504a-4ab5-94d1-928d656aee86 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:56.286663 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b9708-504a-4ab5-94d1-928d656aee86 None admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:56.287527 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393b9708-504a-4ab5-94d1-928d656aee86 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:56.287917 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393b9708-504a-4ab5-94d1-928d656aee86 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:56.289388 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393b9708-504a-4ab5-94d1-928d656aee86 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:56.304896 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:56.315274 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 346/700] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Oct 4 03:16:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:16:56.321192 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2739b854-d0a7-49da-8611-a61ef8f23bd7 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:56.343260 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393b9708-504a-4ab5-94d1-928d656aee86 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:56.367424 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:56.456333 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393b9708-504a-4ab5-94d1-928d656aee86 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:56.458144 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2739b854-d0a7-49da-8611-a61ef8f23bd7 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:56.492723 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545cd5f4-66f0-43d6-8c88-e995275c17fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:56.493519 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545cd5f4-66f0-43d6-8c88-e995275c17fc None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:56.493800 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545cd5f4-66f0-43d6-8c88-e995275c17fc None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:56.494073 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545cd5f4-66f0-43d6-8c88-e995275c17fc None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:56.495112 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545cd5f4-66f0-43d6-8c88-e995275c17fc None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:56.496682 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545cd5f4-66f0-43d6-8c88-e995275c17fc None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:56.502861 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ef6330-d839-40ed-b9c2-58b2e8c3b21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:56.503474 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef6330-d839-40ed-b9c2-58b2e8c3b21d None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:56.503797 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef6330-d839-40ed-b9c2-58b2e8c3b21d None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:56.504073 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef6330-d839-40ed-b9c2-58b2e8c3b21d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:56.508067 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-545cd5f4-66f0-43d6-8c88-e995275c17fc None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 03:16:56.508067 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:56.508067 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 03:16:56.508067 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 03:16:56.508067 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 03:16:56.508067 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 03:16:56.508067 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 03:16:56.508067 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 03:16:56.508067 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 03:16:56.508067 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:16:56.508067 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 03:16:56.508067 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:16:56.508067 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:56.508067 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:56.508067 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:56.508067 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:56.508067 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:56.509166 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:56.509166 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:56.509166 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:56.509166 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:56.509166 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:56.509166 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:56.509166 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 03:16:56.509166 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 03:16:56.509166 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 03:16:56.509166 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 03:16:56.509166 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:56.509166 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:56.509166 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:56.509166 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:56.509166 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:56.509166 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:56.510129 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:56.510129 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:56.510129 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:56.510129 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:56.510129 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:56.510129 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:56.510129 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:56.510129 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:56.510129 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:56.510129 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:56.510129 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 03:16:56.510129 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 03:16:56.510129 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 03:16:56.510129 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:16:56.510129 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 347/701] 10.222.0.25 () {56 vars in 1129 bytes} [Tue Oct 4 03:16:56 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 03:16:56.510963 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eca2cf-c7d1-42c1-9f48-84b87a1a9e5c None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:56.510963 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eca2cf-c7d1-42c1-9f48-84b87a1a9e5c None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:56.510963 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eca2cf-c7d1-42c1-9f48-84b87a1a9e5c None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:56.512465 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 348/702] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:16:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:16:56.515422 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eca2cf-c7d1-42c1-9f48-84b87a1a9e5c None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:56.585295 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ef6330-d839-40ed-b9c2-58b2e8c3b21d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:56.586783 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ef6330-d839-40ed-b9c2-58b2e8c3b21d None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:56.588899 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:56.620482 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:56.651537 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eca2cf-c7d1-42c1-9f48-84b87a1a9e5c None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:56.686684 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02a278d-1a9f-4f9a-a54b-ceb5a87d03f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:56.687311 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a278d-1a9f-4f9a-a54b-ceb5a87d03f2 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:56.687656 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a278d-1a9f-4f9a-a54b-ceb5a87d03f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:56.687933 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a278d-1a9f-4f9a-a54b-ceb5a87d03f2 None admin] PATH_INFO: `/v3/services` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:56.688558 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02a278d-1a9f-4f9a-a54b-ceb5a87d03f2 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:56.688858 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02a278d-1a9f-4f9a-a54b-ceb5a87d03f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:56.690219 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02a278d-1a9f-4f9a-a54b-ceb5a87d03f2 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:56.696058 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 349/703] 10.222.0.25 () {56 vars in 1124 bytes} [Tue Oct 4 03:16:56 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:16:56.697331 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798acf86-7ea5-45f7-86ec-5f7adbe7baee None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:56.697609 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798acf86-7ea5-45f7-86ec-5f7adbe7baee None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:56.697921 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798acf86-7ea5-45f7-86ec-5f7adbe7baee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:56.717422 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 355/704] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 03:16:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 03:16:56.718288 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ef6330-d839-40ed-b9c2-58b2e8c3b21d None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:56.719268 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-798acf86-7ea5-45f7-86ec-5f7adbe7baee None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:16:56.720471 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-798acf86-7ea5-45f7-86ec-5f7adbe7baee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:16:56.799650 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 350/705] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:16:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 03:16:56.800591 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798acf86-7ea5-45f7-86ec-5f7adbe7baee None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:56.840850 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ef6330-d839-40ed-b9c2-58b2e8c3b21d None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:56.875457 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:56.883231 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d0bf81-5063-426e-b428-7c77f22d1d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:56.883870 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0bf81-5063-426e-b428-7c77f22d1d13 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:56.884153 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0bf81-5063-426e-b428-7c77f22d1d13 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:56.884431 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0bf81-5063-426e-b428-7c77f22d1d13 None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:56.885062 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d0bf81-5063-426e-b428-7c77f22d1d13 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:56.885367 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d0bf81-5063-426e-b428-7c77f22d1d13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:56.886740 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d0bf81-5063-426e-b428-7c77f22d1d13 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:56.893811 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 356/706] 10.222.0.25 () {56 vars in 1124 bytes} [Tue Oct 4 03:16:56 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:56.902573 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:56.979792 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798acf86-7ea5-45f7-86ec-5f7adbe7baee None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:57.023282 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be0ce67-b37e-4cd9-a452-db6ad8deb690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:57.024394 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be0ce67-b37e-4cd9-a452-db6ad8deb690 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:57.024936 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be0ce67-b37e-4cd9-a452-db6ad8deb690 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:57.025477 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be0ce67-b37e-4cd9-a452-db6ad8deb690 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:57.037788 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be0ce67-b37e-4cd9-a452-db6ad8deb690 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:57.039647 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be0ce67-b37e-4cd9-a452-db6ad8deb690 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:57.056738 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-3be0ce67-b37e-4cd9-a452-db6ad8deb690 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:16:57.056738 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:57.056738 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:57.056738 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:57.056738 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:57.056738 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:57.056738 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:57.056738 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:57.056738 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:57.056738 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:57.056738 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:57.056738 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:57.056738 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 03:16:57.056738 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 03:16:57.056738 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 03:16:57.056738 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 03:16:57.057752 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:57.057752 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:57.057752 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:57.057752 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:57.057752 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:57.057752 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:57.057752 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:57.057752 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:57.057752 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:57.057752 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:57.057752 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:57.057752 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:57.057752 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:57.057752 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:57.057752 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:57.057752 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:57.057752 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 03:16:57.058647 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 03:16:57.058647 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:16:57.058647 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:16:57.060920 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 351/707] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:16:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:57.067545 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d0bf81-5063-426e-b428-7c77f22d1d13 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:57.150624 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be0ce67-b37e-4cd9-a452-db6ad8deb690 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:57.192636 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d0bf81-5063-426e-b428-7c77f22d1d13 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:57.232664 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f36b2-d70f-4249-abef-80eb994d82c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:57.233610 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f36b2-d70f-4249-abef-80eb994d82c1 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:57.234320 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f36b2-d70f-4249-abef-80eb994d82c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:57.234784 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f36b2-d70f-4249-abef-80eb994d82c1 None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:57.235891 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9f36b2-d70f-4249-abef-80eb994d82c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:57.236443 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9f36b2-d70f-4249-abef-80eb994d82c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:57.238020 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9f36b2-d70f-4249-abef-80eb994d82c1 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:57.253036 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 357/708] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 03:16:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:57.260676 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f36b2-d70f-4249-abef-80eb994d82c1 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:57.271684 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be0ce67-b37e-4cd9-a452-db6ad8deb690 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:57.281050 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:57.310343 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d936b250-0cf3-4118-b098-456260a756be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:57.311333 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936b250-0cf3-4118-b098-456260a756be None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:57.311953 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936b250-0cf3-4118-b098-456260a756be None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:57.312433 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936b250-0cf3-4118-b098-456260a756be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:57.324406 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d936b250-0cf3-4118-b098-456260a756be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:57.326157 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d936b250-0cf3-4118-b098-456260a756be None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:57.341220 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-d936b250-0cf3-4118-b098-456260a756be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:16:57.341220 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:57.341220 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:57.341220 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:57.341220 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:57.341220 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:57.341220 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:57.341220 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:57.341220 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:57.341220 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:57.341220 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:57.341220 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:57.341220 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 03:16:57.341220 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 03:16:57.341220 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 03:16:57.341220 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 03:16:57.342231 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:57.342231 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:57.342231 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:57.342231 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:57.342231 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:57.342231 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:57.342231 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:57.342231 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:57.342231 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:57.342231 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:57.342231 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:57.342231 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:57.342231 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:57.342231 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:57.342231 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:57.342231 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:57.342231 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 03:16:57.343165 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 03:16:57.343165 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:16:57.343165 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:16:57.345439 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 352/709] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:16:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:57.353822 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:57.354925 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d936b250-0cf3-4118-b098-456260a756be None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:57.402618 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f36b2-d70f-4249-abef-80eb994d82c1 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:57.462204 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cac3e5-b1d9-4db8-a875-a8348b1fd538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:57.463282 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cac3e5-b1d9-4db8-a875-a8348b1fd538 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:57.463855 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cac3e5-b1d9-4db8-a875-a8348b1fd538 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:57.464367 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cac3e5-b1d9-4db8-a875-a8348b1fd538 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:57.483577 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cac3e5-b1d9-4db8-a875-a8348b1fd538 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:57.484978 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cac3e5-b1d9-4db8-a875-a8348b1fd538 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:57.500380 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-e7cac3e5-b1d9-4db8-a875-a8348b1fd538 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 03:16:57.500380 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:57.500380 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:57.500380 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:57.500380 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:57.500380 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:57.500380 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:57.500380 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:57.500380 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:57.500380 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:57.500380 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:57.500380 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:57.500380 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 03:16:57.500380 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 03:16:57.500380 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 03:16:57.501370 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 03:16:57.501370 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:57.501370 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:57.501370 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:57.501370 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:57.501370 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:57.501370 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:57.501370 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:57.501370 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:57.501370 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:57.501370 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:57.501370 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:57.501370 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:57.501370 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:57.501370 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:57.501370 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:57.501370 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:57.502491 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 03:16:57.502491 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 03:16:57.502491 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 03:16:57.502491 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 03:16:57.502491 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 03:16:57.502491 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 03:16:57.502491 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 03:16:57.502491 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:16:57.502491 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 358/710] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 03:16:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 03:16:57.509760 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cac3e5-b1d9-4db8-a875-a8348b1fd538 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:57.529417 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d936b250-0cf3-4118-b098-456260a756be None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:57.584005 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5116fc31-d560-4508-be91-72461dba045f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:57.584947 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116fc31-d560-4508-be91-72461dba045f None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:57.585453 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116fc31-d560-4508-be91-72461dba045f None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:57.585911 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116fc31-d560-4508-be91-72461dba045f None admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:57.586831 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5116fc31-d560-4508-be91-72461dba045f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:57.587331 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5116fc31-d560-4508-be91-72461dba045f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:57.588966 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5116fc31-d560-4508-be91-72461dba045f None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:57.602600 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 353/711] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 03:16:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:57.610501 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5116fc31-d560-4508-be91-72461dba045f None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:57.644685 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cac3e5-b1d9-4db8-a875-a8348b1fd538 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:57.650209 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:57.663994 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:57.699517 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17add3df-3547-49c8-925b-b23a6cdf22aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:57.700580 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17add3df-3547-49c8-925b-b23a6cdf22aa None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:57.701152 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17add3df-3547-49c8-925b-b23a6cdf22aa None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:57.701736 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17add3df-3547-49c8-925b-b23a6cdf22aa None admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:57.702664 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17add3df-3547-49c8-925b-b23a6cdf22aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:57.703158 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17add3df-3547-49c8-925b-b23a6cdf22aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:57.705081 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17add3df-3547-49c8-925b-b23a6cdf22aa None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:57.728170 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 359/712] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 4 03:16:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:57.734554 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17add3df-3547-49c8-925b-b23a6cdf22aa None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:57.745926 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5116fc31-d560-4508-be91-72461dba045f None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:57.786371 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27125650-9d60-4924-974a-4b99b446dc0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:57.787143 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27125650-9d60-4924-974a-4b99b446dc0b None admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:57.787435 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27125650-9d60-4924-974a-4b99b446dc0b None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:57.787737 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27125650-9d60-4924-974a-4b99b446dc0b None admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:57.788389 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27125650-9d60-4924-974a-4b99b446dc0b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:57.789825 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27125650-9d60-4924-974a-4b99b446dc0b None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:57.827535 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 354/713] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Oct 4 03:16:57 2022] POST /identity/v3/users => generated 254 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:16:57.919402 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17add3df-3547-49c8-925b-b23a6cdf22aa None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:57.968058 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aadd2b-222a-4e92-8557-72240e8ccf2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:57.968729 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aadd2b-222a-4e92-8557-72240e8ccf2c None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:57.969007 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aadd2b-222a-4e92-8557-72240e8ccf2c None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:57.969276 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aadd2b-222a-4e92-8557-72240e8ccf2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:57.970013 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aadd2b-222a-4e92-8557-72240e8ccf2c None admin] RBAC: Adding query filter params (role.id=fe9379cda35c4ff78576fe48b60bea3c, scope.project.id=80ae15e46620470b9c55fb7fe300fcb6, user.id=2c1f412befb9418fa66a2aabf475aa90) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:57.970320 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aadd2b-222a-4e92-8557-72240e8ccf2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:57.971827 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aadd2b-222a-4e92-8557-72240e8ccf2c None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:57.981755 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 360/714] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 03:16:57 2022] GET /identity/v3/role_assignments?user.id=2c1f412befb9418fa66a2aabf475aa90&scope.project.id=80ae15e46620470b9c55fb7fe300fcb6&role.id=fe9379cda35c4ff78576fe48b60bea3c => generated 259 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:16:58.209574 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f3092-33ea-45b2-928b-55d62a360fda None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:58.209794 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f3092-33ea-45b2-928b-55d62a360fda None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:58.210103 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f3092-33ea-45b2-928b-55d62a360fda None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:58.211775 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 355/715] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:16:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:16:58.217276 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55edf71b-d944-4257-8763-67b2975d8a40 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:58.217562 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55edf71b-d944-4257-8763-67b2975d8a40 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:58.217833 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55edf71b-d944-4257-8763-67b2975d8a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:58.239881 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-55edf71b-d944-4257-8763-67b2975d8a40 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:16:58.242061 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-55edf71b-d944-4257-8763-67b2975d8a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:16:58.274133 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:58.313332 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 361/716] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:16:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 03:16:58.589943 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877f3092-33ea-45b2-928b-55d62a360fda None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:58.674954 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:58.701477 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877f3092-33ea-45b2-928b-55d62a360fda None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:58.748255 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a4c158-b133-4ceb-93fc-3a02355f1a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:58.748897 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a4c158-b133-4ceb-93fc-3a02355f1a76 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:58.749174 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a4c158-b133-4ceb-93fc-3a02355f1a76 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:58.749442 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a4c158-b133-4ceb-93fc-3a02355f1a76 None admin] PATH_INFO: `/v3/services/network` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:58.750026 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a4c158-b133-4ceb-93fc-3a02355f1a76 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:58.751445 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a4c158-b133-4ceb-93fc-3a02355f1a76 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:58.761130 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-07a4c158-b133-4ceb-93fc-3a02355f1a76 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 03:16:58.761130 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:58.761130 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 03:16:58.761130 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 03:16:58.761130 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 03:16:58.761130 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 03:16:58.761130 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 03:16:58.761130 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 03:16:58.761130 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 03:16:58.761130 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:16:58.761130 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 03:16:58.761130 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:16:58.761130 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:58.761130 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:58.761130 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:58.761130 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:58.761130 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:58.762122 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:58.762122 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:58.762122 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:58.762122 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:58.762122 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:58.762122 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:58.762122 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 03:16:58.762122 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 03:16:58.762122 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 03:16:58.762122 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 03:16:58.762122 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:58.762122 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:58.762122 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:58.762122 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:58.762122 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:58.762122 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:58.762951 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:58.762951 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:58.762951 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:58.762951 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:58.762951 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:58.762951 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:58.762951 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:58.762951 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:58.762951 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:58.762951 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:58.762951 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 03:16:58.762951 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 03:16:58.762951 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 03:16:58.762951 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:16:58.767936 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 356/717] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 03:16:58 2022] GET /identity/v3/services/network => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:58.773833 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55edf71b-d944-4257-8763-67b2975d8a40 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:58.854122 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24186648-7465-4593-8b9c-4325c8e05321 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:58.854747 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24186648-7465-4593-8b9c-4325c8e05321 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:58.855232 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24186648-7465-4593-8b9c-4325c8e05321 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:58.857063 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 357/718] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:16:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 03:16:58.862727 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede6cc0-9dec-4364-8603-e8535d3cee8c None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:58.863009 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede6cc0-9dec-4364-8603-e8535d3cee8c None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:58.863280 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede6cc0-9dec-4364-8603-e8535d3cee8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:58.885154 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55edf71b-d944-4257-8763-67b2975d8a40 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:58.900513 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-aede6cc0-9dec-4364-8603-e8535d3cee8c None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:16:58.901713 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-aede6cc0-9dec-4364-8603-e8535d3cee8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:16:58.922063 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b066835b-d608-47f9-bfc2-fd1f0946e643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:58.923410 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066835b-d608-47f9-bfc2-fd1f0946e643 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:58.923966 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066835b-d608-47f9-bfc2-fd1f0946e643 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:58.924508 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066835b-d608-47f9-bfc2-fd1f0946e643 None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:58.925455 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b066835b-d608-47f9-bfc2-fd1f0946e643 None admin] RBAC: Adding query filter params (name=network) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:58.925957 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b066835b-d608-47f9-bfc2-fd1f0946e643 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:58.927688 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b066835b-d608-47f9-bfc2-fd1f0946e643 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:58.933131 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 362/719] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Oct 4 03:16:58 2022] GET /identity/v3/services?name=network => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:58.945233 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b066835b-d608-47f9-bfc2-fd1f0946e643 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:59.008252 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:59.008442 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 358/720] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:16:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 03:16:59.109750 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b066835b-d608-47f9-bfc2-fd1f0946e643 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:59.157608 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee98e5e-17ce-4a92-8b74-0671e76766db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:59.158214 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee98e5e-17ce-4a92-8b74-0671e76766db None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:59.158491 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee98e5e-17ce-4a92-8b74-0671e76766db None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:59.158761 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee98e5e-17ce-4a92-8b74-0671e76766db None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:59.159392 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee98e5e-17ce-4a92-8b74-0671e76766db None admin] RBAC: Adding query filter params (type=network) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:59.159715 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee98e5e-17ce-4a92-8b74-0671e76766db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:59.161178 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee98e5e-17ce-4a92-8b74-0671e76766db None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:59.167499 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 363/721] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Oct 4 03:16:58 2022] GET /identity/v3/services?type=network => generated 124 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:59.289960 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede6cc0-9dec-4364-8603-e8535d3cee8c None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:59.393053 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:59.429686 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede6cc0-9dec-4364-8603-e8535d3cee8c None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:59.465854 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff898f6-d392-4af6-a358-a3858a98447a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:59.466479 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff898f6-d392-4af6-a358-a3858a98447a None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:59.466761 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff898f6-d392-4af6-a358-a3858a98447a None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:59.467036 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff898f6-d392-4af6-a358-a3858a98447a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:59.480639 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff898f6-d392-4af6-a358-a3858a98447a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:16:59.485495 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-aff898f6-d392-4af6-a358-a3858a98447a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 03:16:59.485495 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:59.485495 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:59.485495 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:59.485495 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:59.485495 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:59.485495 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:59.485495 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:59.485495 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:59.485495 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:59.485495 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:59.485495 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:59.485495 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:16:59.485495 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:16:59.485495 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:16:59.485495 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:16:59.486414 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:16:59.486414 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:16:59.486414 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:16:59.486414 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:16:59.486414 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:59.486414 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:59.486414 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:59.486414 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:59.486414 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:59.486414 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:59.486414 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:59.486414 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:59.486414 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:59.486414 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:59.486414 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:59.486414 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:59.487240 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:59.487240 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:59.487240 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:59.487240 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:59.487240 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:16:59.487240 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:16:59.487240 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:16:59.487240 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:16:59.487240 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:16:59.487240 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:16:59.487240 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 03:16:59.487240 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:16:59.487240 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 359/722] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 4 03:16:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:16:59.496120 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee98e5e-17ce-4a92-8b74-0671e76766db None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:59.625425 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:59.635750 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee98e5e-17ce-4a92-8b74-0671e76766db None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:59.692803 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f913f7-2a2a-48c2-8e3d-1233bc092be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:59.694098 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f913f7-2a2a-48c2-8e3d-1233bc092be8 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:59.694472 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f913f7-2a2a-48c2-8e3d-1233bc092be8 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:59.694745 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f913f7-2a2a-48c2-8e3d-1233bc092be8 None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:59.695775 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f913f7-2a2a-48c2-8e3d-1233bc092be8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:16:59.696083 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f913f7-2a2a-48c2-8e3d-1233bc092be8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:59.697469 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f913f7-2a2a-48c2-8e3d-1233bc092be8 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:59.712372 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 364/723] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 03:16:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:16:59.718082 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff898f6-d392-4af6-a358-a3858a98447a None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:16:59.807464 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd5071-99e7-4c06-ae86-689394925976 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:59.807812 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd5071-99e7-4c06-ae86-689394925976 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:59.808040 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd5071-99e7-4c06-ae86-689394925976 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:59.809475 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 365/724] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:16:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 03:16:59.814954 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2a078-e95d-42f3-a8c3-65a3caf0543a None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:59.815243 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2a078-e95d-42f3-a8c3-65a3caf0543a None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:59.815534 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2a078-e95d-42f3-a8c3-65a3caf0543a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:59.856543 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-74a2a078-e95d-42f3-a8c3-65a3caf0543a None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:16:59.857754 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-74a2a078-e95d-42f3-a8c3-65a3caf0543a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:16:59.887744 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff898f6-d392-4af6-a358-a3858a98447a None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:16:59.955925 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:16:59.956100 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 366/725] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:16:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 03:16:59.960460 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c9b114-4a5a-493f-a86e-f9133972aaca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:16:59.961104 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9b114-4a5a-493f-a86e-f9133972aaca None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:16:59.961388 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9b114-4a5a-493f-a86e-f9133972aaca None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:16:59.961676 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9b114-4a5a-493f-a86e-f9133972aaca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:16:59.977858 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c9b114-4a5a-493f-a86e-f9133972aaca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:16:59.979291 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c9b114-4a5a-493f-a86e-f9133972aaca None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:16:59.995239 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-d3c9b114-4a5a-493f-a86e-f9133972aaca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:16:59.995239 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:16:59.995239 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:16:59.995239 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:16:59.995239 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:16:59.995239 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:16:59.995239 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:16:59.995239 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:16:59.995239 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:16:59.995239 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:16:59.995239 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:16:59.995239 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:16:59.995239 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 03:16:59.995239 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 03:16:59.995239 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 03:16:59.995239 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 03:16:59.996267 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:16:59.996267 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:16:59.996267 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:16:59.996267 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:16:59.996267 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:16:59.996267 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:16:59.996267 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:16:59.996267 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:16:59.996267 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:16:59.996267 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:16:59.996267 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:16:59.996267 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:16:59.996267 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:16:59.996267 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:16:59.996267 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:16:59.996267 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:16:59.996267 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 03:16:59.997188 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 03:16:59.997188 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:16:59.997188 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:16:59.997188 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 360/726] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:16:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:17:00.003400 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a2a078-e95d-42f3-a8c3-65a3caf0543a None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:00.138323 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:00.156517 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a2a078-e95d-42f3-a8c3-65a3caf0543a None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:00.207008 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba7bf9-0318-4d6a-a1e5-1da9120027b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:00.207557 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba7bf9-0318-4d6a-a1e5-1da9120027b7 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:00.207845 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba7bf9-0318-4d6a-a1e5-1da9120027b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:00.208124 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba7bf9-0318-4d6a-a1e5-1da9120027b7 None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:00.209292 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dba7bf9-0318-4d6a-a1e5-1da9120027b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:00.209601 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dba7bf9-0318-4d6a-a1e5-1da9120027b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:00.210971 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dba7bf9-0318-4d6a-a1e5-1da9120027b7 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:00.226577 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 367/727] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 03:17:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:17:00.232006 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c9b114-4a5a-493f-a86e-f9133972aaca None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:00.371966 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c9b114-4a5a-493f-a86e-f9133972aaca None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:00.373748 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba7bf9-0318-4d6a-a1e5-1da9120027b7 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:00.407744 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7924ce8d-9861-4205-9118-1b9452bf8310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:00.408367 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924ce8d-9861-4205-9118-1b9452bf8310 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:00.408648 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924ce8d-9861-4205-9118-1b9452bf8310 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:00.408915 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924ce8d-9861-4205-9118-1b9452bf8310 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:00.417416 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7924ce8d-9861-4205-9118-1b9452bf8310 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:00.418938 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7924ce8d-9861-4205-9118-1b9452bf8310 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:00.431053 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-7924ce8d-9861-4205-9118-1b9452bf8310 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 04 03:17:00.431053 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:00.431053 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:00.431053 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:00.431053 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:00.431053 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:00.431053 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:00.431053 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:00.431053 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:00.431053 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:00.431053 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:00.431053 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:00.431053 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 03:17:00.431053 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 03:17:00.431053 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 03:17:00.431053 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 03:17:00.432114 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:00.432114 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:00.432114 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 03:17:00.432114 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 03:17:00.432114 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 03:17:00.432114 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 03:17:00.432114 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:00.432114 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:00.432114 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:00.432114 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:00.432114 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:00.432114 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:00.432114 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:00.432114 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:00.432114 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:00.432114 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:00.432114 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:00.432114 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:00.433062 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:00.433062 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:00.433062 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 03:17:00.433062 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 03:17:00.433062 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 03:17:00.433062 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 03:17:00.433062 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 03:17:00.433062 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 03:17:00.433062 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 04 03:17:00.433062 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:17:00.433062 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 361/728] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 4 03:17:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:17:00.440817 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7924ce8d-9861-4205-9118-1b9452bf8310 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:00.511847 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:00.557415 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba7bf9-0318-4d6a-a1e5-1da9120027b7 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:00.596118 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da2a77-1440-4044-8cf9-491a34c4d6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:00.597128 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da2a77-1440-4044-8cf9-491a34c4d6ce None admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:00.597644 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da2a77-1440-4044-8cf9-491a34c4d6ce None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:00.598123 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da2a77-1440-4044-8cf9-491a34c4d6ce None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:00.598987 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8da2a77-1440-4044-8cf9-491a34c4d6ce None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:00.601114 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8da2a77-1440-4044-8cf9-491a34c4d6ce None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:00.624472 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 368/729] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Oct 4 03:17:00 2022] POST /identity/v3/services => generated 251 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:17:00.662807 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7924ce8d-9861-4205-9118-1b9452bf8310 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:00.735948 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4fd823-5980-4e19-bd80-e14920214361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:00.736579 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4fd823-5980-4e19-bd80-e14920214361 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:00.736836 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4fd823-5980-4e19-bd80-e14920214361 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:00.737133 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4fd823-5980-4e19-bd80-e14920214361 None admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:00.737870 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4fd823-5980-4e19-bd80-e14920214361 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:00.738184 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4fd823-5980-4e19-bd80-e14920214361 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:00.739738 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4fd823-5980-4e19-bd80-e14920214361 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:00.767588 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 362/730] 10.222.0.25 () {56 vars in 1135 bytes} [Tue Oct 4 03:17:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:00.774325 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da2a77-1440-4044-8cf9-491a34c4d6ce None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:00.798481 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:00.880282 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c0ad4-64b5-4c4e-b736-f28f57955d76 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:00.881562 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c0ad4-64b5-4c4e-b736-f28f57955d76 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:00.882073 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c0ad4-64b5-4c4e-b736-f28f57955d76 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:00.883705 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 363/731] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:17:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:17:00.889940 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897bb9af-28f4-48fe-8cba-5af4f50cc130 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:00.890259 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897bb9af-28f4-48fe-8cba-5af4f50cc130 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:00.890645 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897bb9af-28f4-48fe-8cba-5af4f50cc130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:00.918536 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-897bb9af-28f4-48fe-8cba-5af4f50cc130 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:17:00.919900 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-897bb9af-28f4-48fe-8cba-5af4f50cc130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:17:00.942584 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da2a77-1440-4044-8cf9-491a34c4d6ce None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:00.986711 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768de819-d728-4a07-9c04-1aa651590d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:00.987849 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768de819-d728-4a07-9c04-1aa651590d8c None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:00.988136 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768de819-d728-4a07-9c04-1aa651590d8c None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:00.988456 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768de819-d728-4a07-9c04-1aa651590d8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:01.015300 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 364/732] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:17:00 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 03:17:01.016463 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e144596-ea64-42bc-ac1c-c3621a47f34a None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:01.016751 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e144596-ea64-42bc-ac1c-c3621a47f34a None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:01.017029 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e144596-ea64-42bc-ac1c-c3621a47f34a None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:01.018465 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 365/733] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:17:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:17:01.027555 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87cccf2-776c-4554-bcf1-18626f068d1b None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:01.027555 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87cccf2-776c-4554-bcf1-18626f068d1b None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:01.027555 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87cccf2-776c-4554-bcf1-18626f068d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:01.056190 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-b87cccf2-776c-4554-bcf1-18626f068d1b None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:17:01.057385 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-b87cccf2-776c-4554-bcf1-18626f068d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:17:01.096830 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:01.100758 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768de819-d728-4a07-9c04-1aa651590d8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:01.102208 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768de819-d728-4a07-9c04-1aa651590d8c None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:01.118278 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:01.162825 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 366/734] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:17:01 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 03:17:01.237359 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 369/735] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 03:17:00 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 03:17:01.243114 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87cccf2-776c-4554-bcf1-18626f068d1b None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:01.298257 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768de819-d728-4a07-9c04-1aa651590d8c None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:01.399721 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87cccf2-776c-4554-bcf1-18626f068d1b None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:01.462615 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d2d9c-03b8-4913-a8ed-4689acb70433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:01.463249 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d2d9c-03b8-4913-a8ed-4689acb70433 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:01.463553 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d2d9c-03b8-4913-a8ed-4689acb70433 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:01.463829 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d2d9c-03b8-4913-a8ed-4689acb70433 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:01.470561 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768de819-d728-4a07-9c04-1aa651590d8c None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:01.484774 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0d2d9c-03b8-4913-a8ed-4689acb70433 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:01.486215 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0d2d9c-03b8-4913-a8ed-4689acb70433 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:01.488574 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:01.508188 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-6b0d2d9c-03b8-4913-a8ed-4689acb70433 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:17:01.508188 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:01.508188 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:01.508188 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:01.508188 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:01.508188 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:01.508188 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:01.508188 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:01.508188 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:01.508188 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:01.508188 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:01.508188 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:01.508188 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 03:17:01.508188 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 03:17:01.508188 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 03:17:01.508188 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 03:17:01.509170 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:01.509170 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:01.509170 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:01.509170 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:01.509170 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:01.509170 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:01.509170 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:01.509170 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:01.509170 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:01.509170 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:01.509170 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:01.509170 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:01.509170 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:01.509170 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:01.509170 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:01.509170 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:01.509170 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 03:17:01.510055 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 03:17:01.510055 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:17:01.510055 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:17:01.510055 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 367/736] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:17:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:17:01.530094 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d2d9c-03b8-4913-a8ed-4689acb70433 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:01.532326 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facbf372-b9a7-498e-9865-8eb8c958f604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:01.533032 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facbf372-b9a7-498e-9865-8eb8c958f604 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:01.533412 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facbf372-b9a7-498e-9865-8eb8c958f604 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:01.533762 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facbf372-b9a7-498e-9865-8eb8c958f604 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:01.544846 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facbf372-b9a7-498e-9865-8eb8c958f604 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:17:01.549918 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-facbf372-b9a7-498e-9865-8eb8c958f604 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 03:17:01.549918 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:01.549918 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:01.549918 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:01.549918 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:01.549918 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:01.549918 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:01.549918 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:01.549918 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:01.549918 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:01.549918 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:01.549918 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:01.549918 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:17:01.549918 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:17:01.549918 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:17:01.549918 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:17:01.550861 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:17:01.550861 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:17:01.550861 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:17:01.550861 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:17:01.550861 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:01.550861 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:01.550861 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:01.550861 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:01.550861 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:01.550861 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:01.550861 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:01.550861 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:01.550861 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:01.550861 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:01.550861 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:01.550861 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:01.551841 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:01.551841 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:01.551841 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:01.551841 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:01.551841 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:17:01.551841 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:17:01.551841 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:17:01.551841 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:17:01.551841 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:17:01.551841 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:17:01.551841 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 03:17:01.551841 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:17:01.551841 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 370/737] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Oct 4 03:17:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 03:17:01.553597 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:01.563530 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facbf372-b9a7-498e-9865-8eb8c958f604 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:01.686035 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facbf372-b9a7-498e-9865-8eb8c958f604 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:01.696729 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d2d9c-03b8-4913-a8ed-4689acb70433 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:01.723069 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa572512-e622-49d3-8a12-726b85e1098c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:01.723888 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa572512-e622-49d3-8a12-726b85e1098c None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:01.724287 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa572512-e622-49d3-8a12-726b85e1098c None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:01.724690 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa572512-e622-49d3-8a12-726b85e1098c None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:01.725449 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa572512-e622-49d3-8a12-726b85e1098c None admin] RBAC: Adding query filter params (name=service) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:01.725854 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa572512-e622-49d3-8a12-726b85e1098c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:01.727300 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa572512-e622-49d3-8a12-726b85e1098c None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:01.740773 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 371/738] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Oct 4 03:17:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:17:01.740773 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa572512-e622-49d3-8a12-726b85e1098c None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:01.753309 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93085e4a-f8a1-4949-82ba-1d7a7b45dfe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:01.755217 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93085e4a-f8a1-4949-82ba-1d7a7b45dfe2 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:01.755803 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93085e4a-f8a1-4949-82ba-1d7a7b45dfe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:01.756551 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93085e4a-f8a1-4949-82ba-1d7a7b45dfe2 None admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:01.757699 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93085e4a-f8a1-4949-82ba-1d7a7b45dfe2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:01.758247 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93085e4a-f8a1-4949-82ba-1d7a7b45dfe2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:01.760279 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93085e4a-f8a1-4949-82ba-1d7a7b45dfe2 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:01.770623 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:01.784793 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 368/739] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 03:17:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:01.785995 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93085e4a-f8a1-4949-82ba-1d7a7b45dfe2 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:01.855731 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa572512-e622-49d3-8a12-726b85e1098c None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:01.889818 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:01.899630 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3d6d2d-6d16-4e78-8a98-0cdc3953ba8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:01.900362 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d6d2d-6d16-4e78-8a98-0cdc3953ba8b None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:01.900707 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d6d2d-6d16-4e78-8a98-0cdc3953ba8b None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:01.901056 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d6d2d-6d16-4e78-8a98-0cdc3953ba8b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:01.913040 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3d6d2d-6d16-4e78-8a98-0cdc3953ba8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:17:01.918765 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-ce3d6d2d-6d16-4e78-8a98-0cdc3953ba8b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 03:17:01.918765 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:01.918765 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:01.918765 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:01.918765 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:01.918765 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:01.918765 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:01.918765 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:01.918765 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:01.918765 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:01.918765 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:01.918765 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:01.918765 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:17:01.918765 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:17:01.918765 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:17:01.918765 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:17:01.920396 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:17:01.920396 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:17:01.920396 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:17:01.920396 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:17:01.920396 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:01.920396 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:01.920396 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:01.920396 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:01.920396 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:01.920396 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:01.920396 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:01.920396 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:01.920396 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:01.920396 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:01.920396 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:01.920396 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:01.921978 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:01.921978 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:01.921978 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:01.921978 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:01.921978 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:17:01.921978 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:17:01.921978 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:17:01.921978 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:17:01.921978 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:17:01.921978 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:17:01.921978 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 03:17:01.921978 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:17:01.921978 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 372/740] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 4 03:17:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:17:01.921978 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3d6d2d-6d16-4e78-8a98-0cdc3953ba8b None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:01.952811 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93085e4a-f8a1-4949-82ba-1d7a7b45dfe2 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:01.997324 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33caef85-06fb-4730-aa14-60dfc36fc875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:01.998144 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33caef85-06fb-4730-aa14-60dfc36fc875 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:01.998483 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33caef85-06fb-4730-aa14-60dfc36fc875 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:01.999212 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33caef85-06fb-4730-aa14-60dfc36fc875 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:02.009228 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33caef85-06fb-4730-aa14-60dfc36fc875 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:02.010790 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33caef85-06fb-4730-aa14-60dfc36fc875 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:02.025357 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:02.025864 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-33caef85-06fb-4730-aa14-60dfc36fc875 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:17:02.025864 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:02.025864 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:02.025864 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:02.025864 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:02.025864 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:02.025864 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:02.025864 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:02.025864 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:02.025864 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:02.025864 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:02.025864 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:02.025864 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 03:17:02.025864 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 03:17:02.025864 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 03:17:02.025864 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 03:17:02.026713 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:02.026713 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:02.026713 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:02.026713 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:02.026713 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:02.026713 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:02.026713 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:02.026713 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:02.026713 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:02.026713 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:02.026713 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:02.026713 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:02.026713 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:02.026713 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:02.026713 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:02.026713 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:02.026713 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 03:17:02.028252 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 03:17:02.028252 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:17:02.028252 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:17:02.028252 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 369/741] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:17:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:17:02.028252 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33caef85-06fb-4730-aa14-60dfc36fc875 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:02.041642 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3d6d2d-6d16-4e78-8a98-0cdc3953ba8b None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:02.076003 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351045d0-65c0-47c2-b2f5-df3dbd41b12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:02.076631 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351045d0-65c0-47c2-b2f5-df3dbd41b12e None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:02.076911 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351045d0-65c0-47c2-b2f5-df3dbd41b12e None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:02.077183 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351045d0-65c0-47c2-b2f5-df3dbd41b12e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:02.084359 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351045d0-65c0-47c2-b2f5-df3dbd41b12e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:02.086005 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351045d0-65c0-47c2-b2f5-df3dbd41b12e None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:02.097088 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-351045d0-65c0-47c2-b2f5-df3dbd41b12e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 03:17:02.097088 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:02.097088 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:02.097088 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:02.097088 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:02.097088 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:02.097088 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:02.097088 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:02.097088 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:02.097088 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:02.097088 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:02.097088 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:02.097088 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 03:17:02.097088 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 03:17:02.097088 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 03:17:02.098162 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 03:17:02.098162 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:02.098162 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:02.098162 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:02.098162 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:02.098162 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:02.098162 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:02.098162 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:02.098162 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:02.098162 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:02.098162 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:02.098162 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:02.098162 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:02.098162 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:02.098162 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:02.098162 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:02.098162 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:02.099275 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 03:17:02.099275 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 03:17:02.099275 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 03:17:02.099275 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 03:17:02.099275 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 03:17:02.099275 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 03:17:02.099275 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 03:17:02.099275 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:17:02.099275 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 373/742] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 03:17:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:17:02.100076 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e57f4e4-ede8-4f8f-8261-327b5743f882 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:02.100076 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e57f4e4-ede8-4f8f-8261-327b5743f882 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:02.100200 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e57f4e4-ede8-4f8f-8261-327b5743f882 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:02.105680 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 374/743] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:17:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:17:02.105680 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e57f4e4-ede8-4f8f-8261-327b5743f882 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:02.144171 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33caef85-06fb-4730-aa14-60dfc36fc875 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:02.165601 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:02.181929 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463bb07b-2866-43f7-a4f8-dfadfb1d4b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:02.182544 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463bb07b-2866-43f7-a4f8-dfadfb1d4b91 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:02.182831 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463bb07b-2866-43f7-a4f8-dfadfb1d4b91 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:02.183111 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463bb07b-2866-43f7-a4f8-dfadfb1d4b91 None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:02.183805 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463bb07b-2866-43f7-a4f8-dfadfb1d4b91 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:02.184115 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463bb07b-2866-43f7-a4f8-dfadfb1d4b91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:02.185476 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463bb07b-2866-43f7-a4f8-dfadfb1d4b91 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:02.199137 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 370/744] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 03:17:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:02.199137 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463bb07b-2866-43f7-a4f8-dfadfb1d4b91 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:02.220886 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e57f4e4-ede8-4f8f-8261-327b5743f882 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:02.257123 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2448d36-000c-4a73-9497-f6813ac74395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:02.257734 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2448d36-000c-4a73-9497-f6813ac74395 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:02.258007 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2448d36-000c-4a73-9497-f6813ac74395 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:02.258283 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2448d36-000c-4a73-9497-f6813ac74395 None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:02.258920 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2448d36-000c-4a73-9497-f6813ac74395 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:02.259226 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2448d36-000c-4a73-9497-f6813ac74395 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:02.260607 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2448d36-000c-4a73-9497-f6813ac74395 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:02.273097 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 375/745] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 03:17:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:02.274341 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a83e6-2485-4788-9d68-3c0d1d6da4ee None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:02.274633 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a83e6-2485-4788-9d68-3c0d1d6da4ee None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:02.274908 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a83e6-2485-4788-9d68-3c0d1d6da4ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:02.294313 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-866a83e6-2485-4788-9d68-3c0d1d6da4ee None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:17:02.295468 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-866a83e6-2485-4788-9d68-3c0d1d6da4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:17:02.299303 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:02.304325 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463bb07b-2866-43f7-a4f8-dfadfb1d4b91 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:02.374235 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 376/746] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:17:02 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 03:17:02.375391 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a83e6-2485-4788-9d68-3c0d1d6da4ee None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:02.453041 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8b9595-76ea-40e6-afea-6a2a13b5e30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:02.453561 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b9595-76ea-40e6-afea-6a2a13b5e30d None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:02.453842 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b9595-76ea-40e6-afea-6a2a13b5e30d None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:02.454116 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b9595-76ea-40e6-afea-6a2a13b5e30d None admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:02.454804 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8b9595-76ea-40e6-afea-6a2a13b5e30d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:02.455109 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8b9595-76ea-40e6-afea-6a2a13b5e30d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:02.456553 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8b9595-76ea-40e6-afea-6a2a13b5e30d None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:02.469205 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 371/747] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 4 03:17:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:02.470071 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8b9595-76ea-40e6-afea-6a2a13b5e30d None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:02.499725 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a83e6-2485-4788-9d68-3c0d1d6da4ee None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:02.519556 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:02.542534 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31a2a0b-22c2-424c-b02a-ecb81198c7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:02.543550 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a2a0b-22c2-424c-b02a-ecb81198c7a7 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:02.544037 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a2a0b-22c2-424c-b02a-ecb81198c7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:02.544513 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a2a0b-22c2-424c-b02a-ecb81198c7a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:02.553953 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:02.557073 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31a2a0b-22c2-424c-b02a-ecb81198c7a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:02.558936 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31a2a0b-22c2-424c-b02a-ecb81198c7a7 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:02.577074 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-c31a2a0b-22c2-424c-b02a-ecb81198c7a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:17:02.577074 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:02.577074 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:02.577074 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:02.577074 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:02.577074 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:02.577074 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:02.577074 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:02.577074 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:02.577074 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:02.577074 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:02.577074 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:02.577074 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 03:17:02.577074 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 03:17:02.577074 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 03:17:02.577074 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 03:17:02.578062 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:02.578062 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:02.578062 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:02.578062 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:02.578062 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:02.578062 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:02.578062 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:02.578062 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:02.578062 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:02.578062 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:02.578062 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:02.578062 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:02.578062 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:02.578062 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:02.578062 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:02.578062 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:02.578062 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 03:17:02.578940 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 03:17:02.578940 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:17:02.578940 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:17:02.585410 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8b9595-76ea-40e6-afea-6a2a13b5e30d None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:02.586146 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 377/748] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:17:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:17:02.587253 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31a2a0b-22c2-424c-b02a-ecb81198c7a7 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:02.618358 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d3c9cf-1ad1-4da1-af76-7a0f7046b91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:02.618973 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3c9cf-1ad1-4da1-af76-7a0f7046b91b None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:02.619255 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3c9cf-1ad1-4da1-af76-7a0f7046b91b None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:02.619567 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3c9cf-1ad1-4da1-af76-7a0f7046b91b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:02.626930 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d3c9cf-1ad1-4da1-af76-7a0f7046b91b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:02.628408 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d3c9cf-1ad1-4da1-af76-7a0f7046b91b None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:02.641067 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-77d3c9cf-1ad1-4da1-af76-7a0f7046b91b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 03:17:02.641067 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:02.641067 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:02.641067 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:02.641067 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:02.641067 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:02.641067 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:02.641067 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:02.641067 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:02.641067 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:02.641067 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:02.641067 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:02.641067 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 03:17:02.641067 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 03:17:02.641067 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 03:17:02.641067 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 03:17:02.642063 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:02.642063 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:02.642063 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 03:17:02.642063 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 03:17:02.642063 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 03:17:02.642063 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 03:17:02.642063 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:02.642063 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:02.642063 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:02.642063 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:02.642063 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:02.642063 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:02.642063 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:02.642063 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:02.642063 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:02.642063 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:02.642063 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:02.642063 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:02.643561 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:02.643561 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:02.643561 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 03:17:02.643561 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 03:17:02.643561 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 03:17:02.643561 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 03:17:02.643561 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 03:17:02.643561 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 03:17:02.643561 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 03:17:02.643561 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:17:02.643561 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 372/749] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Oct 4 03:17:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:17:02.643561 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d3c9cf-1ad1-4da1-af76-7a0f7046b91b None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:02.705472 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31a2a0b-22c2-424c-b02a-ecb81198c7a7 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:02.739720 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a228f7b-bfe9-4831-86d0-dd0e4af0277f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:02.740497 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a228f7b-bfe9-4831-86d0-dd0e4af0277f None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:02.740885 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a228f7b-bfe9-4831-86d0-dd0e4af0277f None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:02.741166 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a228f7b-bfe9-4831-86d0-dd0e4af0277f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:02.741895 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a228f7b-bfe9-4831-86d0-dd0e4af0277f None admin] RBAC: Adding query filter params (role.id=fe9379cda35c4ff78576fe48b60bea3c, scope.project.id=80ae15e46620470b9c55fb7fe300fcb6, user.id=1d8da6bacc8f432e8f48bb99c7aede11) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:02.742303 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a228f7b-bfe9-4831-86d0-dd0e4af0277f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:02.743837 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a228f7b-bfe9-4831-86d0-dd0e4af0277f None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:02.749252 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d3c9cf-1ad1-4da1-af76-7a0f7046b91b None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:02.749572 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 378/750] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 03:17:02 2022] GET /identity/v3/role_assignments?user.id=1d8da6bacc8f432e8f48bb99c7aede11&scope.project.id=80ae15e46620470b9c55fb7fe300fcb6&role.id=fe9379cda35c4ff78576fe48b60bea3c => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:02.750364 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a228f7b-bfe9-4831-86d0-dd0e4af0277f None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:02.751322 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:02.810638 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cede90a8-4ef6-4945-a993-9ba7e76847c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:02.811299 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede90a8-4ef6-4945-a993-9ba7e76847c3 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:02.811813 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede90a8-4ef6-4945-a993-9ba7e76847c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:02.812321 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede90a8-4ef6-4945-a993-9ba7e76847c3 None admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:02.813814 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cede90a8-4ef6-4945-a993-9ba7e76847c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:02.814447 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cede90a8-4ef6-4945-a993-9ba7e76847c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:02.816233 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cede90a8-4ef6-4945-a993-9ba7e76847c3 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:02.829235 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:02.839704 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 373/751] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 03:17:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:02.840970 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cede90a8-4ef6-4945-a993-9ba7e76847c3 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:02.897016 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a228f7b-bfe9-4831-86d0-dd0e4af0277f None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:02.940649 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c333beb-3d74-4679-b785-f4f6666c3135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:02.941316 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c333beb-3d74-4679-b785-f4f6666c3135 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:02.941599 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c333beb-3d74-4679-b785-f4f6666c3135 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:02.941872 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c333beb-3d74-4679-b785-f4f6666c3135 None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:02.942720 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c333beb-3d74-4679-b785-f4f6666c3135 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:02.943064 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c333beb-3d74-4679-b785-f4f6666c3135 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:02.944709 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c333beb-3d74-4679-b785-f4f6666c3135 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:02.967680 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 379/752] 10.222.0.25 () {56 vars in 1149 bytes} [Tue Oct 4 03:17:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:02.970983 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c333beb-3d74-4679-b785-f4f6666c3135 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:02.985313 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cede90a8-4ef6-4945-a993-9ba7e76847c3 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:03.037976 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921470af-d202-4ae5-8f8f-b29d8bdfc11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:03.038979 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921470af-d202-4ae5-8f8f-b29d8bdfc11d None admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:03.039580 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921470af-d202-4ae5-8f8f-b29d8bdfc11d None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:03.040067 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921470af-d202-4ae5-8f8f-b29d8bdfc11d None admin] PATH_INFO: `/v3/services` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:03.041046 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921470af-d202-4ae5-8f8f-b29d8bdfc11d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:03.042778 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921470af-d202-4ae5-8f8f-b29d8bdfc11d None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:03.067729 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 374/753] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Oct 4 03:17:02 2022] POST /identity/v3/services => generated 240 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:17:03.069319 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921470af-d202-4ae5-8f8f-b29d8bdfc11d None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:03.111234 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:03.146129 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c333beb-3d74-4679-b785-f4f6666c3135 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:03.162361 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:03.200089 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad5e406-f126-418b-8b34-577d8f839da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:03.200828 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad5e406-f126-418b-8b34-577d8f839da9 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:03.201172 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad5e406-f126-418b-8b34-577d8f839da9 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:03.201508 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad5e406-f126-418b-8b34-577d8f839da9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:03.209942 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad5e406-f126-418b-8b34-577d8f839da9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:03.211529 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad5e406-f126-418b-8b34-577d8f839da9 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:03.224311 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-3ad5e406-f126-418b-8b34-577d8f839da9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 03:17:03.224311 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:03.224311 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:03.224311 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:03.224311 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:03.224311 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:03.224311 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:03.224311 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:03.224311 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:03.224311 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:03.224311 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:03.224311 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:03.224311 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 03:17:03.224311 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 03:17:03.224311 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 03:17:03.224311 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 03:17:03.226030 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:03.226030 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:03.226030 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 03:17:03.226030 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 03:17:03.226030 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 03:17:03.226030 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 03:17:03.226030 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:03.226030 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:03.226030 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:03.226030 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:03.226030 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:03.226030 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:03.226030 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:03.226030 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:03.226030 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:03.226030 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:03.226030 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:03.226030 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:03.228488 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:03.228488 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:03.228488 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 03:17:03.228488 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 03:17:03.228488 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 03:17:03.228488 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 03:17:03.228488 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 03:17:03.228488 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 03:17:03.228488 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 03:17:03.228488 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:17:03.228488 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 380/754] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Oct 4 03:17:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:17:03.228488 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7cf8fa-be90-4bef-8726-2150a0326994 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:03.228488 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7cf8fa-be90-4bef-8726-2150a0326994 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:03.230149 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7cf8fa-be90-4bef-8726-2150a0326994 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:03.234715 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 381/755] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:17:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:17:03.236324 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a22ce-228e-4d94-b97b-5e408a0bdadb None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:03.236324 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a22ce-228e-4d94-b97b-5e408a0bdadb None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:03.236324 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a22ce-228e-4d94-b97b-5e408a0bdadb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:03.241546 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921470af-d202-4ae5-8f8f-b29d8bdfc11d None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:03.257226 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-3a4a22ce-228e-4d94-b97b-5e408a0bdadb None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:17:03.258560 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-3a4a22ce-228e-4d94-b97b-5e408a0bdadb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:17:03.293092 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1377f2-80d7-4054-b40e-5482fb0a0054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:03.293717 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1377f2-80d7-4054-b40e-5482fb0a0054 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:03.294007 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1377f2-80d7-4054-b40e-5482fb0a0054 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:03.294289 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1377f2-80d7-4054-b40e-5482fb0a0054 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:03.341077 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 382/756] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:17:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 03:17:03.341997 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4a22ce-228e-4d94-b97b-5e408a0bdadb None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:03.392680 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1377f2-80d7-4054-b40e-5482fb0a0054 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:03.394145 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1377f2-80d7-4054-b40e-5482fb0a0054 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:03.426402 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:03.472127 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:03.476373 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4a22ce-228e-4d94-b97b-5e408a0bdadb None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:03.516012 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 375/757] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 03:17:03 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 03:17:03.525777 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1377f2-80d7-4054-b40e-5482fb0a0054 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:03.527318 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1dd07c-4eb8-4638-9868-d5f74b5200ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:03.528467 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1dd07c-4eb8-4638-9868-d5f74b5200ba None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:03.528780 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1dd07c-4eb8-4638-9868-d5f74b5200ba None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:03.529064 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1dd07c-4eb8-4638-9868-d5f74b5200ba None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:03.530775 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1dd07c-4eb8-4638-9868-d5f74b5200ba None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:03.530775 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1dd07c-4eb8-4638-9868-d5f74b5200ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:03.532314 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1dd07c-4eb8-4638-9868-d5f74b5200ba None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:03.556723 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 383/758] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Oct 4 03:17:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:03.564559 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1dd07c-4eb8-4638-9868-d5f74b5200ba None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:03.708089 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1377f2-80d7-4054-b40e-5482fb0a0054 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:03.730020 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1dd07c-4eb8-4638-9868-d5f74b5200ba None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:03.739567 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:03.757522 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd13882d-dfc4-4e96-8e46-cf05b8c8d0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:03.758294 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13882d-dfc4-4e96-8e46-cf05b8c8d0e7 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:03.758646 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13882d-dfc4-4e96-8e46-cf05b8c8d0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:03.759054 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13882d-dfc4-4e96-8e46-cf05b8c8d0e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:03.775946 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd13882d-dfc4-4e96-8e46-cf05b8c8d0e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:03.777845 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd13882d-dfc4-4e96-8e46-cf05b8c8d0e7 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:03.800861 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-cd13882d-dfc4-4e96-8e46-cf05b8c8d0e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:17:03.800861 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:03.800861 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:03.800861 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:03.800861 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:03.800861 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:03.800861 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:03.800861 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:03.800861 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:03.800861 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:03.800861 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:03.800861 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:03.800861 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 03:17:03.800861 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 03:17:03.800861 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 03:17:03.800861 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 03:17:03.802086 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:03.802086 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:03.802086 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:03.802086 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:03.802086 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:03.802086 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:03.802086 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:03.802086 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:03.802086 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:03.802086 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:03.802086 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:03.802086 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:03.802086 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:03.802086 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:03.802086 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:03.802086 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:03.802086 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 03:17:03.805467 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 03:17:03.805467 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:17:03.805467 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:17:03.805467 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 376/759] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:17:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:17:03.807883 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd13882d-dfc4-4e96-8e46-cf05b8c8d0e7 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:03.818670 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee65618-154b-4331-980b-aaf2afa3113c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:03.819634 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee65618-154b-4331-980b-aaf2afa3113c None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:03.820324 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee65618-154b-4331-980b-aaf2afa3113c None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:03.820756 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee65618-154b-4331-980b-aaf2afa3113c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:03.833419 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee65618-154b-4331-980b-aaf2afa3113c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:03.836120 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee65618-154b-4331-980b-aaf2afa3113c None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:03.860526 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-5ee65618-154b-4331-980b-aaf2afa3113c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:17:03.860526 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:03.860526 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:03.860526 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:03.860526 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:03.860526 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:03.860526 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:03.860526 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:03.860526 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:03.860526 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:03.860526 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:03.860526 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:03.860526 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 03:17:03.860526 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 03:17:03.860526 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 03:17:03.860526 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 03:17:03.861562 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:03.861562 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:03.861562 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:03.861562 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:03.861562 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:03.861562 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:03.861562 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:03.861562 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:03.861562 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:03.861562 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:03.861562 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:03.861562 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:03.861562 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:03.861562 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:03.861562 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:03.861562 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:03.861562 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 03:17:03.862494 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 03:17:03.862494 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:17:03.862494 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:17:03.864611 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 384/760] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:17:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:17:03.866209 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee65618-154b-4331-980b-aaf2afa3113c None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:03.882098 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:03.964146 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd13882d-dfc4-4e96-8e46-cf05b8c8d0e7 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:04.000602 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee65618-154b-4331-980b-aaf2afa3113c None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:04.006636 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd881410-616e-4d93-a5b2-a93f43c4ac0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:04.007379 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd881410-616e-4d93-a5b2-a93f43c4ac0e None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:04.008089 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd881410-616e-4d93-a5b2-a93f43c4ac0e None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:04.008486 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd881410-616e-4d93-a5b2-a93f43c4ac0e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:04.009152 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd881410-616e-4d93-a5b2-a93f43c4ac0e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:04.010651 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd881410-616e-4d93-a5b2-a93f43c4ac0e None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:04.023306 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-dd881410-616e-4d93-a5b2-a93f43c4ac0e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 03:17:04.023306 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:04.023306 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 03:17:04.023306 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 03:17:04.023306 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 03:17:04.023306 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 03:17:04.023306 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 03:17:04.023306 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 03:17:04.023306 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 03:17:04.023306 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:17:04.023306 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 03:17:04.023306 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:17:04.023306 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:04.023306 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:04.023306 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:04.023306 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:04.023306 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:04.024393 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:04.024393 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:04.024393 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:04.024393 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:04.024393 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:04.024393 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:04.024393 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 03:17:04.024393 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 03:17:04.024393 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 03:17:04.024393 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 03:17:04.024393 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:04.024393 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:04.024393 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:04.024393 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:04.024393 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:04.024393 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:04.025242 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:04.025242 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:04.025242 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:04.025242 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:04.025242 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:04.025242 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:04.025242 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:04.025242 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:04.025242 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:04.025242 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:04.025242 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 03:17:04.025242 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 03:17:04.025242 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 03:17:04.025242 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:17:04.025974 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 377/761] 10.222.0.25 () {56 vars in 1129 bytes} [Tue Oct 4 03:17:03 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:17:04.030885 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd881410-616e-4d93-a5b2-a93f43c4ac0e None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:04.053005 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9944a5-8832-4e5b-a37b-e9546889f7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:04.054073 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9944a5-8832-4e5b-a37b-e9546889f7f4 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:04.054501 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9944a5-8832-4e5b-a37b-e9546889f7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:04.055265 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9944a5-8832-4e5b-a37b-e9546889f7f4 None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:04.056088 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9944a5-8832-4e5b-a37b-e9546889f7f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:04.056533 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9944a5-8832-4e5b-a37b-e9546889f7f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:04.058033 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9944a5-8832-4e5b-a37b-e9546889f7f4 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:04.075353 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 385/762] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 03:17:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:04.076539 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9944a5-8832-4e5b-a37b-e9546889f7f4 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:04.087308 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:04.154632 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd881410-616e-4d93-a5b2-a93f43c4ac0e None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:04.170107 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:04.191138 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9370110d-efa1-4cb0-94d4-48192d74ab20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:04.191635 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370110d-efa1-4cb0-94d4-48192d74ab20 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:04.192068 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370110d-efa1-4cb0-94d4-48192d74ab20 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:04.192437 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370110d-efa1-4cb0-94d4-48192d74ab20 None admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:04.193714 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9370110d-efa1-4cb0-94d4-48192d74ab20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:04.194138 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9370110d-efa1-4cb0-94d4-48192d74ab20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:04.195910 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9370110d-efa1-4cb0-94d4-48192d74ab20 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:04.207748 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 378/763] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 03:17:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:04.208709 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9370110d-efa1-4cb0-94d4-48192d74ab20 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:04.215339 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9944a5-8832-4e5b-a37b-e9546889f7f4 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:04.260831 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b31c6b-1007-4d55-8d67-8b434056a20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:04.261390 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b31c6b-1007-4d55-8d67-8b434056a20a None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:04.261672 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b31c6b-1007-4d55-8d67-8b434056a20a None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:04.261950 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b31c6b-1007-4d55-8d67-8b434056a20a None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:04.264729 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b31c6b-1007-4d55-8d67-8b434056a20a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:04.265685 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b31c6b-1007-4d55-8d67-8b434056a20a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:04.267594 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b31c6b-1007-4d55-8d67-8b434056a20a None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:04.280315 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 386/764] 10.222.0.25 () {56 vars in 1124 bytes} [Tue Oct 4 03:17:04 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:04.280939 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b31c6b-1007-4d55-8d67-8b434056a20a None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:04.338045 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:04.341310 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9370110d-efa1-4cb0-94d4-48192d74ab20 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:04.383519 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8442cd34-5a13-44d0-921e-23591892401b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:04.384419 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8442cd34-5a13-44d0-921e-23591892401b None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:04.384842 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8442cd34-5a13-44d0-921e-23591892401b None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:04.385256 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8442cd34-5a13-44d0-921e-23591892401b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:04.394808 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8442cd34-5a13-44d0-921e-23591892401b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:04.397156 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8442cd34-5a13-44d0-921e-23591892401b None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:04.412768 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-8442cd34-5a13-44d0-921e-23591892401b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 03:17:04.412768 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:04.412768 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:04.412768 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:04.412768 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:04.412768 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:04.412768 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:04.412768 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:04.412768 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:04.412768 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:04.412768 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:04.412768 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:04.412768 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 03:17:04.412768 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 03:17:04.412768 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 03:17:04.413834 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 03:17:04.413834 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:04.413834 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:04.413834 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:04.413834 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:04.413834 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:04.413834 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:04.413834 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:04.413834 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:04.413834 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:04.413834 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:04.413834 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:04.413834 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:04.413834 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:04.413834 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:04.413834 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:04.413834 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:04.414925 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 03:17:04.414925 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 03:17:04.414925 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 03:17:04.414925 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 03:17:04.414925 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 03:17:04.414925 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 03:17:04.414925 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 03:17:04.414925 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:17:04.415637 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b31c6b-1007-4d55-8d67-8b434056a20a None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:04.417239 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 379/765] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 03:17:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:17:04.419124 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8442cd34-5a13-44d0-921e-23591892401b None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:04.469444 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bfa238-2786-4f8a-a6d3-5cd332a3afab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:04.470688 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bfa238-2786-4f8a-a6d3-5cd332a3afab None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:04.471460 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bfa238-2786-4f8a-a6d3-5cd332a3afab None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:04.472137 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bfa238-2786-4f8a-a6d3-5cd332a3afab None admin] PATH_INFO: `/v3/projects/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:04.476328 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:04.484441 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bfa238-2786-4f8a-a6d3-5cd332a3afab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:04.486265 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bfa238-2786-4f8a-a6d3-5cd332a3afab None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:04.500216 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-57bfa238-2786-4f8a-a6d3-5cd332a3afab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 03:17:04.500216 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:04.500216 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:04.500216 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:04.500216 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:04.500216 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:04.500216 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:04.500216 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:04.500216 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:04.500216 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:04.500216 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:04.500216 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:04.500216 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 03:17:04.500216 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 03:17:04.500216 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 03:17:04.501146 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 03:17:04.501146 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:04.501146 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:04.501146 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:04.501146 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:04.501146 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:04.501146 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:04.501146 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:04.501146 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:04.501146 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:04.501146 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:04.501146 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:04.501146 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:04.501146 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:04.501146 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:04.501146 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:04.501146 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:04.502037 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 03:17:04.502037 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 03:17:04.502037 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 03:17:04.502037 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 03:17:04.502037 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 03:17:04.502037 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 03:17:04.502037 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 03:17:04.502037 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:17:04.504556 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 387/766] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 03:17:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:17:04.505835 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bfa238-2786-4f8a-a6d3-5cd332a3afab None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:04.548731 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8442cd34-5a13-44d0-921e-23591892401b None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:04.594936 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa5a286-3645-40a4-ab06-30d54e30a60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:04.595738 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa5a286-3645-40a4-ab06-30d54e30a60f None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:04.597783 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa5a286-3645-40a4-ab06-30d54e30a60f None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:04.597783 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa5a286-3645-40a4-ab06-30d54e30a60f None admin] PATH_INFO: `/v3/services` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:04.597783 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa5a286-3645-40a4-ab06-30d54e30a60f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:04.598215 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa5a286-3645-40a4-ab06-30d54e30a60f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:04.600024 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa5a286-3645-40a4-ab06-30d54e30a60f None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:04.606865 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 380/767] 10.222.0.25 () {56 vars in 1124 bytes} [Tue Oct 4 03:17:04 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:04.607989 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa5a286-3645-40a4-ab06-30d54e30a60f None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:04.632591 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bfa238-2786-4f8a-a6d3-5cd332a3afab None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:04.636857 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:04.671247 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984cd231-0ac6-4b8d-a369-573a5784ef6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:04.672049 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984cd231-0ac6-4b8d-a369-573a5784ef6a None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:04.672426 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984cd231-0ac6-4b8d-a369-573a5784ef6a None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:04.672799 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984cd231-0ac6-4b8d-a369-573a5784ef6a None admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:04.673584 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984cd231-0ac6-4b8d-a369-573a5784ef6a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:04.673996 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984cd231-0ac6-4b8d-a369-573a5784ef6a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:04.675752 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984cd231-0ac6-4b8d-a369-573a5784ef6a None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:04.694438 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 388/768] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 4 03:17:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:04.695794 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984cd231-0ac6-4b8d-a369-573a5784ef6a None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:04.720683 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa5a286-3645-40a4-ab06-30d54e30a60f None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:04.760084 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3bd384-0c4b-43ac-9075-db60e6026c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:04.760966 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3bd384-0c4b-43ac-9075-db60e6026c9f None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:04.761398 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3bd384-0c4b-43ac-9075-db60e6026c9f None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:04.761820 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3bd384-0c4b-43ac-9075-db60e6026c9f None admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:04.762346 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:04.763920 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3bd384-0c4b-43ac-9075-db60e6026c9f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:04.764414 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3bd384-0c4b-43ac-9075-db60e6026c9f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:04.765996 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3bd384-0c4b-43ac-9075-db60e6026c9f None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:04.786027 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 381/769] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 4 03:17:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:04.786027 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3bd384-0c4b-43ac-9075-db60e6026c9f None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:04.827530 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984cd231-0ac6-4b8d-a369-573a5784ef6a None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:04.873553 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc08d0f4-0014-4321-9d52-5ecfd14433ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:04.874557 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08d0f4-0014-4321-9d52-5ecfd14433ce None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:04.875383 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08d0f4-0014-4321-9d52-5ecfd14433ce None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:04.875899 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08d0f4-0014-4321-9d52-5ecfd14433ce None admin] PATH_INFO: `/v3/endpoints` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:04.877107 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc08d0f4-0014-4321-9d52-5ecfd14433ce None admin] RBAC: Adding query filter params (interface=public, service_id=42867caf646444a6b27efc5136ada7dd, region_id=RegionOne) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:04.877900 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc08d0f4-0014-4321-9d52-5ecfd14433ce None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:04.879665 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc08d0f4-0014-4321-9d52-5ecfd14433ce None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:04.880181 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:04.890591 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 389/770] 10.222.0.25 () {56 vars in 1251 bytes} [Tue Oct 4 03:17:04 2022] GET /identity/v3/endpoints?service_id=42867caf646444a6b27efc5136ada7dd&interface=public®ion_id=RegionOne => generated 194 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:04.892239 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc08d0f4-0014-4321-9d52-5ecfd14433ce None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:04.906192 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3bd384-0c4b-43ac-9075-db60e6026c9f None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:04.949209 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6618a2e0-f5ce-4091-9c2c-61d798b30232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:04.949925 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6618a2e0-f5ce-4091-9c2c-61d798b30232 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:04.950212 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6618a2e0-f5ce-4091-9c2c-61d798b30232 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:04.950490 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6618a2e0-f5ce-4091-9c2c-61d798b30232 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:04.951414 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6618a2e0-f5ce-4091-9c2c-61d798b30232 None admin] RBAC: Adding query filter params (role.id=1f60934edaf04074936ff079756fc4a6, scope.project.id=80ae15e46620470b9c55fb7fe300fcb6, user.id=bef61ef12079495ba72b7fcd2717aca2) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:04.951890 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6618a2e0-f5ce-4091-9c2c-61d798b30232 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:04.953777 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6618a2e0-f5ce-4091-9c2c-61d798b30232 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:04.967514 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 382/771] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 03:17:04 2022] GET /identity/v3/role_assignments?user.id=bef61ef12079495ba72b7fcd2717aca2&scope.project.id=80ae15e46620470b9c55fb7fe300fcb6&role.id=1f60934edaf04074936ff079756fc4a6 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:04.967514 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6618a2e0-f5ce-4091-9c2c-61d798b30232 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:05.040403 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc08d0f4-0014-4321-9d52-5ecfd14433ce None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:05.060638 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:05.096189 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eed917-4b0d-4663-95d1-2a2cf90be92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:05.096788 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eed917-4b0d-4663-95d1-2a2cf90be92a None admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:05.097074 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eed917-4b0d-4663-95d1-2a2cf90be92a None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:05.097351 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eed917-4b0d-4663-95d1-2a2cf90be92a None admin] PATH_INFO: `/v3/projects/80ae15e46620470b9c55fb7fe300fcb6/users/2c1f412befb9418fa66a2aabf475aa90/roles/fe9379cda35c4ff78576fe48b60bea3c` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:05.102981 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eed917-4b0d-4663-95d1-2a2cf90be92a None admin] RBAC: Authorizing `identity:create_grant(project_id=80ae15e46620470b9c55fb7fe300fcb6, user_id=2c1f412befb9418fa66a2aabf475aa90, role_id=fe9379cda35c4ff78576fe48b60bea3c)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:05.105176 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eed917-4b0d-4663-95d1-2a2cf90be92a None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:05.137312 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 390/772] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Oct 4 03:17:04 2022] PUT /identity/v3/projects/80ae15e46620470b9c55fb7fe300fcb6/users/2c1f412befb9418fa66a2aabf475aa90/roles/fe9379cda35c4ff78576fe48b60bea3c => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:17:05.166476 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6618a2e0-f5ce-4091-9c2c-61d798b30232 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:05.208260 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41e1867-8c87-4e3a-aea5-cb2d32b12565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:05.209429 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e1867-8c87-4e3a-aea5-cb2d32b12565 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:05.210170 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e1867-8c87-4e3a-aea5-cb2d32b12565 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:05.210573 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e1867-8c87-4e3a-aea5-cb2d32b12565 None admin] PATH_INFO: `/v3/services` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:05.211266 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41e1867-8c87-4e3a-aea5-cb2d32b12565 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:05.212837 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41e1867-8c87-4e3a-aea5-cb2d32b12565 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:05.219006 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 383/773] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Oct 4 03:17:04 2022] GET /identity/v3/services => generated 772 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:05.250290 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84aa39e-9632-4d58-8135-6402d80ad27a None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:05.250822 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84aa39e-9632-4d58-8135-6402d80ad27a None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:05.251071 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84aa39e-9632-4d58-8135-6402d80ad27a None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:05.253058 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 391/774] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:17:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:17:05.259106 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a289c-a1c0-4497-96e5-093b41c3eb5c None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:05.259753 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a289c-a1c0-4497-96e5-093b41c3eb5c None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:05.260197 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a289c-a1c0-4497-96e5-093b41c3eb5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:05.289856 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-a93a289c-a1c0-4497-96e5-093b41c3eb5c None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:17:05.291381 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-a93a289c-a1c0-4497-96e5-093b41c3eb5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:17:05.295005 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:05.409332 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 384/775] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:17:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 03:17:05.619644 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcd94f6-8a42-4247-b51f-23dd179adcc0 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:05.619969 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcd94f6-8a42-4247-b51f-23dd179adcc0 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:05.620191 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcd94f6-8a42-4247-b51f-23dd179adcc0 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:05.621790 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 392/776] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:17:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:17:05.627046 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a24082-4c51-4db9-9fe4-c0fbcd35d02a None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:05.627337 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a24082-4c51-4db9-9fe4-c0fbcd35d02a None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:05.627641 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a24082-4c51-4db9-9fe4-c0fbcd35d02a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:05.653076 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-f5a24082-4c51-4db9-9fe4-c0fbcd35d02a None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:17:05.654317 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-f5a24082-4c51-4db9-9fe4-c0fbcd35d02a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:17:05.753146 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 385/777] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:17:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 03:17:05.824412 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcd94f6-8a42-4247-b51f-23dd179adcc0 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:05.940712 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcd94f6-8a42-4247-b51f-23dd179adcc0 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:05.989338 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2151a709-a690-412b-a105-a927646e36fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:05.990599 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151a709-a690-412b-a105-a927646e36fa None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:05.990875 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151a709-a690-412b-a105-a927646e36fa None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:05.991178 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151a709-a690-412b-a105-a927646e36fa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:06.005062 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2151a709-a690-412b-a105-a927646e36fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:17:06.126088 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-2151a709-a690-412b-a105-a927646e36fa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 03:17:06.126088 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:06.126088 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:06.126088 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:06.126088 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:06.126088 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:06.126088 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:06.126088 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:06.126088 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:06.126088 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:06.126088 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:06.126088 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:06.126088 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:17:06.126088 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:17:06.126088 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:17:06.126088 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:17:06.127137 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:17:06.127137 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:17:06.127137 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:17:06.127137 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:17:06.127137 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:06.127137 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:06.127137 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:06.127137 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:06.127137 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:06.127137 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:06.127137 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:06.127137 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:06.127137 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:06.127137 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:06.127137 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:06.127137 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:06.128060 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:06.128060 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:06.128060 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:06.128060 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:06.128060 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:17:06.128060 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:17:06.128060 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:17:06.128060 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:17:06.128060 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:17:06.128060 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:17:06.128060 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 03:17:06.128060 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:17:06.131783 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 393/778] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 4 03:17:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:17:06.133963 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a24082-4c51-4db9-9fe4-c0fbcd35d02a None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:06.228846 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:06.249603 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2151a709-a690-412b-a105-a927646e36fa None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:06.262985 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a24082-4c51-4db9-9fe4-c0fbcd35d02a None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:06.305561 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be6d8f-8665-4f56-8e0e-504d67bdd800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:06.306238 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be6d8f-8665-4f56-8e0e-504d67bdd800 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:06.306526 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be6d8f-8665-4f56-8e0e-504d67bdd800 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:06.306803 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be6d8f-8665-4f56-8e0e-504d67bdd800 None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:06.307512 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00be6d8f-8665-4f56-8e0e-504d67bdd800 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:06.307821 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00be6d8f-8665-4f56-8e0e-504d67bdd800 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:06.309365 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00be6d8f-8665-4f56-8e0e-504d67bdd800 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:06.320194 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 386/779] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 03:17:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:06.326127 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be6d8f-8665-4f56-8e0e-504d67bdd800 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:06.345099 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:06.465598 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2151a709-a690-412b-a105-a927646e36fa None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:06.484944 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be6d8f-8665-4f56-8e0e-504d67bdd800 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:06.516532 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:06.522581 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcfb94b-40fd-4712-82cf-72c0d44ef2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:06.523209 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcfb94b-40fd-4712-82cf-72c0d44ef2bf None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:06.523671 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcfb94b-40fd-4712-82cf-72c0d44ef2bf None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:06.524116 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcfb94b-40fd-4712-82cf-72c0d44ef2bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:06.535522 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcfb94b-40fd-4712-82cf-72c0d44ef2bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:06.537876 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcfb94b-40fd-4712-82cf-72c0d44ef2bf None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:06.546202 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57033b5-eb1c-46f7-ba0d-7c8d9ba20a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:06.546942 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57033b5-eb1c-46f7-ba0d-7c8d9ba20a44 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:06.547224 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57033b5-eb1c-46f7-ba0d-7c8d9ba20a44 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:06.547511 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57033b5-eb1c-46f7-ba0d-7c8d9ba20a44 None admin] PATH_INFO: `/v3/services/network` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:06.548108 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57033b5-eb1c-46f7-ba0d-7c8d9ba20a44 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:06.549472 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57033b5-eb1c-46f7-ba0d-7c8d9ba20a44 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:06.553209 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-dbcfb94b-40fd-4712-82cf-72c0d44ef2bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:17:06.553209 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:06.553209 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:06.553209 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:06.553209 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:06.553209 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:06.553209 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:06.553209 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:06.553209 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:06.553209 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:06.553209 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:06.553209 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:06.553209 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 03:17:06.553209 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 03:17:06.553209 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 03:17:06.553209 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 03:17:06.554116 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:06.554116 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:06.554116 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:06.554116 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:06.554116 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:06.554116 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:06.554116 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:06.554116 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:06.554116 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:06.554116 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:06.554116 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:06.554116 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:06.554116 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:06.554116 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:06.554116 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:06.554116 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:06.554116 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 03:17:06.555028 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 03:17:06.555028 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:17:06.555028 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:17:06.555028 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 387/780] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:17:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 03:17:06.559847 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcfb94b-40fd-4712-82cf-72c0d44ef2bf None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:06.573809 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-b57033b5-eb1c-46f7-ba0d-7c8d9ba20a44 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 03:17:06.573809 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:06.573809 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 03:17:06.573809 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 03:17:06.573809 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 03:17:06.573809 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 03:17:06.573809 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 03:17:06.573809 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 03:17:06.573809 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 03:17:06.573809 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:17:06.573809 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 03:17:06.573809 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:17:06.573809 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:06.573809 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:06.573809 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:06.573809 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:06.573809 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:06.574815 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:06.574815 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:06.574815 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:06.574815 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:06.574815 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:06.574815 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:06.574815 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 03:17:06.574815 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 03:17:06.574815 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 03:17:06.574815 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 03:17:06.574815 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:06.574815 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:06.574815 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:06.574815 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:06.574815 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:06.574815 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:06.575704 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:06.575704 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:06.575704 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:06.575704 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:06.575704 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:06.575704 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:06.575704 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:06.575704 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:06.575704 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:06.575704 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:06.575704 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 03:17:06.575704 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 03:17:06.575704 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 03:17:06.575704 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:17:06.575704 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 394/781] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 03:17:06 2022] GET /identity/v3/services/network => generated 88 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:17:06.580739 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57033b5-eb1c-46f7-ba0d-7c8d9ba20a44 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:06.691861 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcfb94b-40fd-4712-82cf-72c0d44ef2bf None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:06.722259 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57033b5-eb1c-46f7-ba0d-7c8d9ba20a44 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:06.723896 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:06.730719 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc861cc4-2cd7-4f73-8a81-1d12fdc790db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:06.731585 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc861cc4-2cd7-4f73-8a81-1d12fdc790db None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:06.732042 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc861cc4-2cd7-4f73-8a81-1d12fdc790db None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:06.732463 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc861cc4-2cd7-4f73-8a81-1d12fdc790db None admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:06.733253 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc861cc4-2cd7-4f73-8a81-1d12fdc790db None admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:06.733703 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc861cc4-2cd7-4f73-8a81-1d12fdc790db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:06.735220 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc861cc4-2cd7-4f73-8a81-1d12fdc790db None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:06.747803 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 388/782] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 03:17:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:17:06.753811 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc861cc4-2cd7-4f73-8a81-1d12fdc790db None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:06.790979 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a7d112-a7b2-4efa-8f69-fbd5616b9023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:06.791893 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a7d112-a7b2-4efa-8f69-fbd5616b9023 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:06.792352 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a7d112-a7b2-4efa-8f69-fbd5616b9023 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:06.792776 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a7d112-a7b2-4efa-8f69-fbd5616b9023 None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:06.793582 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a7d112-a7b2-4efa-8f69-fbd5616b9023 None admin] RBAC: Adding query filter params (name=network) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:06.795203 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a7d112-a7b2-4efa-8f69-fbd5616b9023 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:06.796746 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a7d112-a7b2-4efa-8f69-fbd5616b9023 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:06.808410 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 395/783] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Oct 4 03:17:06 2022] GET /identity/v3/services?name=network => generated 124 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:06.814283 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a7d112-a7b2-4efa-8f69-fbd5616b9023 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:06.839857 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:06.951689 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc861cc4-2cd7-4f73-8a81-1d12fdc790db None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:06.988278 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ce8bd4-6b44-4b07-bfc7-efaaae0396b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:06.989249 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ce8bd4-6b44-4b07-bfc7-efaaae0396b7 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:06.990369 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ce8bd4-6b44-4b07-bfc7-efaaae0396b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:06.990947 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ce8bd4-6b44-4b07-bfc7-efaaae0396b7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:06.999054 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ce8bd4-6b44-4b07-bfc7-efaaae0396b7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:07.000802 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ce8bd4-6b44-4b07-bfc7-efaaae0396b7 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:07.012458 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-b3ce8bd4-6b44-4b07-bfc7-efaaae0396b7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 04 03:17:07.012458 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:07.012458 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:07.012458 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:07.012458 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:07.012458 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:07.012458 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:07.012458 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:07.012458 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:07.012458 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:07.012458 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:07.012458 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:07.012458 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 03:17:07.012458 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 03:17:07.012458 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 03:17:07.012458 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 03:17:07.013443 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:07.013443 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:07.013443 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 03:17:07.013443 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 03:17:07.013443 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 03:17:07.013443 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 03:17:07.013443 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:07.013443 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:07.013443 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:07.013443 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:07.013443 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:07.013443 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:07.013443 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:07.013443 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:07.013443 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:07.013443 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:07.013443 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:07.013443 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:07.014392 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:07.014392 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:07.014392 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 03:17:07.014392 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 03:17:07.014392 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 03:17:07.014392 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 03:17:07.014392 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 03:17:07.014392 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 03:17:07.014392 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 04 03:17:07.014392 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:17:07.017053 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 389/784] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 4 03:17:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 03:17:07.022416 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ce8bd4-6b44-4b07-bfc7-efaaae0396b7 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:07.042621 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a7d112-a7b2-4efa-8f69-fbd5616b9023 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:07.080580 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0871901-53c1-4fba-89c5-c38770f2124d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:07.081543 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0871901-53c1-4fba-89c5-c38770f2124d None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:07.082055 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0871901-53c1-4fba-89c5-c38770f2124d None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:07.082574 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0871901-53c1-4fba-89c5-c38770f2124d None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:07.083400 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0871901-53c1-4fba-89c5-c38770f2124d None admin] RBAC: Adding query filter params (type=network) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:07.084374 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0871901-53c1-4fba-89c5-c38770f2124d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:07.085935 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0871901-53c1-4fba-89c5-c38770f2124d None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:07.091971 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 396/785] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Oct 4 03:17:06 2022] GET /identity/v3/services?type=network => generated 350 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:07.097422 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0871901-53c1-4fba-89c5-c38770f2124d None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:07.163864 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:07.254543 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ce8bd4-6b44-4b07-bfc7-efaaae0396b7 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:07.263840 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:07.307690 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0871901-53c1-4fba-89c5-c38770f2124d None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:07.313144 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c33dc3-a5e0-44ca-b69a-c08c7330705f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:07.313759 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c33dc3-a5e0-44ca-b69a-c08c7330705f None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:07.314041 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c33dc3-a5e0-44ca-b69a-c08c7330705f None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:07.314318 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c33dc3-a5e0-44ca-b69a-c08c7330705f None admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:07.315050 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c33dc3-a5e0-44ca-b69a-c08c7330705f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:07.315357 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c33dc3-a5e0-44ca-b69a-c08c7330705f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:07.328058 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c33dc3-a5e0-44ca-b69a-c08c7330705f None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:07.352784 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 390/786] 10.222.0.25 () {56 vars in 1135 bytes} [Tue Oct 4 03:17:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:17:07.355267 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf90e366-0614-4c01-af25-67e89faf89f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:07.356513 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf90e366-0614-4c01-af25-67e89faf89f0 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:07.357251 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf90e366-0614-4c01-af25-67e89faf89f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:07.357732 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf90e366-0614-4c01-af25-67e89faf89f0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:07.358635 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf90e366-0614-4c01-af25-67e89faf89f0 None admin] RBAC: Adding query filter params (interface=public, service_id=641bee1db6b148588acc48006927735f, region_id=RegionOne) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:07.359171 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf90e366-0614-4c01-af25-67e89faf89f0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:07.360545 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c33dc3-a5e0-44ca-b69a-c08c7330705f None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:07.361120 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf90e366-0614-4c01-af25-67e89faf89f0 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:07.367623 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 397/787] 10.222.0.25 () {56 vars in 1251 bytes} [Tue Oct 4 03:17:07 2022] GET /identity/v3/endpoints?service_id=641bee1db6b148588acc48006927735f&interface=public®ion_id=RegionOne => generated 194 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:07.376498 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf90e366-0614-4c01-af25-67e89faf89f0 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:07.528009 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:07.535253 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c33dc3-a5e0-44ca-b69a-c08c7330705f None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:07.537508 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf90e366-0614-4c01-af25-67e89faf89f0 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:07.578143 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786757ed-4cea-4373-826d-a5dfe62e309c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:07.578656 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786757ed-4cea-4373-826d-a5dfe62e309c None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:07.578963 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786757ed-4cea-4373-826d-a5dfe62e309c None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:07.579195 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786757ed-4cea-4373-826d-a5dfe62e309c None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:07.579824 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786757ed-4cea-4373-826d-a5dfe62e309c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:07.581146 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4165fc-8bf8-4cd4-8c55-875ae68d26c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:07.581271 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786757ed-4cea-4373-826d-a5dfe62e309c None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:07.582205 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4165fc-8bf8-4cd4-8c55-875ae68d26c2 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:07.582778 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4165fc-8bf8-4cd4-8c55-875ae68d26c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:07.583250 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4165fc-8bf8-4cd4-8c55-875ae68d26c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:07.587961 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 398/788] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Oct 4 03:17:07 2022] GET /identity/v3/services => generated 772 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:07.589242 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b08d55-cebf-4eb6-b967-b423838bea82 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:07.589524 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b08d55-cebf-4eb6-b967-b423838bea82 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:07.589788 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b08d55-cebf-4eb6-b967-b423838bea82 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:07.601494 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 399/789] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:17:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:17:07.601494 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d4c2e-09d4-4177-87bb-7b74a4ae0989 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:07.601494 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d4c2e-09d4-4177-87bb-7b74a4ae0989 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:07.601494 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d4c2e-09d4-4177-87bb-7b74a4ae0989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:07.612856 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4165fc-8bf8-4cd4-8c55-875ae68d26c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:07.615264 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4165fc-8bf8-4cd4-8c55-875ae68d26c2 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:07.627522 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-f83d4c2e-09d4-4177-87bb-7b74a4ae0989 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:17:07.627522 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-f83d4c2e-09d4-4177-87bb-7b74a4ae0989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:17:07.649996 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-de4165fc-8bf8-4cd4-8c55-875ae68d26c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:17:07.649996 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:07.649996 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:07.649996 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:07.649996 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:07.649996 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:07.649996 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:07.649996 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:07.649996 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:07.649996 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:07.649996 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:07.649996 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:07.649996 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 03:17:07.649996 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 03:17:07.649996 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 03:17:07.649996 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 03:17:07.651074 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:07.651074 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:07.651074 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:07.651074 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:07.651074 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:07.651074 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:07.651074 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:07.651074 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:07.651074 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:07.651074 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:07.651074 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:07.651074 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:07.651074 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:07.651074 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:07.651074 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:07.651074 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:07.651074 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 03:17:07.652160 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 03:17:07.652160 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:17:07.652160 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:17:07.652160 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 391/790] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:17:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:17:07.658572 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4165fc-8bf8-4cd4-8c55-875ae68d26c2 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:07.695195 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:07.723474 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 400/791] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:17:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 03:17:07.836221 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4165fc-8bf8-4cd4-8c55-875ae68d26c2 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:07.845759 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f88cf5-10d6-43d1-93eb-fc02ab430291 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:07.846115 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f88cf5-10d6-43d1-93eb-fc02ab430291 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:07.846306 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f88cf5-10d6-43d1-93eb-fc02ab430291 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:07.848626 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 401/792] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:17:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:17:07.855789 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f25add-4d18-4264-ae0c-4f4292167b01 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:07.856089 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f25add-4d18-4264-ae0c-4f4292167b01 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:07.856332 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f25add-4d18-4264-ae0c-4f4292167b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:07.879838 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-38f25add-4d18-4264-ae0c-4f4292167b01 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:17:07.881887 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-38f25add-4d18-4264-ae0c-4f4292167b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:17:07.883409 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e643c9ff-31a7-4c34-8022-0660d7a0700f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:07.884420 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e643c9ff-31a7-4c34-8022-0660d7a0700f None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:07.884953 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e643c9ff-31a7-4c34-8022-0660d7a0700f None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:07.885490 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e643c9ff-31a7-4c34-8022-0660d7a0700f None admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:07.886328 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e643c9ff-31a7-4c34-8022-0660d7a0700f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:07.886841 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e643c9ff-31a7-4c34-8022-0660d7a0700f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:07.888425 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e643c9ff-31a7-4c34-8022-0660d7a0700f None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:07.901987 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 392/793] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 03:17:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:17:07.907387 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e643c9ff-31a7-4c34-8022-0660d7a0700f None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:07.957813 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 402/794] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:17:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 03:17:07.959472 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31d6eb-6fd1-452e-a70b-9f5376320f88 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:07.959786 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31d6eb-6fd1-452e-a70b-9f5376320f88 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:07.960060 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31d6eb-6fd1-452e-a70b-9f5376320f88 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:07.961516 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 403/795] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:17:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:17:07.980825 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5bd7a-d036-447a-9e24-6cb3eaefff8e None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:07.981114 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5bd7a-d036-447a-9e24-6cb3eaefff8e None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:07.981365 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5bd7a-d036-447a-9e24-6cb3eaefff8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:08.011417 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-a0d5bd7a-d036-447a-9e24-6cb3eaefff8e None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:17:08.012627 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-a0d5bd7a-d036-447a-9e24-6cb3eaefff8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:17:08.040842 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:08.042751 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:08.077443 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e643c9ff-31a7-4c34-8022-0660d7a0700f None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:08.112871 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 404/796] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:17:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 03:17:08.113748 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d5bd7a-d036-447a-9e24-6cb3eaefff8e None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:08.122150 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f19002-b3a4-4e3a-a2bb-b658b208c096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:08.122874 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f19002-b3a4-4e3a-a2bb-b658b208c096 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:08.123206 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f19002-b3a4-4e3a-a2bb-b658b208c096 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:08.123498 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f19002-b3a4-4e3a-a2bb-b658b208c096 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:08.131108 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f19002-b3a4-4e3a-a2bb-b658b208c096 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:08.132808 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f19002-b3a4-4e3a-a2bb-b658b208c096 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:08.144826 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-19f19002-b3a4-4e3a-a2bb-b658b208c096 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 03:17:08.144826 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:08.144826 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:08.144826 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:08.144826 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:08.144826 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:08.144826 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:08.144826 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:08.144826 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:08.144826 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:08.144826 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:08.144826 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:08.144826 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 03:17:08.144826 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 03:17:08.144826 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 03:17:08.145747 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 03:17:08.145747 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:08.145747 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:08.145747 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:08.145747 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:08.145747 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:08.145747 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:08.145747 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:08.145747 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:08.145747 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:08.145747 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:08.145747 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:08.145747 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:08.145747 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:08.145747 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:08.145747 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:08.145747 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:08.147461 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 03:17:08.147461 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 03:17:08.147461 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 03:17:08.147461 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 03:17:08.147461 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 03:17:08.147461 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 03:17:08.147461 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 03:17:08.147461 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:17:08.147461 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 393/797] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 03:17:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:17:08.156034 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f19002-b3a4-4e3a-a2bb-b658b208c096 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:08.227142 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d5bd7a-d036-447a-9e24-6cb3eaefff8e None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:08.269918 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f19002-b3a4-4e3a-a2bb-b658b208c096 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:08.282709 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c967869-4f40-46ad-a847-25ab08c8f073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:08.283661 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c967869-4f40-46ad-a847-25ab08c8f073 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:08.284124 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c967869-4f40-46ad-a847-25ab08c8f073 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:08.284571 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c967869-4f40-46ad-a847-25ab08c8f073 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:08.304839 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c967869-4f40-46ad-a847-25ab08c8f073 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:17:08.310268 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-8c967869-4f40-46ad-a847-25ab08c8f073 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 03:17:08.310268 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:08.310268 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:08.310268 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:08.310268 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:08.310268 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:08.310268 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:08.310268 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:08.310268 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:08.310268 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:08.310268 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:08.310268 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:08.310268 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:17:08.310268 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:17:08.310268 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:17:08.310268 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:17:08.311214 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:17:08.311214 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:17:08.311214 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:17:08.311214 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:17:08.311214 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:08.311214 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:08.311214 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:08.311214 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:08.311214 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:08.311214 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:08.311214 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:08.311214 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:08.311214 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:08.311214 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:08.311214 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:08.311214 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:08.312134 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:08.312134 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:08.312134 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:08.312134 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:08.312134 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:17:08.312134 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:17:08.312134 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:17:08.312134 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:17:08.312134 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:17:08.312134 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:17:08.312134 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 03:17:08.312134 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:17:08.314741 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 405/798] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Oct 4 03:17:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:17:08.315740 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c967869-4f40-46ad-a847-25ab08c8f073 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:08.328456 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:08.336174 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688bb33d-3740-497b-8833-2df53ed82688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:08.337025 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688bb33d-3740-497b-8833-2df53ed82688 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:08.337448 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688bb33d-3740-497b-8833-2df53ed82688 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:08.337908 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688bb33d-3740-497b-8833-2df53ed82688 None admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:08.338827 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688bb33d-3740-497b-8833-2df53ed82688 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:08.339366 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688bb33d-3740-497b-8833-2df53ed82688 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:08.341033 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688bb33d-3740-497b-8833-2df53ed82688 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:08.342997 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:08.361496 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 394/799] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 4 03:17:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:08.362657 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688bb33d-3740-497b-8833-2df53ed82688 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:08.435136 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c967869-4f40-46ad-a847-25ab08c8f073 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:08.473815 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c851c72f-1979-47a2-a3d3-fff155268914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:08.474505 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851c72f-1979-47a2-a3d3-fff155268914 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:08.474791 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851c72f-1979-47a2-a3d3-fff155268914 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:08.475068 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851c72f-1979-47a2-a3d3-fff155268914 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:08.487638 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c851c72f-1979-47a2-a3d3-fff155268914 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:17:08.492470 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688bb33d-3740-497b-8833-2df53ed82688 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:08.493135 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-c851c72f-1979-47a2-a3d3-fff155268914 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 03:17:08.493135 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:08.493135 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:08.493135 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:08.493135 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:08.493135 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:08.493135 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:08.493135 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:08.493135 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:08.493135 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:08.493135 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:08.493135 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:08.493135 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:17:08.493135 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:17:08.493135 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:17:08.493135 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:17:08.494045 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:17:08.494045 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:17:08.494045 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:17:08.494045 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:17:08.494045 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:08.494045 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:08.494045 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:08.494045 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:08.494045 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:08.494045 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:08.494045 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:08.494045 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:08.494045 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:08.494045 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:08.494045 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:08.494045 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:08.494887 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:08.494887 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:08.494887 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:08.494887 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:08.494887 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:17:08.494887 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:17:08.494887 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:17:08.494887 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:17:08.494887 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:17:08.494887 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:17:08.494887 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 03:17:08.494887 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:17:08.494887 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 406/800] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 4 03:17:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:17:08.496455 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c851c72f-1979-47a2-a3d3-fff155268914 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:08.535978 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c400a4aa-45a0-47b0-a6cf-2ef59bd7f013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:08.537164 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c400a4aa-45a0-47b0-a6cf-2ef59bd7f013 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:08.537526 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c400a4aa-45a0-47b0-a6cf-2ef59bd7f013 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:08.537990 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c400a4aa-45a0-47b0-a6cf-2ef59bd7f013 None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:08.538656 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c400a4aa-45a0-47b0-a6cf-2ef59bd7f013 None admin] RBAC: Adding query filter params (name=service) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:08.538956 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c400a4aa-45a0-47b0-a6cf-2ef59bd7f013 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:08.540365 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c400a4aa-45a0-47b0-a6cf-2ef59bd7f013 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:08.553118 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 395/801] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Oct 4 03:17:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:08.553118 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c400a4aa-45a0-47b0-a6cf-2ef59bd7f013 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:08.576641 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:08.607590 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:08.616470 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c851c72f-1979-47a2-a3d3-fff155268914 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:08.655417 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c400a4aa-45a0-47b0-a6cf-2ef59bd7f013 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:08.658997 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016c62c0-08fb-4186-b8fd-bc722d1cce46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:08.659698 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c62c0-08fb-4186-b8fd-bc722d1cce46 None admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:08.659983 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c62c0-08fb-4186-b8fd-bc722d1cce46 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:08.660261 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c62c0-08fb-4186-b8fd-bc722d1cce46 None admin] PATH_INFO: `/v3/projects/80ae15e46620470b9c55fb7fe300fcb6/users/1d8da6bacc8f432e8f48bb99c7aede11/roles/fe9379cda35c4ff78576fe48b60bea3c` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:08.662875 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016c62c0-08fb-4186-b8fd-bc722d1cce46 None admin] RBAC: Authorizing `identity:create_grant(project_id=80ae15e46620470b9c55fb7fe300fcb6, user_id=1d8da6bacc8f432e8f48bb99c7aede11, role_id=fe9379cda35c4ff78576fe48b60bea3c)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:08.664374 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016c62c0-08fb-4186-b8fd-bc722d1cce46 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:08.691644 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 407/802] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Oct 4 03:17:08 2022] PUT /identity/v3/projects/80ae15e46620470b9c55fb7fe300fcb6/users/1d8da6bacc8f432e8f48bb99c7aede11/roles/fe9379cda35c4ff78576fe48b60bea3c => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:17:08.691644 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016c62c0-08fb-4186-b8fd-bc722d1cce46 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:08.708881 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f1b702-9e49-43c3-927f-2b6d1951167b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:08.709747 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f1b702-9e49-43c3-927f-2b6d1951167b None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:08.710127 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f1b702-9e49-43c3-927f-2b6d1951167b None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:08.710466 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f1b702-9e49-43c3-927f-2b6d1951167b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:08.711228 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f1b702-9e49-43c3-927f-2b6d1951167b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:08.712858 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f1b702-9e49-43c3-927f-2b6d1951167b None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:08.723618 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-95f1b702-9e49-43c3-927f-2b6d1951167b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 03:17:08.723618 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:08.723618 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 03:17:08.723618 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 03:17:08.723618 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 03:17:08.723618 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 03:17:08.723618 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 03:17:08.723618 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 03:17:08.723618 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 03:17:08.723618 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:17:08.723618 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 03:17:08.723618 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:17:08.723618 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:08.723618 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:08.723618 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:08.723618 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:08.723618 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:08.725352 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:08.725352 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:08.725352 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:08.725352 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:08.725352 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:08.725352 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:08.725352 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 03:17:08.725352 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 03:17:08.725352 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 03:17:08.725352 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 03:17:08.725352 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:08.725352 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:08.725352 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:08.725352 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:08.725352 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:08.725352 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:08.726199 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:08.726199 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:08.726199 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:08.726199 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:08.726199 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:08.726199 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:08.726199 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:08.726199 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:08.726199 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:08.726199 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:08.726199 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 03:17:08.726199 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 03:17:08.726199 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 03:17:08.726199 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:17:08.726199 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 396/803] 10.222.0.25 () {56 vars in 1129 bytes} [Tue Oct 4 03:17:08 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:17:08.726980 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f1b702-9e49-43c3-927f-2b6d1951167b None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:08.827637 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016c62c0-08fb-4186-b8fd-bc722d1cce46 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:08.860816 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f1b702-9e49-43c3-927f-2b6d1951167b None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:08.862407 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:08.874927 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5322751c-ce3c-4fa4-93ad-5fa43f876367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:08.875581 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5322751c-ce3c-4fa4-93ad-5fa43f876367 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:08.875862 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5322751c-ce3c-4fa4-93ad-5fa43f876367 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:08.876134 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5322751c-ce3c-4fa4-93ad-5fa43f876367 None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:08.876808 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5322751c-ce3c-4fa4-93ad-5fa43f876367 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:08.877099 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5322751c-ce3c-4fa4-93ad-5fa43f876367 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:08.878465 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5322751c-ce3c-4fa4-93ad-5fa43f876367 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:08.886680 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:08.888918 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 408/804] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 03:17:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:08.889683 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5322751c-ce3c-4fa4-93ad-5fa43f876367 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:08.914548 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c09773-8bcd-4c27-8791-b48979833ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:08.914548 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c09773-8bcd-4c27-8791-b48979833ce1 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:08.914548 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c09773-8bcd-4c27-8791-b48979833ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:08.914548 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c09773-8bcd-4c27-8791-b48979833ce1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:08.926645 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c09773-8bcd-4c27-8791-b48979833ce1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:08.928676 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c09773-8bcd-4c27-8791-b48979833ce1 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:08.943289 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-79c09773-8bcd-4c27-8791-b48979833ce1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:17:08.943289 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:08.943289 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:08.943289 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:08.943289 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:08.943289 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:08.943289 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:08.943289 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:08.943289 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:08.943289 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:08.943289 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:08.943289 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:08.943289 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 03:17:08.943289 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 03:17:08.943289 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 03:17:08.943289 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 03:17:08.944482 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:08.944482 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:08.944482 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:08.944482 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:08.944482 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:08.944482 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:08.944482 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:08.944482 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:08.944482 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:08.944482 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:08.944482 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:08.944482 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:08.944482 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:08.944482 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:08.944482 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:08.944482 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:08.944482 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 03:17:08.945641 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 03:17:08.945641 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:17:08.945641 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:17:08.947640 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 397/805] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:17:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:17:08.948500 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c09773-8bcd-4c27-8791-b48979833ce1 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:09.024954 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5322751c-ce3c-4fa4-93ad-5fa43f876367 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:09.055373 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c09773-8bcd-4c27-8791-b48979833ce1 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:09.066384 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b508558-5b1b-47c4-be03-bc0de3a26136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:09.067284 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b508558-5b1b-47c4-be03-bc0de3a26136 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:09.067836 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b508558-5b1b-47c4-be03-bc0de3a26136 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:09.068352 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b508558-5b1b-47c4-be03-bc0de3a26136 None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:09.069526 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b508558-5b1b-47c4-be03-bc0de3a26136 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:09.070808 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b508558-5b1b-47c4-be03-bc0de3a26136 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:09.072800 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b508558-5b1b-47c4-be03-bc0de3a26136 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:09.082823 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 409/806] 10.222.0.25 () {56 vars in 1124 bytes} [Tue Oct 4 03:17:08 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:09.082823 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b508558-5b1b-47c4-be03-bc0de3a26136 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:09.105446 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083f9ac6-8c74-4cb0-b2bc-cf6416f30d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:09.106818 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f9ac6-8c74-4cb0-b2bc-cf6416f30d79 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:09.107308 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f9ac6-8c74-4cb0-b2bc-cf6416f30d79 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:09.107954 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f9ac6-8c74-4cb0-b2bc-cf6416f30d79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:09.124038 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083f9ac6-8c74-4cb0-b2bc-cf6416f30d79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:09.129529 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083f9ac6-8c74-4cb0-b2bc-cf6416f30d79 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:09.145031 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:09.152454 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-083f9ac6-8c74-4cb0-b2bc-cf6416f30d79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:17:09.152454 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:09.152454 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:09.152454 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:09.152454 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:09.152454 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:09.152454 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:09.152454 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:09.152454 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:09.152454 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:09.152454 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:09.152454 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:09.152454 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 03:17:09.152454 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 03:17:09.152454 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 03:17:09.152454 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 03:17:09.153413 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:09.153413 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:09.153413 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:09.153413 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:09.153413 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:09.153413 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:09.153413 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:09.153413 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:09.153413 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:09.153413 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:09.153413 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:09.153413 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:09.153413 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:09.153413 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:09.153413 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:09.153413 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:09.153413 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 03:17:09.154325 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 03:17:09.154325 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:17:09.154325 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:17:09.161006 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 398/807] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:17:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:17:09.161006 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083f9ac6-8c74-4cb0-b2bc-cf6416f30d79 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:09.187815 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:09.214137 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b508558-5b1b-47c4-be03-bc0de3a26136 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:09.250591 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245c01aa-489d-4e19-a80f-a174f71f627c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:09.251201 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c01aa-489d-4e19-a80f-a174f71f627c None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:09.251476 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c01aa-489d-4e19-a80f-a174f71f627c None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:09.251784 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c01aa-489d-4e19-a80f-a174f71f627c None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:09.252421 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245c01aa-489d-4e19-a80f-a174f71f627c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:09.252721 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245c01aa-489d-4e19-a80f-a174f71f627c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:09.254067 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245c01aa-489d-4e19-a80f-a174f71f627c None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:09.271583 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 410/808] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 03:17:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:09.272708 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245c01aa-489d-4e19-a80f-a174f71f627c None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:09.285213 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083f9ac6-8c74-4cb0-b2bc-cf6416f30d79 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:09.322055 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace42890-1775-46d2-b943-917793cedff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:09.322254 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace42890-1775-46d2-b943-917793cedff3 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:09.322465 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace42890-1775-46d2-b943-917793cedff3 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:09.322733 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace42890-1775-46d2-b943-917793cedff3 None admin] PATH_INFO: `/v3/services` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:09.323357 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace42890-1775-46d2-b943-917793cedff3 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:09.323697 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace42890-1775-46d2-b943-917793cedff3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:09.325099 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace42890-1775-46d2-b943-917793cedff3 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:09.334938 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 399/809] 10.222.0.25 () {56 vars in 1124 bytes} [Tue Oct 4 03:17:09 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:09.334938 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace42890-1775-46d2-b943-917793cedff3 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:09.417418 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245c01aa-489d-4e19-a80f-a174f71f627c None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:09.432292 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:09.442386 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:09.457853 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34836af5-a395-4614-9c88-75180227ec62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:09.458574 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34836af5-a395-4614-9c88-75180227ec62 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:09.458768 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34836af5-a395-4614-9c88-75180227ec62 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:09.459038 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34836af5-a395-4614-9c88-75180227ec62 None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:09.459702 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34836af5-a395-4614-9c88-75180227ec62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:09.460006 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34836af5-a395-4614-9c88-75180227ec62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:09.461351 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34836af5-a395-4614-9c88-75180227ec62 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:09.461857 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace42890-1775-46d2-b943-917793cedff3 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:09.482131 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 411/810] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 03:17:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:09.482131 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34836af5-a395-4614-9c88-75180227ec62 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:09.515437 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef80af5-5a58-4d7b-9767-d7373f074725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:09.516615 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef80af5-5a58-4d7b-9767-d7373f074725 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:09.517113 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef80af5-5a58-4d7b-9767-d7373f074725 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:09.517535 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef80af5-5a58-4d7b-9767-d7373f074725 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:09.528884 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef80af5-5a58-4d7b-9767-d7373f074725 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:09.531058 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef80af5-5a58-4d7b-9767-d7373f074725 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:09.544921 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-eef80af5-5a58-4d7b-9767-d7373f074725 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 03:17:09.544921 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:09.544921 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:09.544921 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:09.544921 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:09.544921 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:09.544921 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:09.544921 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:09.544921 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:09.544921 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:09.544921 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:09.544921 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:09.544921 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 03:17:09.544921 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 03:17:09.544921 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 03:17:09.544921 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 03:17:09.546164 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:09.546164 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:09.546164 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 03:17:09.546164 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 03:17:09.546164 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 03:17:09.546164 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 03:17:09.546164 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:09.546164 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:09.546164 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:09.546164 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:09.546164 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:09.546164 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:09.546164 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:09.546164 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:09.546164 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:09.546164 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:09.546164 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:09.546164 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:09.547343 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:09.547343 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:09.547343 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 03:17:09.547343 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 03:17:09.547343 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 03:17:09.547343 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 03:17:09.547343 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 03:17:09.547343 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 03:17:09.547343 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 03:17:09.547343 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:17:09.553638 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 400/811] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Oct 4 03:17:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:17:09.554685 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef80af5-5a58-4d7b-9767-d7373f074725 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:09.600310 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34836af5-a395-4614-9c88-75180227ec62 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:09.650125 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70118ba2-ebb9-4614-92d4-ecc704342a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:09.650880 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70118ba2-ebb9-4614-92d4-ecc704342a6f None admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:09.652150 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70118ba2-ebb9-4614-92d4-ecc704342a6f None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:09.652150 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70118ba2-ebb9-4614-92d4-ecc704342a6f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:09.652470 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70118ba2-ebb9-4614-92d4-ecc704342a6f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:09.654185 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70118ba2-ebb9-4614-92d4-ecc704342a6f None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:09.687519 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 412/812] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:17:09 2022] POST /identity/v3/endpoints => generated 346 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:17:09.687519 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70118ba2-ebb9-4614-92d4-ecc704342a6f None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:09.706794 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef80af5-5a58-4d7b-9767-d7373f074725 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:09.764862 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:09.800883 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310f00b2-ca6e-4e0a-863a-9423e8e71178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:09.801910 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f00b2-ca6e-4e0a-863a-9423e8e71178 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:09.803135 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f00b2-ca6e-4e0a-863a-9423e8e71178 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:09.803799 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f00b2-ca6e-4e0a-863a-9423e8e71178 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:09.821051 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310f00b2-ca6e-4e0a-863a-9423e8e71178 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:09.822959 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310f00b2-ca6e-4e0a-863a-9423e8e71178 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:09.842824 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-310f00b2-ca6e-4e0a-863a-9423e8e71178 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 03:17:09.842824 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:09.842824 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:09.842824 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:09.842824 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:09.842824 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:09.842824 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:09.842824 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:09.842824 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:09.842824 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:09.842824 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:09.842824 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:09.842824 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 03:17:09.842824 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 03:17:09.842824 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 03:17:09.842824 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 03:17:09.843903 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:09.843903 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:09.843903 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 03:17:09.843903 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 03:17:09.843903 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 03:17:09.843903 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 03:17:09.843903 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:09.843903 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:09.843903 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:09.843903 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:09.843903 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:09.843903 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:09.843903 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:09.843903 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:09.843903 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:09.843903 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:09.843903 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:09.843903 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:09.844861 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:09.844861 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:09.844861 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 03:17:09.844861 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 03:17:09.844861 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 03:17:09.844861 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 03:17:09.844861 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 03:17:09.844861 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 03:17:09.844861 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 03:17:09.844861 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:17:09.855654 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70118ba2-ebb9-4614-92d4-ecc704342a6f None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:09.856324 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 401/813] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Oct 4 03:17:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:17:09.862376 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310f00b2-ca6e-4e0a-863a-9423e8e71178 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:09.873799 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:09.893627 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbbaa91-7337-418a-8e74-6bfe8c849171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:09.894595 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbbaa91-7337-418a-8e74-6bfe8c849171 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:09.894972 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbbaa91-7337-418a-8e74-6bfe8c849171 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:09.895342 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbbaa91-7337-418a-8e74-6bfe8c849171 None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:09.896974 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbbaa91-7337-418a-8e74-6bfe8c849171 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:09.897428 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbbaa91-7337-418a-8e74-6bfe8c849171 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:09.899056 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbbaa91-7337-418a-8e74-6bfe8c849171 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:09.925776 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 413/814] 10.222.0.25 () {56 vars in 1149 bytes} [Tue Oct 4 03:17:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:09.928983 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbbaa91-7337-418a-8e74-6bfe8c849171 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:10.035405 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:10.051389 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310f00b2-ca6e-4e0a-863a-9423e8e71178 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:10.062212 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbbaa91-7337-418a-8e74-6bfe8c849171 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:10.096069 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cadc54e-b903-4365-b40e-45189e57a3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:10.097171 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cadc54e-b903-4365-b40e-45189e57a3d8 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:10.097708 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cadc54e-b903-4365-b40e-45189e57a3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:10.098229 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cadc54e-b903-4365-b40e-45189e57a3d8 None admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:10.099749 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cadc54e-b903-4365-b40e-45189e57a3d8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:10.100206 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cadc54e-b903-4365-b40e-45189e57a3d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:10.101515 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1343f0-ff85-4912-b43d-6f0a394067c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:10.102065 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cadc54e-b903-4365-b40e-45189e57a3d8 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:10.102182 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1343f0-ff85-4912-b43d-6f0a394067c4 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:10.102409 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1343f0-ff85-4912-b43d-6f0a394067c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:10.102684 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1343f0-ff85-4912-b43d-6f0a394067c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:10.113807 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1343f0-ff85-4912-b43d-6f0a394067c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:10.115530 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1343f0-ff85-4912-b43d-6f0a394067c4 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:10.130049 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 402/815] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Oct 4 03:17:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:17:10.130049 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96274a-e4d6-4163-ba0c-0a5091c1d762 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:10.130049 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96274a-e4d6-4163-ba0c-0a5091c1d762 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:10.130049 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96274a-e4d6-4163-ba0c-0a5091c1d762 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:10.131708 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 403/816] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:17:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:17:10.136135 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c96274a-e4d6-4163-ba0c-0a5091c1d762 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:10.136742 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-ba1343f0-ff85-4912-b43d-6f0a394067c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:17:10.136742 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:10.136742 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:10.136742 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:10.136742 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:10.136742 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:10.136742 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:10.136742 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:10.136742 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:10.136742 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:10.136742 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:10.136742 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:10.136742 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 03:17:10.136742 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 03:17:10.136742 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 03:17:10.136742 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 03:17:10.137633 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:10.137633 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:10.137633 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:10.137633 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:10.137633 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:10.137633 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:10.137633 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:10.137633 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:10.137633 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:10.137633 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:10.137633 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:10.137633 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:10.137633 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:10.137633 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:10.137633 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:10.137633 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:10.137633 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 03:17:10.138557 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 03:17:10.138557 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:17:10.138557 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:17:10.138557 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 414/817] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:17:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:17:10.145988 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1343f0-ff85-4912-b43d-6f0a394067c4 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:10.210063 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:10.254076 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c96274a-e4d6-4163-ba0c-0a5091c1d762 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:10.283763 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1343f0-ff85-4912-b43d-6f0a394067c4 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:10.292162 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e873f10-2663-4715-b3de-fd8faa7c9c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:10.292826 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e873f10-2663-4715-b3de-fd8faa7c9c1e None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:10.293212 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e873f10-2663-4715-b3de-fd8faa7c9c1e None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:10.293587 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e873f10-2663-4715-b3de-fd8faa7c9c1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:10.326784 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9226f070-f597-48ae-a440-134ce33b2c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:10.327791 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9226f070-f597-48ae-a440-134ce33b2c99 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:10.328026 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9226f070-f597-48ae-a440-134ce33b2c99 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:10.328399 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9226f070-f597-48ae-a440-134ce33b2c99 None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:10.329191 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9226f070-f597-48ae-a440-134ce33b2c99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:10.329598 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9226f070-f597-48ae-a440-134ce33b2c99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:10.331101 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9226f070-f597-48ae-a440-134ce33b2c99 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:10.342585 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:10.351841 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 415/818] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 03:17:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:10.353335 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a63582-b37c-40b6-b168-162fcfc9d12b None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:10.353984 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a63582-b37c-40b6-b168-162fcfc9d12b None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:10.354577 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a63582-b37c-40b6-b168-162fcfc9d12b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:10.376788 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-84a63582-b37c-40b6-b168-162fcfc9d12b None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:17:10.378093 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-84a63582-b37c-40b6-b168-162fcfc9d12b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:17:10.386299 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e873f10-2663-4715-b3de-fd8faa7c9c1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:10.388080 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e873f10-2663-4715-b3de-fd8faa7c9c1e None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:10.452015 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:10.479537 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 416/819] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:17:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 03:17:10.479537 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a63582-b37c-40b6-b168-162fcfc9d12b None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:10.520244 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 404/820] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 03:17:10 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 03:17:10.526975 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e873f10-2663-4715-b3de-fd8faa7c9c1e None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:10.590659 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a63582-b37c-40b6-b168-162fcfc9d12b None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:10.625984 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:10.633905 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57df52b1-cb05-4ff4-ac2a-9c1b010595ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:10.639531 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df52b1-cb05-4ff4-ac2a-9c1b010595ad None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:10.639531 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df52b1-cb05-4ff4-ac2a-9c1b010595ad None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:10.639531 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df52b1-cb05-4ff4-ac2a-9c1b010595ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:10.644011 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57df52b1-cb05-4ff4-ac2a-9c1b010595ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:10.645648 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57df52b1-cb05-4ff4-ac2a-9c1b010595ad None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:10.659415 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-57df52b1-cb05-4ff4-ac2a-9c1b010595ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 03:17:10.659415 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:10.659415 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:10.659415 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:10.659415 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:10.659415 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:10.659415 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:10.659415 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:10.659415 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:10.659415 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:10.659415 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:10.659415 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:10.659415 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 03:17:10.659415 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 03:17:10.659415 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 03:17:10.660380 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 03:17:10.660380 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:10.660380 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:10.660380 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:10.660380 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:10.660380 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:10.660380 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:10.660380 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:10.660380 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:10.660380 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:10.660380 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:10.660380 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:10.660380 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:10.660380 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:10.660380 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:10.660380 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:10.660380 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:10.661292 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 03:17:10.661292 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 03:17:10.661292 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 03:17:10.661292 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 03:17:10.661292 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 03:17:10.661292 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 03:17:10.661292 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 03:17:10.661292 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:17:10.661292 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 417/821] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 03:17:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:17:10.667124 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57df52b1-cb05-4ff4-ac2a-9c1b010595ad None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:10.725063 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e873f10-2663-4715-b3de-fd8faa7c9c1e None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:10.792359 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312c642d-84b1-4dd6-a2b3-ba8d3abbadec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:10.793452 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c642d-84b1-4dd6-a2b3-ba8d3abbadec None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:10.793976 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c642d-84b1-4dd6-a2b3-ba8d3abbadec None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:10.794465 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c642d-84b1-4dd6-a2b3-ba8d3abbadec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:10.815453 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312c642d-84b1-4dd6-a2b3-ba8d3abbadec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:10.819291 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312c642d-84b1-4dd6-a2b3-ba8d3abbadec None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:10.845258 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-312c642d-84b1-4dd6-a2b3-ba8d3abbadec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:17:10.845258 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:10.845258 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:10.845258 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:10.845258 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:10.845258 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:10.845258 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:10.845258 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:10.845258 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:10.845258 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:10.845258 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:10.845258 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:10.845258 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 03:17:10.845258 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 03:17:10.845258 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 03:17:10.845258 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 03:17:10.846232 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:10.846232 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:10.846232 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:10.846232 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:10.846232 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:10.846232 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:10.846232 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:10.846232 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:10.846232 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:10.846232 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:10.846232 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:10.846232 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:10.846232 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:10.846232 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:10.846232 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:10.846232 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:10.846232 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 03:17:10.847171 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 03:17:10.847171 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:17:10.847171 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:17:10.849919 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 405/822] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:17:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 03:17:10.855520 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312c642d-84b1-4dd6-a2b3-ba8d3abbadec None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:10.869416 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57df52b1-cb05-4ff4-ac2a-9c1b010595ad None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:10.876554 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:10.925336 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e57dd-9336-4eec-b274-c19ca06d853d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:10.926389 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e57dd-9336-4eec-b274-c19ca06d853d None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:10.926879 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e57dd-9336-4eec-b274-c19ca06d853d None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:10.927470 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e57dd-9336-4eec-b274-c19ca06d853d None admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:10.928399 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0e57dd-9336-4eec-b274-c19ca06d853d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:10.928941 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0e57dd-9336-4eec-b274-c19ca06d853d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:10.930626 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0e57dd-9336-4eec-b274-c19ca06d853d None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:10.945354 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 418/823] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 4 03:17:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:17:10.950172 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e57dd-9336-4eec-b274-c19ca06d853d None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:10.984145 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312c642d-84b1-4dd6-a2b3-ba8d3abbadec None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:11.011013 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:11.021956 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95521752-7c6d-40ca-ab1a-bb153e453236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:11.022571 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95521752-7c6d-40ca-ab1a-bb153e453236 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:11.022852 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95521752-7c6d-40ca-ab1a-bb153e453236 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:11.023125 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95521752-7c6d-40ca-ab1a-bb153e453236 None admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:11.023804 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95521752-7c6d-40ca-ab1a-bb153e453236 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:11.024105 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95521752-7c6d-40ca-ab1a-bb153e453236 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:11.025469 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95521752-7c6d-40ca-ab1a-bb153e453236 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:11.044356 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 406/824] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 03:17:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:17:11.044356 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29400e8-3082-4048-be02-aea630c1c5d6 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:11.044356 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29400e8-3082-4048-be02-aea630c1c5d6 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:11.044356 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29400e8-3082-4048-be02-aea630c1c5d6 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:11.044356 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 407/825] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:17:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:17:11.044356 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29400e8-3082-4048-be02-aea630c1c5d6 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:11.075362 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e57dd-9336-4eec-b274-c19ca06d853d None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:11.115384 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8257c7-c144-4aa6-b2ab-825bb11322ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:11.116011 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8257c7-c144-4aa6-b2ab-825bb11322ee None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:11.116751 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8257c7-c144-4aa6-b2ab-825bb11322ee None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:11.116751 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8257c7-c144-4aa6-b2ab-825bb11322ee None admin] PATH_INFO: `/v3/services/network` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:11.117122 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8257c7-c144-4aa6-b2ab-825bb11322ee None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:11.118468 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8257c7-c144-4aa6-b2ab-825bb11322ee None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:11.125786 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:11.133254 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-7c8257c7-c144-4aa6-b2ab-825bb11322ee None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 03:17:11.133254 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:11.133254 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 03:17:11.133254 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 03:17:11.133254 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 03:17:11.133254 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 03:17:11.133254 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 03:17:11.133254 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 03:17:11.133254 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 03:17:11.133254 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:17:11.133254 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 03:17:11.133254 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:17:11.133254 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:11.133254 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:11.133254 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:11.133254 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:11.133254 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:11.134264 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:11.134264 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:11.134264 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:11.134264 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:11.134264 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:11.134264 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:11.134264 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 03:17:11.134264 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 03:17:11.134264 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 03:17:11.134264 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 03:17:11.134264 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:11.134264 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:11.134264 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:11.134264 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:11.134264 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:11.134264 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:11.135100 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:11.135100 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:11.135100 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:11.135100 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:11.135100 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:11.135100 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:11.135100 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:11.135100 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:11.135100 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:11.135100 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:11.135100 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 03:17:11.135100 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 03:17:11.135100 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 03:17:11.135100 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:17:11.137479 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 419/826] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 03:17:10 2022] GET /identity/v3/services/network => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:17:11.138102 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8257c7-c144-4aa6-b2ab-825bb11322ee None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:11.161210 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29400e8-3082-4048-be02-aea630c1c5d6 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:11.199897 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114c8ae2-ebb9-43a8-9a52-802417f23706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:11.200552 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c8ae2-ebb9-43a8-9a52-802417f23706 None admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:11.200834 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c8ae2-ebb9-43a8-9a52-802417f23706 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:11.201327 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c8ae2-ebb9-43a8-9a52-802417f23706 None admin] PATH_INFO: `/v3/projects/80ae15e46620470b9c55fb7fe300fcb6/users/bef61ef12079495ba72b7fcd2717aca2/roles/1f60934edaf04074936ff079756fc4a6` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:11.216434 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114c8ae2-ebb9-43a8-9a52-802417f23706 None admin] RBAC: Authorizing `identity:create_grant(project_id=80ae15e46620470b9c55fb7fe300fcb6, user_id=bef61ef12079495ba72b7fcd2717aca2, role_id=1f60934edaf04074936ff079756fc4a6)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:11.217895 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114c8ae2-ebb9-43a8-9a52-802417f23706 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:11.230802 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 408/827] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Oct 4 03:17:11 2022] PUT /identity/v3/projects/80ae15e46620470b9c55fb7fe300fcb6/users/bef61ef12079495ba72b7fcd2717aca2/roles/1f60934edaf04074936ff079756fc4a6 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:17:11.232034 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c6cee9-40dc-4bd5-9699-c4653438abb2 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:11.232322 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c6cee9-40dc-4bd5-9699-c4653438abb2 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:11.232599 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c6cee9-40dc-4bd5-9699-c4653438abb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:11.254298 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-f8c6cee9-40dc-4bd5-9699-c4653438abb2 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:17:11.255993 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-f8c6cee9-40dc-4bd5-9699-c4653438abb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:17:11.261032 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8257c7-c144-4aa6-b2ab-825bb11322ee None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:11.282149 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:11.319333 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98b72af-fab6-4572-b4c3-2fdfa82d4e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:11.320118 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b72af-fab6-4572-b4c3-2fdfa82d4e93 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:11.320415 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b72af-fab6-4572-b4c3-2fdfa82d4e93 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:11.320684 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b72af-fab6-4572-b4c3-2fdfa82d4e93 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:11.329495 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98b72af-fab6-4572-b4c3-2fdfa82d4e93 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:11.330674 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98b72af-fab6-4572-b4c3-2fdfa82d4e93 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:11.344393 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-f98b72af-fab6-4572-b4c3-2fdfa82d4e93 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 03:17:11.344393 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:11.344393 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:11.344393 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:11.344393 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:11.344393 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:11.344393 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:11.344393 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:11.344393 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:11.344393 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:11.344393 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:11.344393 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:11.344393 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 03:17:11.344393 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 03:17:11.344393 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 03:17:11.345401 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 03:17:11.345401 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:11.345401 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:11.345401 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:11.345401 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:11.345401 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:11.345401 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:11.345401 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:11.345401 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:11.345401 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:11.345401 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:11.345401 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:11.345401 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:11.345401 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:11.345401 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:11.345401 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:11.345401 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:11.346934 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 03:17:11.346934 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 03:17:11.346934 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 03:17:11.346934 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 03:17:11.346934 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 03:17:11.346934 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 03:17:11.346934 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 03:17:11.346934 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:17:11.346934 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 420/828] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 03:17:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:17:11.346934 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98b72af-fab6-4572-b4c3-2fdfa82d4e93 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:11.350870 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 409/829] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:17:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 03:17:11.366708 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c6cee9-40dc-4bd5-9699-c4653438abb2 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:11.471559 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:11.474659 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98b72af-fab6-4572-b4c3-2fdfa82d4e93 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:11.527563 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c6cee9-40dc-4bd5-9699-c4653438abb2 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:11.528183 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c65ee-632e-4865-b448-ad219252559b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:11.529524 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c65ee-632e-4865-b448-ad219252559b None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:11.529950 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c65ee-632e-4865-b448-ad219252559b None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:11.531241 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c65ee-632e-4865-b448-ad219252559b None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:11.532060 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252c65ee-632e-4865-b448-ad219252559b None admin] RBAC: Adding query filter params (name=network) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:11.532510 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252c65ee-632e-4865-b448-ad219252559b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:11.534015 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252c65ee-632e-4865-b448-ad219252559b None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:11.541179 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 421/830] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Oct 4 03:17:11 2022] GET /identity/v3/services?name=network => generated 124 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:11.549192 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c65ee-632e-4865-b448-ad219252559b None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:11.582559 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90174600-93c5-4c6c-b2d6-e3c7dd8f386d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:11.583347 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90174600-93c5-4c6c-b2d6-e3c7dd8f386d None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:11.583774 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90174600-93c5-4c6c-b2d6-e3c7dd8f386d None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:11.584147 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90174600-93c5-4c6c-b2d6-e3c7dd8f386d None admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:11.585318 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90174600-93c5-4c6c-b2d6-e3c7dd8f386d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:11.585318 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90174600-93c5-4c6c-b2d6-e3c7dd8f386d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:11.586895 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90174600-93c5-4c6c-b2d6-e3c7dd8f386d None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:11.602269 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 410/831] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 4 03:17:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:11.611905 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:11.613804 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90174600-93c5-4c6c-b2d6-e3c7dd8f386d None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:11.693017 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c65ee-632e-4865-b448-ad219252559b None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:11.732065 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72093259-bf9a-458f-b9c2-1d0fb3f10eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:11.733026 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72093259-bf9a-458f-b9c2-1d0fb3f10eba None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:11.733527 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72093259-bf9a-458f-b9c2-1d0fb3f10eba None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:11.734591 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72093259-bf9a-458f-b9c2-1d0fb3f10eba None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:11.735436 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72093259-bf9a-458f-b9c2-1d0fb3f10eba None admin] RBAC: Adding query filter params (type=network) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:11.736445 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72093259-bf9a-458f-b9c2-1d0fb3f10eba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:11.738700 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72093259-bf9a-458f-b9c2-1d0fb3f10eba None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:11.745949 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 422/832] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Oct 4 03:17:11 2022] GET /identity/v3/services?type=network => generated 350 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:17:11.747083 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72093259-bf9a-458f-b9c2-1d0fb3f10eba None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:11.764712 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90174600-93c5-4c6c-b2d6-e3c7dd8f386d None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:11.783029 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:11.813746 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3abc449-928c-4c2f-8ae9-821ef24b2f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:11.814495 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3abc449-928c-4c2f-8ae9-821ef24b2f3f None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:11.814915 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3abc449-928c-4c2f-8ae9-821ef24b2f3f None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:11.815197 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3abc449-928c-4c2f-8ae9-821ef24b2f3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:11.815969 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3abc449-928c-4c2f-8ae9-821ef24b2f3f None admin] RBAC: Adding query filter params (role.id=fe9379cda35c4ff78576fe48b60bea3c, scope.project.id=80ae15e46620470b9c55fb7fe300fcb6, user.id=2c1f412befb9418fa66a2aabf475aa90) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:11.816280 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3abc449-928c-4c2f-8ae9-821ef24b2f3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:11.818220 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3abc449-928c-4c2f-8ae9-821ef24b2f3f None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:11.826713 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 411/833] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 03:17:11 2022] GET /identity/v3/role_assignments?user.id=2c1f412befb9418fa66a2aabf475aa90&scope.project.id=80ae15e46620470b9c55fb7fe300fcb6&role.id=fe9379cda35c4ff78576fe48b60bea3c => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:11.827623 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3abc449-928c-4c2f-8ae9-821ef24b2f3f None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:11.872383 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72093259-bf9a-458f-b9c2-1d0fb3f10eba None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:11.874636 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:11.918515 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe71735-7380-482a-8764-4b83a074899d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:11.919166 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe71735-7380-482a-8764-4b83a074899d None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:11.919458 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe71735-7380-482a-8764-4b83a074899d None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:11.919759 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe71735-7380-482a-8764-4b83a074899d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:11.933252 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe71735-7380-482a-8764-4b83a074899d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:17:11.939983 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-cfe71735-7380-482a-8764-4b83a074899d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 03:17:11.939983 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:11.939983 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:11.939983 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:11.939983 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:11.939983 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:11.939983 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:11.939983 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:11.939983 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:11.939983 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:11.939983 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:11.939983 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:11.939983 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:17:11.939983 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:17:11.939983 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:17:11.939983 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:17:11.940948 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:17:11.940948 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:17:11.940948 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:17:11.940948 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:17:11.940948 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:11.940948 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:11.940948 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:11.940948 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:11.940948 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:11.940948 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:11.940948 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:11.940948 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:11.940948 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:11.940948 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:11.940948 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:11.940948 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:11.942174 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:11.942174 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:11.942174 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:11.942174 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:11.942174 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:17:11.942174 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:17:11.942174 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:17:11.942174 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:17:11.942174 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:17:11.942174 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:17:11.942174 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 03:17:11.942174 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:17:11.942174 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 423/834] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 4 03:17:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:17:11.948112 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe71735-7380-482a-8764-4b83a074899d None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:11.961196 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3abc449-928c-4c2f-8ae9-821ef24b2f3f None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:12.000703 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4971d631-68d4-4e58-a0c0-33478ad4f64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:12.001703 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4971d631-68d4-4e58-a0c0-33478ad4f64e None admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:12.002205 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4971d631-68d4-4e58-a0c0-33478ad4f64e None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:12.002672 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4971d631-68d4-4e58-a0c0-33478ad4f64e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:12.003589 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4971d631-68d4-4e58-a0c0-33478ad4f64e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:12.005208 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4971d631-68d4-4e58-a0c0-33478ad4f64e None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:12.043630 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 412/835] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:17:11 2022] POST /identity/v3/endpoints => generated 337 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:17:12.091926 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe71735-7380-482a-8764-4b83a074899d None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:12.140430 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9b1884-94f5-47fc-8711-831b5d01202e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:12.141057 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b1884-94f5-47fc-8711-831b5d01202e None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:12.141335 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b1884-94f5-47fc-8711-831b5d01202e None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:12.141610 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b1884-94f5-47fc-8711-831b5d01202e None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:12.142277 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9b1884-94f5-47fc-8711-831b5d01202e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:12.142582 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9b1884-94f5-47fc-8711-831b5d01202e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:12.144391 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9b1884-94f5-47fc-8711-831b5d01202e None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:12.160062 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 424/836] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 03:17:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:12.167279 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4971d631-68d4-4e58-a0c0-33478ad4f64e None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:12.216970 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c44bb23-be5d-4469-880e-c1378cf99b19 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:12.217295 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c44bb23-be5d-4469-880e-c1378cf99b19 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:12.217535 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c44bb23-be5d-4469-880e-c1378cf99b19 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:12.219040 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 425/837] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:17:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:17:12.225514 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066fecc4-2e68-4be5-b17e-6601f67964f2 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:12.225833 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066fecc4-2e68-4be5-b17e-6601f67964f2 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:12.226054 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066fecc4-2e68-4be5-b17e-6601f67964f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:12.226715 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:12.252929 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-066fecc4-2e68-4be5-b17e-6601f67964f2 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:17:12.254506 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-066fecc4-2e68-4be5-b17e-6601f67964f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:17:12.275560 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:12.330204 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4971d631-68d4-4e58-a0c0-33478ad4f64e None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:12.344911 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 426/838] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:17:12 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 03:17:12.368862 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cd98e3-dc01-4593-9e65-440f4355cbd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:12.369517 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cd98e3-dc01-4593-9e65-440f4355cbd4 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:12.369767 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cd98e3-dc01-4593-9e65-440f4355cbd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:12.370039 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cd98e3-dc01-4593-9e65-440f4355cbd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:12.381502 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cd98e3-dc01-4593-9e65-440f4355cbd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:12.382947 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cd98e3-dc01-4593-9e65-440f4355cbd4 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:12.398030 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-62cd98e3-dc01-4593-9e65-440f4355cbd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:17:12.398030 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:12.398030 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:12.398030 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:12.398030 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:12.398030 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:12.398030 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:12.398030 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:12.398030 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:12.398030 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:12.398030 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:12.398030 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:12.398030 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 03:17:12.398030 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 03:17:12.398030 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 03:17:12.398030 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 03:17:12.399011 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:12.399011 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:12.399011 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:12.399011 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:12.399011 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:12.399011 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:12.399011 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:12.399011 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:12.399011 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:12.399011 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:12.399011 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:12.399011 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:12.399011 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:12.399011 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:12.399011 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:12.399011 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:12.399011 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 03:17:12.399959 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 03:17:12.399959 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:17:12.399959 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:17:12.399959 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 413/839] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:17:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:17:12.404782 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066fecc4-2e68-4be5-b17e-6601f67964f2 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:12.515798 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066fecc4-2e68-4be5-b17e-6601f67964f2 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:12.552282 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b3472b-b9a0-40d8-8ea9-b274d8282853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:12.553013 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3472b-b9a0-40d8-8ea9-b274d8282853 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:12.553265 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3472b-b9a0-40d8-8ea9-b274d8282853 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:12.553537 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3472b-b9a0-40d8-8ea9-b274d8282853 None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:12.554171 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b3472b-b9a0-40d8-8ea9-b274d8282853 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:12.554472 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b3472b-b9a0-40d8-8ea9-b274d8282853 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:12.555844 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b3472b-b9a0-40d8-8ea9-b274d8282853 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:12.572694 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 427/840] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 03:17:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:17:12.577781 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cd98e3-dc01-4593-9e65-440f4355cbd4 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:12.666010 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b3472b-b9a0-40d8-8ea9-b274d8282853 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:12.679331 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:12.696247 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:12.697767 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cd98e3-dc01-4593-9e65-440f4355cbd4 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:12.736594 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34400f6f-a46d-46f1-b353-434f365201e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:12.737372 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34400f6f-a46d-46f1-b353-434f365201e0 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:12.737484 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34400f6f-a46d-46f1-b353-434f365201e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:12.737757 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34400f6f-a46d-46f1-b353-434f365201e0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:12.746587 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34400f6f-a46d-46f1-b353-434f365201e0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:12.748033 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34400f6f-a46d-46f1-b353-434f365201e0 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:12.759541 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-34400f6f-a46d-46f1-b353-434f365201e0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 04 03:17:12.759541 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:12.759541 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:12.759541 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:12.759541 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:12.759541 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:12.759541 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:12.759541 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:12.759541 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:12.759541 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:12.759541 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:12.759541 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:12.759541 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 03:17:12.759541 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 03:17:12.759541 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 03:17:12.759541 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 03:17:12.760499 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:12.760499 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:12.760499 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 03:17:12.760499 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 03:17:12.760499 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 03:17:12.760499 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 03:17:12.760499 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:12.760499 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:12.760499 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:12.760499 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:12.760499 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:12.760499 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:12.760499 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:12.760499 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:12.760499 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:12.760499 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:12.760499 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:12.760499 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:12.761505 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:12.761505 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:12.761505 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 03:17:12.761505 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 03:17:12.761505 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 03:17:12.761505 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 03:17:12.761505 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 03:17:12.761505 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 03:17:12.761505 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 04 03:17:12.761505 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:17:12.765413 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 414/841] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 4 03:17:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:17:12.766536 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34400f6f-a46d-46f1-b353-434f365201e0 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:12.809128 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b3472b-b9a0-40d8-8ea9-b274d8282853 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:12.844929 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99524de5-f7ab-4424-8745-e8f4babc805d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:12.845679 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99524de5-f7ab-4424-8745-e8f4babc805d None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:12.846034 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99524de5-f7ab-4424-8745-e8f4babc805d None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:12.846381 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99524de5-f7ab-4424-8745-e8f4babc805d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:12.847036 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99524de5-f7ab-4424-8745-e8f4babc805d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:12.848535 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99524de5-f7ab-4424-8745-e8f4babc805d None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:12.859315 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-99524de5-f7ab-4424-8745-e8f4babc805d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 03:17:12.859315 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:12.859315 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 03:17:12.859315 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 03:17:12.859315 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 03:17:12.859315 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 03:17:12.859315 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 03:17:12.859315 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 03:17:12.859315 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 03:17:12.859315 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:17:12.859315 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 03:17:12.859315 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:17:12.859315 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:12.859315 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:12.859315 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:12.859315 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:12.859315 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:12.860382 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:12.860382 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:12.860382 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:12.860382 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:12.860382 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:12.860382 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:12.860382 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 03:17:12.860382 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 03:17:12.860382 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 03:17:12.860382 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 03:17:12.860382 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:12.860382 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:12.860382 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:12.860382 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:12.860382 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:12.860382 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:12.861220 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:12.861220 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:12.861220 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:12.861220 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:12.861220 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:12.861220 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:12.861220 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:12.861220 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:12.861220 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:12.861220 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:12.861220 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 03:17:12.861220 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 03:17:12.861220 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 03:17:12.861220 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:17:12.864240 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 428/842] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Oct 4 03:17:12 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 03:17:12.870595 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99524de5-f7ab-4424-8745-e8f4babc805d None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:12.894484 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34400f6f-a46d-46f1-b353-434f365201e0 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:12.949551 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d46b262-1600-462e-aa96-9ba0f0080cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:12.950165 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46b262-1600-462e-aa96-9ba0f0080cf4 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:12.950680 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46b262-1600-462e-aa96-9ba0f0080cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:12.951109 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46b262-1600-462e-aa96-9ba0f0080cf4 None admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:12.951880 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d46b262-1600-462e-aa96-9ba0f0080cf4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:12.952188 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d46b262-1600-462e-aa96-9ba0f0080cf4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:12.953609 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d46b262-1600-462e-aa96-9ba0f0080cf4 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:12.967414 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:12.979586 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 415/843] 10.222.0.25 () {56 vars in 1135 bytes} [Tue Oct 4 03:17:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:12.984286 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d46b262-1600-462e-aa96-9ba0f0080cf4 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:12.988916 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:13.005832 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99524de5-f7ab-4424-8745-e8f4babc805d None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:13.048707 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253381dc-aad4-44af-81f2-8ace1223d1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:13.049810 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253381dc-aad4-44af-81f2-8ace1223d1ed None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:13.050241 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253381dc-aad4-44af-81f2-8ace1223d1ed None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:13.051085 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253381dc-aad4-44af-81f2-8ace1223d1ed None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:13.052321 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253381dc-aad4-44af-81f2-8ace1223d1ed None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:13.052776 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253381dc-aad4-44af-81f2-8ace1223d1ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:13.054569 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253381dc-aad4-44af-81f2-8ace1223d1ed None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:13.060638 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 429/844] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Oct 4 03:17:12 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:13.066824 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253381dc-aad4-44af-81f2-8ace1223d1ed None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:13.108935 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d46b262-1600-462e-aa96-9ba0f0080cf4 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:13.156239 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa13ef-9c8e-4478-8c1c-0a849d9b39ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:13.156881 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa13ef-9c8e-4478-8c1c-0a849d9b39ff None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:13.157164 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa13ef-9c8e-4478-8c1c-0a849d9b39ff None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:13.157442 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa13ef-9c8e-4478-8c1c-0a849d9b39ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:13.188196 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253381dc-aad4-44af-81f2-8ace1223d1ed None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:13.232728 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fccb435-1273-4114-a64c-f5fc91e0ba25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:13.233723 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fccb435-1273-4114-a64c-f5fc91e0ba25 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:13.234115 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fccb435-1273-4114-a64c-f5fc91e0ba25 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:13.234404 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fccb435-1273-4114-a64c-f5fc91e0ba25 None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:13.235540 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fccb435-1273-4114-a64c-f5fc91e0ba25 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:13.235862 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fccb435-1273-4114-a64c-f5fc91e0ba25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:13.237757 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fccb435-1273-4114-a64c-f5fc91e0ba25 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:13.247524 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 430/845] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Oct 4 03:17:13 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:13.260165 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daa13ef-9c8e-4478-8c1c-0a849d9b39ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:13.261783 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daa13ef-9c8e-4478-8c1c-0a849d9b39ff None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:13.265163 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:13.387397 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 416/846] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 03:17:12 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 03:17:13.399654 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fccb435-1273-4114-a64c-f5fc91e0ba25 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:13.402721 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:13.523116 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fccb435-1273-4114-a64c-f5fc91e0ba25 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:13.559999 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed5a16a-41b1-4b58-8ce4-c4dba1c5bb94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:13.561327 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5a16a-41b1-4b58-8ce4-c4dba1c5bb94 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:13.561813 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5a16a-41b1-4b58-8ce4-c4dba1c5bb94 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:13.562225 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5a16a-41b1-4b58-8ce4-c4dba1c5bb94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:13.573155 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed5a16a-41b1-4b58-8ce4-c4dba1c5bb94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:13.574742 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed5a16a-41b1-4b58-8ce4-c4dba1c5bb94 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:13.590490 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-5ed5a16a-41b1-4b58-8ce4-c4dba1c5bb94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:17:13.590490 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:13.590490 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:13.590490 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:13.590490 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:13.590490 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:13.590490 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:13.590490 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:13.590490 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:13.590490 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:13.590490 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:13.590490 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:13.590490 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 03:17:13.590490 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 03:17:13.590490 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 03:17:13.590490 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 03:17:13.591689 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:13.591689 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:13.591689 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:13.591689 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:13.591689 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:13.591689 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:13.591689 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:13.591689 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:13.591689 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:13.591689 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:13.591689 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:13.591689 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:13.591689 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:13.591689 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:13.591689 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:13.591689 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:13.591689 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 03:17:13.592810 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 03:17:13.592810 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:17:13.592810 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:17:13.594488 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 431/847] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:17:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:17:13.600561 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa13ef-9c8e-4478-8c1c-0a849d9b39ff None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:13.713142 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa13ef-9c8e-4478-8c1c-0a849d9b39ff None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:13.715604 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:13.753444 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a1b1d8-3b9b-467e-8562-63f5f1db4f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:13.754057 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a1b1d8-3b9b-467e-8562-63f5f1db4f55 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:13.754338 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a1b1d8-3b9b-467e-8562-63f5f1db4f55 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:13.754614 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a1b1d8-3b9b-467e-8562-63f5f1db4f55 None admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:13.755843 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a1b1d8-3b9b-467e-8562-63f5f1db4f55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:13.756482 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a1b1d8-3b9b-467e-8562-63f5f1db4f55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:13.760487 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a1b1d8-3b9b-467e-8562-63f5f1db4f55 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:13.773383 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 417/848] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 03:17:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:13.779032 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed5a16a-41b1-4b58-8ce4-c4dba1c5bb94 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:13.805856 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3424d4-1bde-4307-8f7a-68907e5f9e0e None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:13.806162 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3424d4-1bde-4307-8f7a-68907e5f9e0e None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:13.806416 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3424d4-1bde-4307-8f7a-68907e5f9e0e None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:13.808060 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 418/849] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:17:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 03:17:13.815084 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19b13c-182e-43fc-b144-059ee810cf25 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:13.815366 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19b13c-182e-43fc-b144-059ee810cf25 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:13.815778 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19b13c-182e-43fc-b144-059ee810cf25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:13.836193 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-9e19b13c-182e-43fc-b144-059ee810cf25 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:17:13.837397 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-9e19b13c-182e-43fc-b144-059ee810cf25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:17:13.844655 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:13.892967 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed5a16a-41b1-4b58-8ce4-c4dba1c5bb94 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:13.923512 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 419/850] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:17:13 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 03:17:13.931817 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e4b4bb-5c9b-4104-b2d3-b1c833bbccbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:13.932446 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e4b4bb-5c9b-4104-b2d3-b1c833bbccbd None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:13.932725 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e4b4bb-5c9b-4104-b2d3-b1c833bbccbd None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:13.932999 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e4b4bb-5c9b-4104-b2d3-b1c833bbccbd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:13.940725 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e4b4bb-5c9b-4104-b2d3-b1c833bbccbd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:13.942210 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e4b4bb-5c9b-4104-b2d3-b1c833bbccbd None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:13.954934 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-b5e4b4bb-5c9b-4104-b2d3-b1c833bbccbd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 03:17:13.954934 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:13.954934 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:13.954934 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:13.954934 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:13.954934 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:13.954934 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:13.954934 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:13.954934 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:13.954934 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:13.954934 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:13.954934 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:13.954934 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 03:17:13.954934 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 03:17:13.954934 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 03:17:13.955910 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 03:17:13.955910 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:13.955910 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:13.955910 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:13.955910 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:13.955910 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:13.955910 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:13.955910 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:13.955910 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:13.955910 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:13.955910 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:13.955910 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:13.955910 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:13.955910 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:13.955910 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:13.955910 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:13.955910 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:13.957225 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 03:17:13.957225 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 03:17:13.957225 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 03:17:13.957225 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 03:17:13.957225 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 03:17:13.957225 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 03:17:13.957225 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 03:17:13.957225 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:17:13.957225 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 432/851] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 03:17:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:17:13.962622 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e19b13c-182e-43fc-b144-059ee810cf25 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:14.060485 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:14.068708 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e19b13c-182e-43fc-b144-059ee810cf25 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:14.112314 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896941c7-4c4f-4112-9eaa-23a29ef9525c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:14.113041 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896941c7-4c4f-4112-9eaa-23a29ef9525c None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:14.113325 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896941c7-4c4f-4112-9eaa-23a29ef9525c None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:14.113601 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896941c7-4c4f-4112-9eaa-23a29ef9525c None admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:14.116259 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896941c7-4c4f-4112-9eaa-23a29ef9525c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:14.116570 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896941c7-4c4f-4112-9eaa-23a29ef9525c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:14.118806 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896941c7-4c4f-4112-9eaa-23a29ef9525c None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:14.137247 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 420/852] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 4 03:17:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:14.143175 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e4b4bb-5c9b-4104-b2d3-b1c833bbccbd None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:14.204274 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896941c7-4c4f-4112-9eaa-23a29ef9525c None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:14.259357 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e4b4bb-5c9b-4104-b2d3-b1c833bbccbd None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:14.274701 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:14.297912 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50620dfe-b50a-428d-89ec-da5e23c06813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:14.298801 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50620dfe-b50a-428d-89ec-da5e23c06813 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:14.299154 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50620dfe-b50a-428d-89ec-da5e23c06813 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:14.299515 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50620dfe-b50a-428d-89ec-da5e23c06813 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:14.300350 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50620dfe-b50a-428d-89ec-da5e23c06813 None admin] RBAC: Adding query filter params (role.id=fe9379cda35c4ff78576fe48b60bea3c, scope.project.id=80ae15e46620470b9c55fb7fe300fcb6, user.id=1d8da6bacc8f432e8f48bb99c7aede11) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:14.300805 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50620dfe-b50a-428d-89ec-da5e23c06813 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:14.303040 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50620dfe-b50a-428d-89ec-da5e23c06813 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:14.311123 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 433/853] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 03:17:14 2022] GET /identity/v3/role_assignments?user.id=1d8da6bacc8f432e8f48bb99c7aede11&scope.project.id=80ae15e46620470b9c55fb7fe300fcb6&role.id=fe9379cda35c4ff78576fe48b60bea3c => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:17:14.327360 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896941c7-4c4f-4112-9eaa-23a29ef9525c None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:14.341885 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84d136-276f-43ea-bde0-b67087b2dc93 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:14.342172 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84d136-276f-43ea-bde0-b67087b2dc93 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:14.342451 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84d136-276f-43ea-bde0-b67087b2dc93 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:14.344715 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 434/854] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:17:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 03:17:14.353348 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1154ff3-8683-4a7a-96c5-97faa9d5bfa6 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:14.353662 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1154ff3-8683-4a7a-96c5-97faa9d5bfa6 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:14.354093 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1154ff3-8683-4a7a-96c5-97faa9d5bfa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:14.366948 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd90b1f3-9629-47d6-9620-00dab93b1c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:14.367615 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd90b1f3-9629-47d6-9620-00dab93b1c6f None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:14.367900 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd90b1f3-9629-47d6-9620-00dab93b1c6f None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:14.368177 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd90b1f3-9629-47d6-9620-00dab93b1c6f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:14.379355 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd90b1f3-9629-47d6-9620-00dab93b1c6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:17:14.383672 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-e1154ff3-8683-4a7a-96c5-97faa9d5bfa6 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:17:14.385230 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-e1154ff3-8683-4a7a-96c5-97faa9d5bfa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:17:14.385518 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-fd90b1f3-9629-47d6-9620-00dab93b1c6f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 03:17:14.385518 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:14.385518 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:14.385518 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:14.385518 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:14.385518 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:14.385518 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:14.385518 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:14.385518 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:14.385518 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:14.385518 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:14.385518 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:14.385518 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:17:14.385518 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:17:14.385518 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:17:14.385518 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:17:14.386452 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:17:14.386452 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:17:14.386452 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:17:14.386452 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:17:14.386452 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:14.386452 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:14.386452 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:14.386452 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:14.386452 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:14.386452 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:14.386452 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:14.386452 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:14.386452 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:14.386452 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:14.386452 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:14.386452 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:14.387329 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:14.387329 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:14.387329 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:14.387329 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:14.387329 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:17:14.387329 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:17:14.387329 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:17:14.387329 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:17:14.387329 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:17:14.387329 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:17:14.387329 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 03:17:14.387329 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:17:14.387329 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 421/855] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Oct 4 03:17:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 03:17:14.393648 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd90b1f3-9629-47d6-9620-00dab93b1c6f None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:14.431869 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:14.488562 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 435/856] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:17:14 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 03:17:14.520574 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd90b1f3-9629-47d6-9620-00dab93b1c6f None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:14.560964 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944ae5a1-11e4-4d9c-9d2f-3b5ecb94ed30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:14.561622 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ae5a1-11e4-4d9c-9d2f-3b5ecb94ed30 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:14.561845 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ae5a1-11e4-4d9c-9d2f-3b5ecb94ed30 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:14.562114 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ae5a1-11e4-4d9c-9d2f-3b5ecb94ed30 None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:14.562768 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944ae5a1-11e4-4d9c-9d2f-3b5ecb94ed30 None admin] RBAC: Adding query filter params (name=service) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:14.563074 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944ae5a1-11e4-4d9c-9d2f-3b5ecb94ed30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:14.564462 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944ae5a1-11e4-4d9c-9d2f-3b5ecb94ed30 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:14.573362 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 422/857] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Oct 4 03:17:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:17:14.579000 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1154ff3-8683-4a7a-96c5-97faa9d5bfa6 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:14.684775 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1154ff3-8683-4a7a-96c5-97faa9d5bfa6 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:14.696412 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:14.723794 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2939d3-0de6-4b20-8234-741bfd563a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:14.725193 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2939d3-0de6-4b20-8234-741bfd563a69 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:14.725738 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2939d3-0de6-4b20-8234-741bfd563a69 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:14.726161 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2939d3-0de6-4b20-8234-741bfd563a69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:14.737345 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2939d3-0de6-4b20-8234-741bfd563a69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:14.739068 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2939d3-0de6-4b20-8234-741bfd563a69 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:14.754686 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-de2939d3-0de6-4b20-8234-741bfd563a69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:17:14.754686 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:14.754686 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:14.754686 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:14.754686 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:14.754686 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:14.754686 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:14.754686 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:14.754686 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:14.754686 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:14.754686 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:14.754686 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:14.754686 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 03:17:14.754686 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 03:17:14.754686 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 03:17:14.754686 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 03:17:14.756452 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:14.756452 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:14.756452 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:14.756452 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:14.756452 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:14.756452 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:14.756452 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:14.756452 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:14.756452 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:14.756452 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:14.756452 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:14.756452 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:14.756452 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:14.756452 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:14.756452 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:14.756452 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:14.756452 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 03:17:14.757572 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 03:17:14.757572 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:17:14.757572 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:17:14.759281 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 436/858] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:17:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:17:14.765191 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944ae5a1-11e4-4d9c-9d2f-3b5ecb94ed30 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:14.765640 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2939d3-0de6-4b20-8234-741bfd563a69 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:14.869509 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:14.872355 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2939d3-0de6-4b20-8234-741bfd563a69 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:14.907204 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944ae5a1-11e4-4d9c-9d2f-3b5ecb94ed30 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:14.912089 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc26fe9-6718-41ba-88eb-34a499237a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:14.912725 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc26fe9-6718-41ba-88eb-34a499237a40 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:14.913004 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc26fe9-6718-41ba-88eb-34a499237a40 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:14.913275 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc26fe9-6718-41ba-88eb-34a499237a40 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:14.913969 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc26fe9-6718-41ba-88eb-34a499237a40 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:14.915317 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc26fe9-6718-41ba-88eb-34a499237a40 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:14.925033 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-6bc26fe9-6718-41ba-88eb-34a499237a40 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 03:17:14.925033 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:14.925033 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 03:17:14.925033 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 03:17:14.925033 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 03:17:14.925033 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 03:17:14.925033 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 03:17:14.925033 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 03:17:14.925033 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 03:17:14.925033 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:17:14.925033 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 03:17:14.925033 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:17:14.925033 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:14.925033 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:14.925033 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:14.925033 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:14.925991 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:14.925991 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:14.925991 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:14.925991 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:14.925991 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:14.925991 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:14.925991 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:14.925991 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 03:17:14.925991 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 03:17:14.925991 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 03:17:14.925991 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 03:17:14.925991 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:14.925991 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:14.925991 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:14.925991 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:14.925991 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:14.925991 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:14.932099 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:14.932099 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:14.932099 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:14.932099 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:14.932099 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:14.932099 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:14.932099 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:14.932099 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:14.932099 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:14.932099 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:14.932099 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 03:17:14.932099 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 03:17:14.932099 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 03:17:14.932099 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:17:14.932099 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 437/859] 10.222.0.25 () {56 vars in 1132 bytes} [Tue Oct 4 03:17:14 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 03:17:14.932890 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc26fe9-6718-41ba-88eb-34a499237a40 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:14.956422 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15399ed9-7c32-4869-908f-d9350ef2c72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:14.957396 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15399ed9-7c32-4869-908f-d9350ef2c72f None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:14.957910 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15399ed9-7c32-4869-908f-d9350ef2c72f None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:14.958845 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15399ed9-7c32-4869-908f-d9350ef2c72f None admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:14.959581 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15399ed9-7c32-4869-908f-d9350ef2c72f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:14.959951 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15399ed9-7c32-4869-908f-d9350ef2c72f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:14.961396 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15399ed9-7c32-4869-908f-d9350ef2c72f None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:14.963342 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:14.979535 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 423/860] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 03:17:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:14.986281 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15399ed9-7c32-4869-908f-d9350ef2c72f None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:15.058167 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc26fe9-6718-41ba-88eb-34a499237a40 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:15.100818 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e2004-9a3b-4c82-a848-5bd756522f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:15.101901 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e2004-9a3b-4c82-a848-5bd756522f5a None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:15.102703 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e2004-9a3b-4c82-a848-5bd756522f5a None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:15.103423 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e2004-9a3b-4c82-a848-5bd756522f5a None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:15.104292 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29e2004-9a3b-4c82-a848-5bd756522f5a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:15.104792 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29e2004-9a3b-4c82-a848-5bd756522f5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:15.106463 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29e2004-9a3b-4c82-a848-5bd756522f5a None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:15.108059 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15399ed9-7c32-4869-908f-d9350ef2c72f None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:15.118177 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 438/861] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Oct 4 03:17:14 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:17:15.119333 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e2004-9a3b-4c82-a848-5bd756522f5a None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:15.152201 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ece014-8d8f-410f-9367-8e13edbc10d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:15.153631 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ece014-8d8f-410f-9367-8e13edbc10d7 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:15.154287 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ece014-8d8f-410f-9367-8e13edbc10d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:15.154737 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ece014-8d8f-410f-9367-8e13edbc10d7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:15.158757 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:15.166693 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ece014-8d8f-410f-9367-8e13edbc10d7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:15.168409 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ece014-8d8f-410f-9367-8e13edbc10d7 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:15.184051 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-f5ece014-8d8f-410f-9367-8e13edbc10d7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 03:17:15.184051 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:15.184051 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:15.184051 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:15.184051 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:15.184051 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:15.184051 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:15.184051 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:15.184051 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:15.184051 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:15.184051 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:15.184051 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:15.184051 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 03:17:15.184051 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 03:17:15.184051 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 03:17:15.184051 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 03:17:15.185028 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:15.185028 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:15.185028 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 03:17:15.185028 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 03:17:15.185028 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 03:17:15.185028 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 03:17:15.185028 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:15.185028 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:15.185028 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:15.185028 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:15.185028 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:15.185028 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:15.185028 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:15.185028 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:15.185028 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:15.185028 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:15.185028 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:15.185028 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:15.185953 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:15.185953 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:15.185953 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 03:17:15.185953 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 03:17:15.185953 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 03:17:15.185953 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 03:17:15.185953 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 03:17:15.185953 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 03:17:15.185953 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 03:17:15.185953 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:17:15.188861 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 424/862] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Oct 4 03:17:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:17:15.195051 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ece014-8d8f-410f-9367-8e13edbc10d7 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:15.230489 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:15.246977 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e2004-9a3b-4c82-a848-5bd756522f5a None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:15.287459 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cc0c91-6a26-4114-aaa2-6361f3814000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:15.288471 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc0c91-6a26-4114-aaa2-6361f3814000 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:15.288988 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc0c91-6a26-4114-aaa2-6361f3814000 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:15.289472 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc0c91-6a26-4114-aaa2-6361f3814000 None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:15.290290 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cc0c91-6a26-4114-aaa2-6361f3814000 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:15.291241 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cc0c91-6a26-4114-aaa2-6361f3814000 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:15.293175 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cc0c91-6a26-4114-aaa2-6361f3814000 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:15.299202 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 439/863] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Oct 4 03:17:15 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:15.329624 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ece014-8d8f-410f-9367-8e13edbc10d7 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:15.370180 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556beccc-926b-4e28-853a-59e32478cdeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:15.371248 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556beccc-926b-4e28-853a-59e32478cdeb None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:15.371767 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556beccc-926b-4e28-853a-59e32478cdeb None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:15.372241 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556beccc-926b-4e28-853a-59e32478cdeb None admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:15.373249 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556beccc-926b-4e28-853a-59e32478cdeb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:15.373756 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556beccc-926b-4e28-853a-59e32478cdeb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:15.375480 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556beccc-926b-4e28-853a-59e32478cdeb None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:15.401621 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 425/864] 10.222.0.25 () {56 vars in 1149 bytes} [Tue Oct 4 03:17:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:15.403928 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cc0c91-6a26-4114-aaa2-6361f3814000 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:15.520007 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cc0c91-6a26-4114-aaa2-6361f3814000 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:15.556058 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649aabb0-5d5a-48cd-8616-b8016137a14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:15.556658 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649aabb0-5d5a-48cd-8616-b8016137a14b None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:15.556934 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649aabb0-5d5a-48cd-8616-b8016137a14b None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:15.557200 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649aabb0-5d5a-48cd-8616-b8016137a14b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:15.581804 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:15.634602 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649aabb0-5d5a-48cd-8616-b8016137a14b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:15.636183 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649aabb0-5d5a-48cd-8616-b8016137a14b None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:15.710944 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ff51ff-da86-478e-8e4d-7e979c68ff89 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:15.711385 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ff51ff-da86-478e-8e4d-7e979c68ff89 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:15.711773 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ff51ff-da86-478e-8e4d-7e979c68ff89 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:15.713302 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 426/865] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:17:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 03:17:15.723151 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894c39d-05ba-46aa-a2a9-c32652efc3d6 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:15.723151 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894c39d-05ba-46aa-a2a9-c32652efc3d6 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:15.723151 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894c39d-05ba-46aa-a2a9-c32652efc3d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:15.739420 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-d894c39d-05ba-46aa-a2a9-c32652efc3d6 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:17:15.741580 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-d894c39d-05ba-46aa-a2a9-c32652efc3d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:17:15.750873 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 440/866] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 03:17:15 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 03:17:15.756824 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649aabb0-5d5a-48cd-8616-b8016137a14b None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:15.803022 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:15.825350 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:15.835511 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 427/867] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:17:15 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 03:17:15.883818 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649aabb0-5d5a-48cd-8616-b8016137a14b None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:15.917758 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a041f3a-cd07-4a9f-9457-8e130353950e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:15.918375 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a041f3a-cd07-4a9f-9457-8e130353950e None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:15.918649 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a041f3a-cd07-4a9f-9457-8e130353950e None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:15.918916 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a041f3a-cd07-4a9f-9457-8e130353950e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:15.929640 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a041f3a-cd07-4a9f-9457-8e130353950e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:15.931058 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a041f3a-cd07-4a9f-9457-8e130353950e None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:15.946009 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-7a041f3a-cd07-4a9f-9457-8e130353950e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:17:15.946009 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:15.946009 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:15.946009 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:15.946009 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:15.946009 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:15.946009 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:15.946009 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:15.946009 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:15.946009 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:15.946009 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:15.946009 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:15.946009 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 03:17:15.946009 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 03:17:15.946009 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 03:17:15.946009 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 03:17:15.946964 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:15.946964 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:15.946964 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:15.946964 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:15.946964 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:15.946964 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:15.946964 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:15.946964 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:15.946964 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:15.946964 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:15.946964 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:15.946964 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:15.946964 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:15.946964 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:15.946964 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:15.946964 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:15.946964 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 03:17:15.947910 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 03:17:15.947910 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:17:15.947910 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:17:15.947910 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 441/868] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:17:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:17:15.953140 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d894c39d-05ba-46aa-a2a9-c32652efc3d6 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:16.059831 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d894c39d-05ba-46aa-a2a9-c32652efc3d6 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:16.095805 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baa78da-3f6c-44b9-902b-3836b6da7c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:16.096654 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa78da-3f6c-44b9-902b-3836b6da7c87 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:16.097112 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa78da-3f6c-44b9-902b-3836b6da7c87 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:16.097536 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa78da-3f6c-44b9-902b-3836b6da7c87 None admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:16.098320 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baa78da-3f6c-44b9-902b-3836b6da7c87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:16.098784 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baa78da-3f6c-44b9-902b-3836b6da7c87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:16.100846 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baa78da-3f6c-44b9-902b-3836b6da7c87 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:16.113120 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 428/869] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 03:17:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:17:16.118885 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a041f3a-cd07-4a9f-9457-8e130353950e None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:16.119054 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baa78da-3f6c-44b9-902b-3836b6da7c87 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:16.166495 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:16.224779 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baa78da-3f6c-44b9-902b-3836b6da7c87 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:16.227071 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a041f3a-cd07-4a9f-9457-8e130353950e None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:16.229610 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:16.262990 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248eee57-b7de-4245-858a-7528bbf832a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:16.263871 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248eee57-b7de-4245-858a-7528bbf832a9 None admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:16.264252 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248eee57-b7de-4245-858a-7528bbf832a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:16.264427 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c99c5d7-ace4-4daf-917b-1feda057c044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:16.264728 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248eee57-b7de-4245-858a-7528bbf832a9 None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:16.265381 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99c5d7-ace4-4daf-917b-1feda057c044 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:16.265551 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248eee57-b7de-4245-858a-7528bbf832a9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:16.265942 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99c5d7-ace4-4daf-917b-1feda057c044 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:16.266364 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99c5d7-ace4-4daf-917b-1feda057c044 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:16.267340 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248eee57-b7de-4245-858a-7528bbf832a9 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:16.274201 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c99c5d7-ace4-4daf-917b-1feda057c044 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:16.275991 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c99c5d7-ace4-4daf-917b-1feda057c044 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:16.286262 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 442/870] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Oct 4 03:17:16 2022] POST /identity/v3/services => generated 251 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:17:16.293671 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-1c99c5d7-ace4-4daf-917b-1feda057c044 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 03:17:16.293671 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:16.293671 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:16.293671 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:16.293671 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:16.293671 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:16.293671 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:16.293671 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:16.293671 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:16.293671 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:16.293671 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:16.293671 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:16.293671 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 03:17:16.293671 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 03:17:16.293671 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 03:17:16.294663 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 03:17:16.294663 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:16.294663 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:16.294663 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:16.294663 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:16.294663 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:16.294663 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:16.294663 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:16.294663 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:16.294663 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:16.294663 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:16.294663 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:16.294663 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:16.294663 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:16.294663 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:16.294663 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:16.294663 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:16.295618 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 03:17:16.295618 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 03:17:16.295618 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 03:17:16.295618 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 03:17:16.295618 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 03:17:16.295618 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 03:17:16.295618 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 03:17:16.295618 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:17:16.303033 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 429/871] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 03:17:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:17:16.304937 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248eee57-b7de-4245-858a-7528bbf832a9 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:16.425668 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248eee57-b7de-4245-858a-7528bbf832a9 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:16.468702 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebb7f95-cf32-408b-8357-469381e0aa39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:16.469327 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb7f95-cf32-408b-8357-469381e0aa39 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:16.469610 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb7f95-cf32-408b-8357-469381e0aa39 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:16.469884 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb7f95-cf32-408b-8357-469381e0aa39 None admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:16.470585 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebb7f95-cf32-408b-8357-469381e0aa39 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:16.470893 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebb7f95-cf32-408b-8357-469381e0aa39 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:16.472371 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebb7f95-cf32-408b-8357-469381e0aa39 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:16.486503 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 443/872] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 4 03:17:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:17:16.492557 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c99c5d7-ace4-4daf-917b-1feda057c044 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:16.608741 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c99c5d7-ace4-4daf-917b-1feda057c044 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:16.611103 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:16.645212 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376c778e-d432-40b4-b198-83c8bb27562b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:16.646354 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c778e-d432-40b4-b198-83c8bb27562b None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:16.646824 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c778e-d432-40b4-b198-83c8bb27562b None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:16.647178 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c778e-d432-40b4-b198-83c8bb27562b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:16.647959 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376c778e-d432-40b4-b198-83c8bb27562b None admin] RBAC: Adding query filter params (role.id=1f60934edaf04074936ff079756fc4a6, scope.project.id=80ae15e46620470b9c55fb7fe300fcb6, user.id=bef61ef12079495ba72b7fcd2717aca2) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:16.648271 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376c778e-d432-40b4-b198-83c8bb27562b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:16.649696 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376c778e-d432-40b4-b198-83c8bb27562b None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:16.656347 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 430/873] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 03:17:16 2022] GET /identity/v3/role_assignments?user.id=bef61ef12079495ba72b7fcd2717aca2&scope.project.id=80ae15e46620470b9c55fb7fe300fcb6&role.id=1f60934edaf04074936ff079756fc4a6 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:16.683961 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ddef0e-520c-47ec-8a3e-0572417b8535 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:16.684453 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ddef0e-520c-47ec-8a3e-0572417b8535 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:16.684453 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ddef0e-520c-47ec-8a3e-0572417b8535 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:16.686097 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 444/874] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:17:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:17:16.691983 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1d15c3-a52d-42c6-9472-e3fdf366fc8d None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:16.692283 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1d15c3-a52d-42c6-9472-e3fdf366fc8d None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:16.692576 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1d15c3-a52d-42c6-9472-e3fdf366fc8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:16.712784 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-ee1d15c3-a52d-42c6-9472-e3fdf366fc8d None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:17:16.714004 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-ee1d15c3-a52d-42c6-9472-e3fdf366fc8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:17:16.792146 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 431/875] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:17:16 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 03:17:17.068706 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ddef0e-520c-47ec-8a3e-0572417b8535 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:17.091481 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:17.181551 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ddef0e-520c-47ec-8a3e-0572417b8535 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:17.217753 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca511285-164c-4b22-840a-fa1c3e224f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:17.218384 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca511285-164c-4b22-840a-fa1c3e224f30 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:17.218667 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca511285-164c-4b22-840a-fa1c3e224f30 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:17.218948 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca511285-164c-4b22-840a-fa1c3e224f30 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:17.219553 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca511285-164c-4b22-840a-fa1c3e224f30 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:17.220917 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca511285-164c-4b22-840a-fa1c3e224f30 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:17.229998 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-ca511285-164c-4b22-840a-fa1c3e224f30 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 03:17:17.229998 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:17.229998 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 03:17:17.229998 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 03:17:17.229998 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 03:17:17.229998 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 03:17:17.229998 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 03:17:17.229998 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 03:17:17.229998 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 03:17:17.229998 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:17:17.229998 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 03:17:17.229998 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:17:17.229998 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:17.229998 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:17.229998 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:17.229998 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:17.229998 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:17.231091 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:17.231091 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:17.231091 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:17.231091 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:17.231091 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:17.231091 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:17.231091 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 03:17:17.231091 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 03:17:17.231091 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 03:17:17.231091 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 03:17:17.231091 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:17.231091 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:17.231091 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:17.231091 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:17.231091 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:17.231091 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:17.232659 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:17.232659 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:17.232659 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:17.232659 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:17.232659 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:17.232659 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:17.232659 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:17.232659 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:17.232659 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:17.232659 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:17.232659 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 03:17:17.232659 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 03:17:17.232659 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 03:17:17.232659 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:17:17.232659 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 445/876] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Oct 4 03:17:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:17:17.237237 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1d15c3-a52d-42c6-9472-e3fdf366fc8d None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:17.352213 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:17.356053 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1d15c3-a52d-42c6-9472-e3fdf366fc8d None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:17.391222 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceddcc8-cb4b-452f-a6e0-f354a003bfce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:17.391935 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceddcc8-cb4b-452f-a6e0-f354a003bfce None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:17.392219 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceddcc8-cb4b-452f-a6e0-f354a003bfce None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:17.392496 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceddcc8-cb4b-452f-a6e0-f354a003bfce None admin] PATH_INFO: `/v3/services` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:17.393176 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceddcc8-cb4b-452f-a6e0-f354a003bfce None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:17.393486 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceddcc8-cb4b-452f-a6e0-f354a003bfce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:17.394855 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceddcc8-cb4b-452f-a6e0-f354a003bfce None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:17.400326 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 432/877] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Oct 4 03:17:17 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:17.408586 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca511285-164c-4b22-840a-fa1c3e224f30 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:17.503550 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:17.520813 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca511285-164c-4b22-840a-fa1c3e224f30 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:17.557200 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cc6cea-b205-4c0f-b584-693c97e45a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:17.557806 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc6cea-b205-4c0f-b584-693c97e45a5b None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:17.558086 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc6cea-b205-4c0f-b584-693c97e45a5b None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:17.558361 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc6cea-b205-4c0f-b584-693c97e45a5b None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:17.558983 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cc6cea-b205-4c0f-b584-693c97e45a5b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:17.559285 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cc6cea-b205-4c0f-b584-693c97e45a5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:17.560672 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cc6cea-b205-4c0f-b584-693c97e45a5b None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:17.565582 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 446/878] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Oct 4 03:17:17 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:17.718646 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378597f1-91ef-4f1a-9976-7f3f10981b0a None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:17.719210 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378597f1-91ef-4f1a-9976-7f3f10981b0a None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:17.719210 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378597f1-91ef-4f1a-9976-7f3f10981b0a None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:17.720863 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 433/879] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:17:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:17:17.726998 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab77ef9-c689-45e9-9906-8e302192d123 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:17.727471 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab77ef9-c689-45e9-9906-8e302192d123 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:17.727603 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab77ef9-c689-45e9-9906-8e302192d123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:17.747208 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-6ab77ef9-c689-45e9-9906-8e302192d123 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:17:17.748508 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-6ab77ef9-c689-45e9-9906-8e302192d123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:17:17.825867 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 447/880] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:17:17 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 03:17:18.092930 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378597f1-91ef-4f1a-9976-7f3f10981b0a None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:18.198743 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378597f1-91ef-4f1a-9976-7f3f10981b0a None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:18.233666 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d16cc52-0c66-429b-b85f-cd8f848d2795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:18.234276 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d16cc52-0c66-429b-b85f-cd8f848d2795 None admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:18.234562 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d16cc52-0c66-429b-b85f-cd8f848d2795 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:18.234840 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d16cc52-0c66-429b-b85f-cd8f848d2795 None admin] PATH_INFO: `/v3/services` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:18.235522 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d16cc52-0c66-429b-b85f-cd8f848d2795 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:18.236911 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d16cc52-0c66-429b-b85f-cd8f848d2795 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:18.258019 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 434/881] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Oct 4 03:17:18 2022] POST /identity/v3/services => generated 269 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:17:18.638555 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f71368c-c7fe-40d4-9a65-71cc621c21a3 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:18.638555 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f71368c-c7fe-40d4-9a65-71cc621c21a3 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:18.638555 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f71368c-c7fe-40d4-9a65-71cc621c21a3 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:18.638555 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 448/882] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:17:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:17:18.643453 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6ac21-ffe0-49b5-936c-1dee3fb963f5 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:18.644007 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6ac21-ffe0-49b5-936c-1dee3fb963f5 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:18.644483 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6ac21-ffe0-49b5-936c-1dee3fb963f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:18.663897 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-b9f6ac21-ffe0-49b5-936c-1dee3fb963f5 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:17:18.665407 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-b9f6ac21-ffe0-49b5-936c-1dee3fb963f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:17:18.683033 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:18.742419 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 435/883] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:17:18 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 03:17:19.024642 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f71368c-c7fe-40d4-9a65-71cc621c21a3 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:19.035865 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b9d362-2a88-4f86-81cf-41d68db2b073 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:19.036670 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b9d362-2a88-4f86-81cf-41d68db2b073 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:19.037246 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b9d362-2a88-4f86-81cf-41d68db2b073 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:19.039195 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 436/884] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:17:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 03:17:19.044733 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bcee5e-8a37-4e6b-a757-23234b955439 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:19.045255 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bcee5e-8a37-4e6b-a757-23234b955439 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:19.045743 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bcee5e-8a37-4e6b-a757-23234b955439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:19.065960 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-05bcee5e-8a37-4e6b-a757-23234b955439 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:17:19.068267 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-05bcee5e-8a37-4e6b-a757-23234b955439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:17:19.116132 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:19.144178 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f71368c-c7fe-40d4-9a65-71cc621c21a3 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:19.147567 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 437/885] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:17:19 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 03:17:19.185868 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23581925-46a8-48c4-8146-0773ca5ed778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:19.186764 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23581925-46a8-48c4-8146-0773ca5ed778 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:19.187219 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23581925-46a8-48c4-8146-0773ca5ed778 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:19.187745 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23581925-46a8-48c4-8146-0773ca5ed778 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:19.188469 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23581925-46a8-48c4-8146-0773ca5ed778 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:19.189978 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23581925-46a8-48c4-8146-0773ca5ed778 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:19.200124 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-23581925-46a8-48c4-8146-0773ca5ed778 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 03:17:19.200124 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:19.200124 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 03:17:19.200124 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 03:17:19.200124 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 03:17:19.200124 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 03:17:19.200124 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 03:17:19.200124 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 03:17:19.200124 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 03:17:19.200124 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:17:19.200124 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 03:17:19.200124 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:17:19.200124 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:19.200124 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:19.200124 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:19.200124 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:19.200124 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:19.201385 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:19.201385 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:19.201385 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:19.201385 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:19.201385 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:19.201385 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:19.201385 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 03:17:19.201385 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 03:17:19.201385 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 03:17:19.201385 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 03:17:19.201385 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:19.201385 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:19.201385 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:19.201385 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:19.201385 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:19.201385 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:19.202414 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:19.202414 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:19.202414 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:19.202414 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:19.202414 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:19.202414 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:19.202414 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:19.202414 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:19.202414 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:19.202414 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:19.202414 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 03:17:19.202414 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 03:17:19.202414 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 03:17:19.202414 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:17:19.204748 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 449/886] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Oct 4 03:17:19 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:17:19.212904 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bcee5e-8a37-4e6b-a757-23234b955439 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:19.296477 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:19.320443 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bcee5e-8a37-4e6b-a757-23234b955439 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:19.355748 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650b6f83-4618-498c-8147-168b9b7bae26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:19.356358 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b6f83-4618-498c-8147-168b9b7bae26 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:19.356641 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b6f83-4618-498c-8147-168b9b7bae26 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:19.356915 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b6f83-4618-498c-8147-168b9b7bae26 None admin] PATH_INFO: `/v3/services` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:19.357542 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650b6f83-4618-498c-8147-168b9b7bae26 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:19.357846 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650b6f83-4618-498c-8147-168b9b7bae26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:19.359210 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650b6f83-4618-498c-8147-168b9b7bae26 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:19.364395 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 438/887] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Oct 4 03:17:19 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:17:19.370196 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23581925-46a8-48c4-8146-0773ca5ed778 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:19.464506 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650b6f83-4618-498c-8147-168b9b7bae26 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:19.484032 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23581925-46a8-48c4-8146-0773ca5ed778 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:19.524600 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb2390-73e4-4686-800f-4b695e3c3b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:19.525214 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb2390-73e4-4686-800f-4b695e3c3b06 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:19.525494 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb2390-73e4-4686-800f-4b695e3c3b06 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:19.525760 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb2390-73e4-4686-800f-4b695e3c3b06 None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:19.526573 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeb2390-73e4-4686-800f-4b695e3c3b06 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:19.527024 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeb2390-73e4-4686-800f-4b695e3c3b06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:19.528554 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeb2390-73e4-4686-800f-4b695e3c3b06 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:19.534787 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 450/888] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Oct 4 03:17:19 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:19.540235 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb2390-73e4-4686-800f-4b695e3c3b06 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:19.550317 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:19.586495 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650b6f83-4618-498c-8147-168b9b7bae26 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:19.633440 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6f1da6-b878-4204-99e6-6cc78c9974d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:19.633803 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f1da6-b878-4204-99e6-6cc78c9974d3 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:19.635800 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f1da6-b878-4204-99e6-6cc78c9974d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:19.635987 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f1da6-b878-4204-99e6-6cc78c9974d3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:19.653829 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6f1da6-b878-4204-99e6-6cc78c9974d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:17:19.661809 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-ed6f1da6-b878-4204-99e6-6cc78c9974d3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 03:17:19.661809 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:19.661809 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:19.661809 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:19.661809 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:19.661809 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:19.661809 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:19.661809 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:19.661809 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:19.661809 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:19.661809 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:19.661809 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:19.661809 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:17:19.661809 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:17:19.661809 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:17:19.661809 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:17:19.662913 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:17:19.662913 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:17:19.662913 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:17:19.662913 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:17:19.662913 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:19.662913 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:19.662913 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:19.662913 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:19.662913 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:19.662913 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:19.662913 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:19.662913 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:19.662913 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:19.662913 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:19.662913 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:19.662913 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:19.663804 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:19.663804 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:19.663804 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:19.663804 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:19.663804 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:17:19.663804 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:17:19.663804 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:17:19.663804 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:17:19.663804 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:17:19.663804 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:17:19.663804 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 03:17:19.663804 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:17:19.669819 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 439/889] 10.222.0.25 () {56 vars in 1120 bytes} [Tue Oct 4 03:17:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 03:17:19.671791 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb2390-73e4-4686-800f-4b695e3c3b06 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:19.672694 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6f1da6-b878-4204-99e6-6cc78c9974d3 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:19.677444 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:19.717504 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca3fff-2987-46a8-912c-198b7b7079ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:19.718268 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca3fff-2987-46a8-912c-198b7b7079ae None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:19.718556 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca3fff-2987-46a8-912c-198b7b7079ae None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:19.718890 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca3fff-2987-46a8-912c-198b7b7079ae None admin] PATH_INFO: `/v3/endpoints` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:19.719637 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cca3fff-2987-46a8-912c-198b7b7079ae None admin] RBAC: Adding query filter params (interface=public, service_id=9cde845737b74415b8a2d5810b2d5fd3, region_id=RegionOne) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:19.720233 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cca3fff-2987-46a8-912c-198b7b7079ae None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:19.721834 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cca3fff-2987-46a8-912c-198b7b7079ae None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:19.733769 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 451/890] 10.222.0.25 () {56 vars in 1251 bytes} [Tue Oct 4 03:17:19 2022] GET /identity/v3/endpoints?service_id=9cde845737b74415b8a2d5810b2d5fd3&interface=public®ion_id=RegionOne => generated 194 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:19.736213 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca3fff-2987-46a8-912c-198b7b7079ae None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:19.811501 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6f1da6-b878-4204-99e6-6cc78c9974d3 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:19.815575 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:19.850038 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca3fff-2987-46a8-912c-198b7b7079ae None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:19.850928 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43bb4a0-0034-4f61-b8bb-a6d83aa8cebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:19.851553 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43bb4a0-0034-4f61-b8bb-a6d83aa8cebe None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:19.851835 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43bb4a0-0034-4f61-b8bb-a6d83aa8cebe None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:19.852103 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43bb4a0-0034-4f61-b8bb-a6d83aa8cebe None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:19.852999 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43bb4a0-0034-4f61-b8bb-a6d83aa8cebe None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:19.853110 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43bb4a0-0034-4f61-b8bb-a6d83aa8cebe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:19.854391 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43bb4a0-0034-4f61-b8bb-a6d83aa8cebe None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:19.862488 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 440/891] 10.222.0.25 () {56 vars in 1115 bytes} [Tue Oct 4 03:17:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:19.863659 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d3e220-c4db-4740-8fcd-ce6c24860b07 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:19.864126 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d3e220-c4db-4740-8fcd-ce6c24860b07 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:19.864628 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d3e220-c4db-4740-8fcd-ce6c24860b07 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:19.866071 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 441/892] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:17:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:17:19.870636 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d3e220-c4db-4740-8fcd-ce6c24860b07 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:19.889558 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70057990-8767-4f63-a4df-36dff4bac3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:19.890161 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70057990-8767-4f63-a4df-36dff4bac3d7 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:19.890441 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70057990-8767-4f63-a4df-36dff4bac3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:19.890712 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70057990-8767-4f63-a4df-36dff4bac3d7 None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:19.891311 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70057990-8767-4f63-a4df-36dff4bac3d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:19.892713 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70057990-8767-4f63-a4df-36dff4bac3d7 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:19.898681 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 452/893] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Oct 4 03:17:19 2022] GET /identity/v3/services => generated 1268 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:17:19.899844 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b5ec8-e89c-44f7-9e70-ddae7c88bfc7 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:19.900290 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b5ec8-e89c-44f7-9e70-ddae7c88bfc7 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:19.900729 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b5ec8-e89c-44f7-9e70-ddae7c88bfc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:19.925785 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-fa2b5ec8-e89c-44f7-9e70-ddae7c88bfc7 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:17:19.928775 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-fa2b5ec8-e89c-44f7-9e70-ddae7c88bfc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:17:19.948177 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:20.003984 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d3e220-c4db-4740-8fcd-ce6c24860b07 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:20.024998 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 453/894] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:17:19 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 03:17:20.053879 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60770685-4ad0-4f8c-b87a-2900a0adaba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:20.054882 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60770685-4ad0-4f8c-b87a-2900a0adaba6 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:20.055323 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60770685-4ad0-4f8c-b87a-2900a0adaba6 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:20.055859 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60770685-4ad0-4f8c-b87a-2900a0adaba6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:20.068257 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60770685-4ad0-4f8c-b87a-2900a0adaba6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:20.070282 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60770685-4ad0-4f8c-b87a-2900a0adaba6 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:20.087972 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-60770685-4ad0-4f8c-b87a-2900a0adaba6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:17:20.087972 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:20.087972 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:20.087972 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:20.087972 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:20.087972 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:20.087972 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:20.087972 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:20.087972 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:20.087972 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:20.087972 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:20.087972 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:20.087972 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 03:17:20.087972 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 03:17:20.087972 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 03:17:20.087972 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 03:17:20.089217 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:20.089217 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:20.089217 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:20.089217 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:20.089217 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:20.089217 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:20.089217 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:20.089217 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:20.089217 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:20.089217 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:20.089217 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:20.089217 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:20.089217 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:20.089217 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:20.089217 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:20.089217 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:20.089217 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 03:17:20.090341 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 03:17:20.090341 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:17:20.090341 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:17:20.091794 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 442/895] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:17:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:17:20.101693 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2b5ec8-e89c-44f7-9e70-ddae7c88bfc7 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:20.166453 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:20.205953 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2b5ec8-e89c-44f7-9e70-ddae7c88bfc7 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:20.242388 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa3849c-279d-4731-b44e-96e1bf6a5b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:20.242995 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa3849c-279d-4731-b44e-96e1bf6a5b79 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:20.243275 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa3849c-279d-4731-b44e-96e1bf6a5b79 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:20.243583 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa3849c-279d-4731-b44e-96e1bf6a5b79 None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:20.244225 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa3849c-279d-4731-b44e-96e1bf6a5b79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:20.244528 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa3849c-279d-4731-b44e-96e1bf6a5b79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:20.245878 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa3849c-279d-4731-b44e-96e1bf6a5b79 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:20.258688 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 454/896] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 03:17:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:20.264438 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60770685-4ad0-4f8c-b87a-2900a0adaba6 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:20.315046 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa3849c-279d-4731-b44e-96e1bf6a5b79 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:20.382531 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60770685-4ad0-4f8c-b87a-2900a0adaba6 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:20.408078 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:20.435451 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd0055-2cf3-453d-8fc2-6df3553c0798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:20.436899 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd0055-2cf3-453d-8fc2-6df3553c0798 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:20.437191 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd0055-2cf3-453d-8fc2-6df3553c0798 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:20.437468 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd0055-2cf3-453d-8fc2-6df3553c0798 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:20.439254 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa3849c-279d-4731-b44e-96e1bf6a5b79 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:20.449235 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dd0055-2cf3-453d-8fc2-6df3553c0798 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:20.451326 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dd0055-2cf3-453d-8fc2-6df3553c0798 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:20.469161 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:20.469955 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-84dd0055-2cf3-453d-8fc2-6df3553c0798 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 03:17:20.469955 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:20.469955 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:20.469955 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:20.469955 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:20.469955 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:20.469955 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:20.469955 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:20.469955 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:20.469955 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:20.469955 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:20.469955 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:20.469955 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 03:17:20.469955 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 03:17:20.469955 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 03:17:20.469955 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 03:17:20.471051 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:20.471051 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:20.471051 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 03:17:20.471051 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 03:17:20.471051 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 03:17:20.471051 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 03:17:20.471051 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:20.471051 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:20.471051 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:20.471051 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:20.471051 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:20.471051 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:20.471051 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:20.471051 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:20.471051 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:20.471051 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:20.471051 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:20.471051 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:20.472049 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:20.472049 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:20.472049 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 03:17:20.472049 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 03:17:20.472049 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 03:17:20.472049 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 03:17:20.472049 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 03:17:20.472049 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 03:17:20.472049 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 03:17:20.472049 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:17:20.475657 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 443/897] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Oct 4 03:17:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:17:20.477391 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd0055-2cf3-453d-8fc2-6df3553c0798 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:20.487637 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7e7da6-2a82-4398-9f96-1640d299ddcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:20.488246 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e7da6-2a82-4398-9f96-1640d299ddcc None admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:20.488524 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e7da6-2a82-4398-9f96-1640d299ddcc None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:20.488795 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e7da6-2a82-4398-9f96-1640d299ddcc None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:20.490178 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7e7da6-2a82-4398-9f96-1640d299ddcc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:20.491711 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7e7da6-2a82-4398-9f96-1640d299ddcc None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:20.510791 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 455/898] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Oct 4 03:17:20 2022] POST /identity/v3/services => generated 241 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 03:17:20.564768 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb04c0f-a92b-4ef2-b97c-e0ff16152ad0 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:20.565217 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb04c0f-a92b-4ef2-b97c-e0ff16152ad0 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:20.565587 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb04c0f-a92b-4ef2-b97c-e0ff16152ad0 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:20.567336 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 456/899] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:17:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 03:17:20.575031 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3828b40-f8a4-413e-bddf-461d44254fc7 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:20.575747 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3828b40-f8a4-413e-bddf-461d44254fc7 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:20.576233 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3828b40-f8a4-413e-bddf-461d44254fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:20.603910 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-a3828b40-f8a4-413e-bddf-461d44254fc7 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:17:20.605586 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-a3828b40-f8a4-413e-bddf-461d44254fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:17:20.620862 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd0055-2cf3-453d-8fc2-6df3553c0798 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:20.685263 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3e14f9-1025-45ea-bb3d-72e6f97f082c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:20.686477 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e14f9-1025-45ea-bb3d-72e6f97f082c None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:20.687420 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e14f9-1025-45ea-bb3d-72e6f97f082c None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:20.687955 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e14f9-1025-45ea-bb3d-72e6f97f082c None admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:20.688897 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3e14f9-1025-45ea-bb3d-72e6f97f082c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:20.689389 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3e14f9-1025-45ea-bb3d-72e6f97f082c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:20.691826 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3e14f9-1025-45ea-bb3d-72e6f97f082c None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:20.709789 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 457/900] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:17:20 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 03:17:20.714896 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 444/901] 10.222.0.25 () {56 vars in 1149 bytes} [Tue Oct 4 03:17:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:20.720671 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3828b40-f8a4-413e-bddf-461d44254fc7 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:20.824775 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3828b40-f8a4-413e-bddf-461d44254fc7 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:20.840916 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:20.865791 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287b7887-db20-4787-bd2b-cdfb595e73db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:20.866776 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b7887-db20-4787-bd2b-cdfb595e73db None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:20.867292 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b7887-db20-4787-bd2b-cdfb595e73db None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:20.867792 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b7887-db20-4787-bd2b-cdfb595e73db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:20.939183 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287b7887-db20-4787-bd2b-cdfb595e73db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:20.940957 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287b7887-db20-4787-bd2b-cdfb595e73db None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:20.978673 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3e14f9-1025-45ea-bb3d-72e6f97f082c None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:21.016857 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:21.057972 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 458/902] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 03:17:20 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 03:17:21.063849 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287b7887-db20-4787-bd2b-cdfb595e73db None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:21.081475 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:21.105280 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3e14f9-1025-45ea-bb3d-72e6f97f082c None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:21.145393 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0ea0dc-c1e1-408f-a2cf-f6afa4ed8338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:21.146586 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ea0dc-c1e1-408f-a2cf-f6afa4ed8338 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:21.146867 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ea0dc-c1e1-408f-a2cf-f6afa4ed8338 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:21.147193 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ea0dc-c1e1-408f-a2cf-f6afa4ed8338 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:21.148095 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0ea0dc-c1e1-408f-a2cf-f6afa4ed8338 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:21.149168 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0ea0dc-c1e1-408f-a2cf-f6afa4ed8338 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:21.158312 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-bb0ea0dc-c1e1-408f-a2cf-f6afa4ed8338 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 03:17:21.158312 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:21.158312 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 03:17:21.158312 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 03:17:21.158312 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 03:17:21.158312 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 03:17:21.158312 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 03:17:21.158312 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 03:17:21.158312 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 03:17:21.158312 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:17:21.158312 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 03:17:21.158312 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:17:21.158312 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:21.158312 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:21.158312 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:21.158312 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:21.159291 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:21.159291 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:21.159291 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:21.159291 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:21.159291 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:21.159291 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:21.159291 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:21.159291 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 03:17:21.159291 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 03:17:21.159291 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 03:17:21.159291 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 03:17:21.159291 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:21.159291 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:21.159291 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:21.159291 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:21.159291 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:21.159291 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:21.165856 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:21.165856 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:21.165856 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:21.165856 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:21.165856 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:21.165856 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:21.165856 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:21.165856 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:21.165856 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:21.165856 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:21.165856 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 03:17:21.165856 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 03:17:21.165856 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 03:17:21.165856 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:17:21.165856 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 445/903] 10.222.0.25 () {56 vars in 1132 bytes} [Tue Oct 4 03:17:20 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:17:21.168598 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0ea0dc-c1e1-408f-a2cf-f6afa4ed8338 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:21.192839 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287b7887-db20-4787-bd2b-cdfb595e73db None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:21.233920 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986af712-0db2-44bd-894b-2cb22c2a784a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:21.234674 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986af712-0db2-44bd-894b-2cb22c2a784a None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:21.234962 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986af712-0db2-44bd-894b-2cb22c2a784a None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:21.235256 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986af712-0db2-44bd-894b-2cb22c2a784a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:21.247718 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986af712-0db2-44bd-894b-2cb22c2a784a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:21.249421 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986af712-0db2-44bd-894b-2cb22c2a784a None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:21.267597 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-986af712-0db2-44bd-894b-2cb22c2a784a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:17:21.267597 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:21.267597 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:21.267597 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:21.267597 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:21.267597 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:21.267597 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:21.267597 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:21.267597 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:21.267597 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:21.267597 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:21.267597 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:21.267597 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 03:17:21.267597 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 03:17:21.267597 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 03:17:21.267597 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 03:17:21.268594 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:21.268594 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:21.268594 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:21.268594 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:21.268594 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:21.268594 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:21.268594 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:21.268594 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:21.268594 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:21.268594 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:21.268594 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:21.268594 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:21.268594 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:21.268594 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:21.268594 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:21.268594 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:21.268594 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 03:17:21.269471 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 03:17:21.269471 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:17:21.269471 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:17:21.271629 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 459/904] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:17:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:17:21.276602 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986af712-0db2-44bd-894b-2cb22c2a784a None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:21.292267 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:21.301610 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0ea0dc-c1e1-408f-a2cf-f6afa4ed8338 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:21.346989 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3756e99a-7dcc-45fb-bc90-61237ed248fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:21.348170 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3756e99a-7dcc-45fb-bc90-61237ed248fd None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:21.349501 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3756e99a-7dcc-45fb-bc90-61237ed248fd None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:21.350130 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3756e99a-7dcc-45fb-bc90-61237ed248fd None admin] PATH_INFO: `/v3/services` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:21.351009 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3756e99a-7dcc-45fb-bc90-61237ed248fd None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:21.351612 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3756e99a-7dcc-45fb-bc90-61237ed248fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:21.353667 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3756e99a-7dcc-45fb-bc90-61237ed248fd None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:21.356838 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:21.364922 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 446/905] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Oct 4 03:17:21 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:21.366544 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3756e99a-7dcc-45fb-bc90-61237ed248fd None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:21.402466 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986af712-0db2-44bd-894b-2cb22c2a784a None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:21.443904 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1b819c-1ab0-4d1b-a909-6c350af984d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:21.444445 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b819c-1ab0-4d1b-a909-6c350af984d8 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:21.445177 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b819c-1ab0-4d1b-a909-6c350af984d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:21.445595 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b819c-1ab0-4d1b-a909-6c350af984d8 None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:21.446302 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1b819c-1ab0-4d1b-a909-6c350af984d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:21.446615 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1b819c-1ab0-4d1b-a909-6c350af984d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:21.448014 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1b819c-1ab0-4d1b-a909-6c350af984d8 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:21.463647 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 460/906] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 03:17:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:17:21.468829 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1b819c-1ab0-4d1b-a909-6c350af984d8 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:21.494573 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3756e99a-7dcc-45fb-bc90-61237ed248fd None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:21.542470 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ab3e15-8744-46b4-94ee-4fc8e25a269c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:21.543455 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ab3e15-8744-46b4-94ee-4fc8e25a269c None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:21.543963 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ab3e15-8744-46b4-94ee-4fc8e25a269c None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:21.544444 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ab3e15-8744-46b4-94ee-4fc8e25a269c None admin] PATH_INFO: `/v3/services` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:21.545689 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ab3e15-8744-46b4-94ee-4fc8e25a269c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:21.546458 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ab3e15-8744-46b4-94ee-4fc8e25a269c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:21.548174 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ab3e15-8744-46b4-94ee-4fc8e25a269c None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:21.556231 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 447/907] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Oct 4 03:17:21 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:17:21.561552 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ab3e15-8744-46b4-94ee-4fc8e25a269c None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:21.592037 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:21.606867 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1b819c-1ab0-4d1b-a909-6c350af984d8 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:21.639386 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:21.649689 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1547b8f1-0838-4e9f-a399-57ce0a69387b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:21.650400 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547b8f1-0838-4e9f-a399-57ce0a69387b None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:21.650600 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547b8f1-0838-4e9f-a399-57ce0a69387b None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:21.651290 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547b8f1-0838-4e9f-a399-57ce0a69387b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:21.660709 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1547b8f1-0838-4e9f-a399-57ce0a69387b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:21.661814 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1547b8f1-0838-4e9f-a399-57ce0a69387b None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:21.673652 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-1547b8f1-0838-4e9f-a399-57ce0a69387b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 03:17:21.673652 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:21.673652 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:21.673652 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:21.673652 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:21.673652 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:21.673652 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:21.673652 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:21.673652 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:21.673652 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:21.673652 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:21.673652 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:21.673652 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 03:17:21.673652 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 03:17:21.673652 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 03:17:21.674602 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 03:17:21.674602 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:21.674602 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:21.674602 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:21.674602 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:21.674602 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:21.674602 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:21.674602 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:21.674602 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:21.674602 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:21.674602 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:21.674602 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:21.674602 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:21.674602 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:21.674602 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:21.674602 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:21.674602 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:21.675515 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 03:17:21.675515 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 03:17:21.675515 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 03:17:21.675515 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 03:17:21.675515 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 03:17:21.675515 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 03:17:21.675515 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 03:17:21.675515 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:17:21.675515 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 461/908] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 03:17:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:17:21.683010 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1547b8f1-0838-4e9f-a399-57ce0a69387b None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:21.702409 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ab3e15-8744-46b4-94ee-4fc8e25a269c None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:21.745271 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade2af7-e6eb-4385-9bce-b7775507093c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:21.745872 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade2af7-e6eb-4385-9bce-b7775507093c None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:21.746173 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade2af7-e6eb-4385-9bce-b7775507093c None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:21.746570 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade2af7-e6eb-4385-9bce-b7775507093c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:21.747266 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dade2af7-e6eb-4385-9bce-b7775507093c None admin] RBAC: Adding query filter params (interface=public, service_id=d7693dd4e2d04090ab50103b4fe73096, region_id=RegionOne) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:21.747602 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dade2af7-e6eb-4385-9bce-b7775507093c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:21.749292 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dade2af7-e6eb-4385-9bce-b7775507093c None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:21.759650 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 448/909] 10.222.0.25 () {56 vars in 1251 bytes} [Tue Oct 4 03:17:21 2022] GET /identity/v3/endpoints?service_id=d7693dd4e2d04090ab50103b4fe73096&interface=public®ion_id=RegionOne => generated 194 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:17:21.764961 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade2af7-e6eb-4385-9bce-b7775507093c None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:21.810904 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1547b8f1-0838-4e9f-a399-57ce0a69387b None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:21.857379 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48fc61b-9d1b-44b8-ae41-81f46236045a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:21.858791 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48fc61b-9d1b-44b8-ae41-81f46236045a None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:21.859234 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48fc61b-9d1b-44b8-ae41-81f46236045a None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:21.859773 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48fc61b-9d1b-44b8-ae41-81f46236045a None admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:21.861149 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48fc61b-9d1b-44b8-ae41-81f46236045a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:21.862048 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48fc61b-9d1b-44b8-ae41-81f46236045a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:21.864050 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48fc61b-9d1b-44b8-ae41-81f46236045a None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:21.869831 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:21.890239 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade2af7-e6eb-4385-9bce-b7775507093c None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:21.890927 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 462/910] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 4 03:17:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:21.891966 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48fc61b-9d1b-44b8-ae41-81f46236045a None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:21.928021 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16e870c-80f4-47cd-ab05-7babfe0f3531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:21.928811 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e870c-80f4-47cd-ab05-7babfe0f3531 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:21.929191 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e870c-80f4-47cd-ab05-7babfe0f3531 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:21.929563 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e870c-80f4-47cd-ab05-7babfe0f3531 None admin] PATH_INFO: `/v3/services` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:21.930277 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16e870c-80f4-47cd-ab05-7babfe0f3531 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:21.931775 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16e870c-80f4-47cd-ab05-7babfe0f3531 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:21.938792 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 449/911] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Oct 4 03:17:21 2022] GET /identity/v3/services => generated 1497 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 03:17:21.955265 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:22.022479 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48fc61b-9d1b-44b8-ae41-81f46236045a None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:22.064133 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06dca26-6f56-498b-b3cd-a1c805a69f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:22.065485 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06dca26-6f56-498b-b3cd-a1c805a69f68 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:22.065917 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06dca26-6f56-498b-b3cd-a1c805a69f68 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:22.066338 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06dca26-6f56-498b-b3cd-a1c805a69f68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:22.067233 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06dca26-6f56-498b-b3cd-a1c805a69f68 None admin] RBAC: Adding query filter params (role.id=8d45a720a6c14675a3504853645b8e22, scope.project.id=80ae15e46620470b9c55fb7fe300fcb6, user.id=bef61ef12079495ba72b7fcd2717aca2) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:22.068276 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06dca26-6f56-498b-b3cd-a1c805a69f68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:22.070245 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06dca26-6f56-498b-b3cd-a1c805a69f68 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:22.076995 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 463/912] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 03:17:21 2022] GET /identity/v3/role_assignments?user.id=bef61ef12079495ba72b7fcd2717aca2&scope.project.id=80ae15e46620470b9c55fb7fe300fcb6&role.id=8d45a720a6c14675a3504853645b8e22 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:22.136969 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27009cd-9e2d-4d29-82cb-42cb36064058 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:22.137523 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27009cd-9e2d-4d29-82cb-42cb36064058 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:22.137523 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27009cd-9e2d-4d29-82cb-42cb36064058 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:22.139069 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 450/913] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:17:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:17:22.145172 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b22c632-ae22-45a6-8f1c-f727ca6881c9 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:22.145686 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b22c632-ae22-45a6-8f1c-f727ca6881c9 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:22.145887 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b22c632-ae22-45a6-8f1c-f727ca6881c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:22.166314 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-7b22c632-ae22-45a6-8f1c-f727ca6881c9 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:17:22.167649 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-7b22c632-ae22-45a6-8f1c-f727ca6881c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:17:22.247971 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 464/914] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:17:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 03:17:22.516217 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27009cd-9e2d-4d29-82cb-42cb36064058 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:22.624242 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27009cd-9e2d-4d29-82cb-42cb36064058 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:22.672133 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551a38e4-5fe7-4bea-8b42-ff968ad7f3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:22.672817 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a38e4-5fe7-4bea-8b42-ff968ad7f3a1 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:22.673102 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a38e4-5fe7-4bea-8b42-ff968ad7f3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:22.673377 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a38e4-5fe7-4bea-8b42-ff968ad7f3a1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:22.674001 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551a38e4-5fe7-4bea-8b42-ff968ad7f3a1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:22.675367 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551a38e4-5fe7-4bea-8b42-ff968ad7f3a1 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:22.685712 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-551a38e4-5fe7-4bea-8b42-ff968ad7f3a1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 03:17:22.685712 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:22.685712 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 03:17:22.685712 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 03:17:22.685712 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 03:17:22.685712 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 03:17:22.685712 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 03:17:22.685712 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 03:17:22.685712 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 03:17:22.685712 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:17:22.685712 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 03:17:22.685712 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:17:22.685712 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:22.685712 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:22.685712 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:22.685712 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:22.685712 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:22.686708 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:22.686708 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:22.686708 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:22.686708 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:22.686708 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:22.686708 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:22.686708 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 03:17:22.686708 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 03:17:22.686708 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 03:17:22.686708 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 03:17:22.686708 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:22.686708 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:22.686708 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:22.686708 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:22.686708 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:22.686708 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:22.687557 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:22.687557 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:22.687557 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:22.687557 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:22.687557 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:22.687557 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:22.687557 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:22.687557 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:22.687557 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:22.687557 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:22.687557 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 03:17:22.687557 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 03:17:22.687557 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 03:17:22.687557 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:17:22.687557 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 451/915] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Oct 4 03:17:22 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:17:22.695258 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b22c632-ae22-45a6-8f1c-f727ca6881c9 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:22.747129 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:22.808975 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b22c632-ae22-45a6-8f1c-f727ca6881c9 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:22.836282 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52c59b3-3445-4201-af47-df10272f0846 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:22.836611 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52c59b3-3445-4201-af47-df10272f0846 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:22.836838 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52c59b3-3445-4201-af47-df10272f0846 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:22.839033 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 452/916] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:17:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 03:17:22.848095 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8d2bde-06e5-43e4-9148-db8809a2a6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:22.849240 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d2bde-06e5-43e4-9148-db8809a2a6dc None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:22.849591 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d2bde-06e5-43e4-9148-db8809a2a6dc None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:22.849928 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d2bde-06e5-43e4-9148-db8809a2a6dc None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:22.850556 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8d2bde-06e5-43e4-9148-db8809a2a6dc None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:22.850860 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8d2bde-06e5-43e4-9148-db8809a2a6dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:22.852597 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8d2bde-06e5-43e4-9148-db8809a2a6dc None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:22.854770 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aeb556-8f0a-498d-8733-0e892eac1687 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:22.855415 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aeb556-8f0a-498d-8733-0e892eac1687 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:22.856015 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aeb556-8f0a-498d-8733-0e892eac1687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:22.857453 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 465/917] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Oct 4 03:17:22 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:22.862624 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8d2bde-06e5-43e4-9148-db8809a2a6dc None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:22.878554 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-c5aeb556-8f0a-498d-8733-0e892eac1687 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:17:22.879466 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-c5aeb556-8f0a-498d-8733-0e892eac1687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:17:22.894061 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:22.963583 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 453/918] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:17:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 03:17:23.001932 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8d2bde-06e5-43e4-9148-db8809a2a6dc None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:23.004321 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:23.037840 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee163b1-b2ac-469e-a4d5-3b6aa00336c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:23.038438 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee163b1-b2ac-469e-a4d5-3b6aa00336c9 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:23.038719 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee163b1-b2ac-469e-a4d5-3b6aa00336c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:23.038989 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee163b1-b2ac-469e-a4d5-3b6aa00336c9 None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:23.039637 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee163b1-b2ac-469e-a4d5-3b6aa00336c9 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:23.039941 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee163b1-b2ac-469e-a4d5-3b6aa00336c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:23.041279 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee163b1-b2ac-469e-a4d5-3b6aa00336c9 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:23.046480 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 466/919] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Oct 4 03:17:22 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:17:23.052281 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aeb556-8f0a-498d-8733-0e892eac1687 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:23.163361 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aeb556-8f0a-498d-8733-0e892eac1687 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:23.198698 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672ba1bc-4e2d-430a-85ca-5a10195cc2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:23.199303 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672ba1bc-4e2d-430a-85ca-5a10195cc2b6 None admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:23.199647 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672ba1bc-4e2d-430a-85ca-5a10195cc2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:23.199926 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672ba1bc-4e2d-430a-85ca-5a10195cc2b6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:23.200592 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672ba1bc-4e2d-430a-85ca-5a10195cc2b6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:23.201941 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672ba1bc-4e2d-430a-85ca-5a10195cc2b6 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:23.221531 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:23.230382 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 454/920] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:17:23 2022] POST /identity/v3/endpoints => generated 346 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:17:23.280383 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee163b1-b2ac-469e-a4d5-3b6aa00336c9 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:23.390330 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee163b1-b2ac-469e-a4d5-3b6aa00336c9 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:23.434888 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72194f8e-e96a-4413-8790-922b092e39a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:23.435435 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72194f8e-e96a-4413-8790-922b092e39a5 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:23.435749 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72194f8e-e96a-4413-8790-922b092e39a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:23.436013 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72194f8e-e96a-4413-8790-922b092e39a5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:23.436578 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72194f8e-e96a-4413-8790-922b092e39a5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:23.437942 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72194f8e-e96a-4413-8790-922b092e39a5 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:23.447461 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-72194f8e-e96a-4413-8790-922b092e39a5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 03:17:23.447461 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:23.447461 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 03:17:23.447461 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 03:17:23.447461 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 03:17:23.447461 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 03:17:23.447461 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 03:17:23.447461 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 03:17:23.447461 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 03:17:23.447461 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:17:23.447461 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 03:17:23.447461 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:17:23.447461 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:23.447461 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:23.447461 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:23.447461 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:23.447461 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:23.448574 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:23.448574 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:23.448574 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:23.448574 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:23.448574 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:23.448574 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:23.448574 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 03:17:23.448574 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 03:17:23.448574 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 03:17:23.448574 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 03:17:23.448574 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:23.448574 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:23.448574 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:23.448574 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:23.448574 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:23.448574 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:23.449397 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:23.449397 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:23.449397 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:23.449397 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:23.449397 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:23.449397 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:23.449397 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:23.449397 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:23.449397 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:23.449397 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:23.449397 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 03:17:23.449397 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 03:17:23.449397 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 03:17:23.449397 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:17:23.449397 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 467/921] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Oct 4 03:17:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:17:23.456761 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672ba1bc-4e2d-430a-85ca-5a10195cc2b6 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:23.564619 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672ba1bc-4e2d-430a-85ca-5a10195cc2b6 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:23.600698 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d104458-76dc-42a5-8f9c-c17250b319ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:23.601310 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d104458-76dc-42a5-8f9c-c17250b319ab None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:23.601605 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d104458-76dc-42a5-8f9c-c17250b319ab None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:23.601869 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d104458-76dc-42a5-8f9c-c17250b319ab None admin] PATH_INFO: `/v3/services` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:23.602504 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d104458-76dc-42a5-8f9c-c17250b319ab None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:23.602809 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d104458-76dc-42a5-8f9c-c17250b319ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:23.604288 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d104458-76dc-42a5-8f9c-c17250b319ab None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:23.609503 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 455/922] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Oct 4 03:17:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:23.615337 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72194f8e-e96a-4413-8790-922b092e39a5 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:23.659893 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:23.732819 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72194f8e-e96a-4413-8790-922b092e39a5 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:23.768373 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbacf9e1-f39f-4375-a63b-9bbac6a96250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:23.768983 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbacf9e1-f39f-4375-a63b-9bbac6a96250 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:23.769269 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbacf9e1-f39f-4375-a63b-9bbac6a96250 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:23.769546 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbacf9e1-f39f-4375-a63b-9bbac6a96250 None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:23.770173 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbacf9e1-f39f-4375-a63b-9bbac6a96250 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:23.770550 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbacf9e1-f39f-4375-a63b-9bbac6a96250 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:23.772140 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbacf9e1-f39f-4375-a63b-9bbac6a96250 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:23.777656 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 468/923] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Oct 4 03:17:23 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:23.783447 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d104458-76dc-42a5-8f9c-c17250b319ab None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:23.852357 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:23.893811 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d104458-76dc-42a5-8f9c-c17250b319ab None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:23.931529 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac180a8-6b38-4ac6-b7cb-ac0f8f4e1909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:23.932552 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac180a8-6b38-4ac6-b7cb-ac0f8f4e1909 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:23.933038 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac180a8-6b38-4ac6-b7cb-ac0f8f4e1909 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:23.933509 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac180a8-6b38-4ac6-b7cb-ac0f8f4e1909 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:23.934495 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac180a8-6b38-4ac6-b7cb-ac0f8f4e1909 None admin] RBAC: Adding query filter params (interface=public, service_id=a53fd6b1a5f74eb1981a39e42d63320b, region_id=RegionOne) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:23.935018 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac180a8-6b38-4ac6-b7cb-ac0f8f4e1909 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:23.936602 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac180a8-6b38-4ac6-b7cb-ac0f8f4e1909 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:23.942693 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 456/924] 10.222.0.25 () {56 vars in 1251 bytes} [Tue Oct 4 03:17:23 2022] GET /identity/v3/endpoints?service_id=a53fd6b1a5f74eb1981a39e42d63320b&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:23.948740 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbacf9e1-f39f-4375-a63b-9bbac6a96250 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:24.048756 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:24.058608 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbacf9e1-f39f-4375-a63b-9bbac6a96250 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:24.095704 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d3607-6560-46c3-af7b-834d29babab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:24.096336 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d3607-6560-46c3-af7b-834d29babab1 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:24.096613 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d3607-6560-46c3-af7b-834d29babab1 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:24.096882 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d3607-6560-46c3-af7b-834d29babab1 None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:24.097509 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085d3607-6560-46c3-af7b-834d29babab1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:24.099152 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085d3607-6560-46c3-af7b-834d29babab1 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:24.106535 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 469/925] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Oct 4 03:17:23 2022] GET /identity/v3/services => generated 1497 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:17:24.212223 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c54e060-54d8-4bb0-a902-9a280e3b6575 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:24.212751 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c54e060-54d8-4bb0-a902-9a280e3b6575 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:24.212751 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c54e060-54d8-4bb0-a902-9a280e3b6575 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:24.214402 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 457/926] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:17:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:17:24.220176 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b181dc-a90a-48d1-97d7-212a85586b44 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:24.220463 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b181dc-a90a-48d1-97d7-212a85586b44 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:24.220741 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b181dc-a90a-48d1-97d7-212a85586b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:24.241147 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-d8b181dc-a90a-48d1-97d7-212a85586b44 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:17:24.242424 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-d8b181dc-a90a-48d1-97d7-212a85586b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:17:24.304012 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15c5ad-0dcd-4a02-84b3-20e7c62cfb8d None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:24.304297 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15c5ad-0dcd-4a02-84b3-20e7c62cfb8d None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:24.304540 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15c5ad-0dcd-4a02-84b3-20e7c62cfb8d None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:24.305999 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 458/927] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:17:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:17:24.311584 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678c17b-c782-4f9a-938a-388390e5104e None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:24.311801 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678c17b-c782-4f9a-938a-388390e5104e None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:24.312081 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678c17b-c782-4f9a-938a-388390e5104e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:24.316342 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 470/928] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:17:24 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 03:17:24.336723 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-6678c17b-c782-4f9a-938a-388390e5104e None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:17:24.337923 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-6678c17b-c782-4f9a-938a-388390e5104e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:17:24.409288 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 459/929] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:17:24 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 03:17:24.591592 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b181dc-a90a-48d1-97d7-212a85586b44 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:24.679252 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:24.695411 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b181dc-a90a-48d1-97d7-212a85586b44 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:24.703633 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6678c17b-c782-4f9a-938a-388390e5104e None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:24.735920 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19e1f74-ae03-43f8-8228-43ea57130a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:24.736565 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e1f74-ae03-43f8-8228-43ea57130a22 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:24.736840 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e1f74-ae03-43f8-8228-43ea57130a22 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:24.737195 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e1f74-ae03-43f8-8228-43ea57130a22 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:24.737782 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19e1f74-ae03-43f8-8228-43ea57130a22 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:24.739141 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19e1f74-ae03-43f8-8228-43ea57130a22 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:24.749060 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-a19e1f74-ae03-43f8-8228-43ea57130a22 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 03:17:24.749060 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:24.749060 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 03:17:24.749060 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 03:17:24.749060 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 03:17:24.749060 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 03:17:24.749060 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 03:17:24.749060 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 03:17:24.749060 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 03:17:24.749060 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:17:24.749060 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 03:17:24.749060 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:17:24.749060 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:24.749060 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:24.749060 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:24.749060 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:24.750054 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:24.750054 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:24.750054 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:24.750054 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:24.750054 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:24.750054 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:24.750054 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:24.750054 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 03:17:24.750054 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 03:17:24.750054 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 03:17:24.750054 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 03:17:24.750054 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:24.750054 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:24.750054 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:24.750054 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:24.750054 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:24.750054 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:24.751236 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:24.751236 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:24.751236 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:24.751236 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:24.751236 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:24.751236 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:24.751236 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:24.751236 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:24.751236 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:24.751236 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:24.751236 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 03:17:24.751236 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 03:17:24.751236 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 03:17:24.751236 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:17:24.751236 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 471/930] 10.222.0.25 () {56 vars in 1132 bytes} [Tue Oct 4 03:17:24 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:17:24.755846 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19e1f74-ae03-43f8-8228-43ea57130a22 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:24.780988 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:24.837530 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6678c17b-c782-4f9a-938a-388390e5104e None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:24.865851 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19e1f74-ae03-43f8-8228-43ea57130a22 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:24.885819 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b56c55b-110e-4515-b337-4edb3b6565c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:24.886652 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b56c55b-110e-4515-b337-4edb3b6565c4 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:24.886971 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b56c55b-110e-4515-b337-4edb3b6565c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:24.887369 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b56c55b-110e-4515-b337-4edb3b6565c4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:24.900667 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b56c55b-110e-4515-b337-4edb3b6565c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:17:24.905785 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-7b56c55b-110e-4515-b337-4edb3b6565c4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 03:17:24.905785 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:24.905785 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:24.905785 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:24.905785 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:24.905785 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:24.905785 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:24.905785 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:24.905785 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:24.905785 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:24.905785 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:24.905785 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:24.905785 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:17:24.905785 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:17:24.905785 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:17:24.905785 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:17:24.906929 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:17:24.906929 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:17:24.906929 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:17:24.906929 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:17:24.906929 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:24.906929 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:24.906929 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:24.906929 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:24.906929 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:24.906929 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:24.906929 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:24.906929 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:24.906929 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:24.906929 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:24.906929 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:24.906929 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:24.907987 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:24.907987 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:24.907987 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:24.907987 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:24.907987 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:17:24.907987 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:17:24.907987 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:17:24.907987 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:17:24.907987 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:17:24.907987 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:17:24.907987 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 03:17:24.907987 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:17:24.909084 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bef1a24-d65d-418a-8377-e16bc0facd30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:24.909850 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef1a24-d65d-418a-8377-e16bc0facd30 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:24.910254 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef1a24-d65d-418a-8377-e16bc0facd30 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:24.910716 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef1a24-d65d-418a-8377-e16bc0facd30 None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:24.911610 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bef1a24-d65d-418a-8377-e16bc0facd30 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:24.912067 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bef1a24-d65d-418a-8377-e16bc0facd30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:24.913548 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bef1a24-d65d-418a-8377-e16bc0facd30 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:24.914947 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 460/931] 10.222.0.25 () {56 vars in 1120 bytes} [Tue Oct 4 03:17:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 03:17:24.916116 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b56c55b-110e-4515-b337-4edb3b6565c4 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:24.919633 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 472/932] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Oct 4 03:17:24 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:24.931598 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bef1a24-d65d-418a-8377-e16bc0facd30 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:24.950897 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:25.042838 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b56c55b-110e-4515-b337-4edb3b6565c4 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:25.062135 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:25.066147 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bef1a24-d65d-418a-8377-e16bc0facd30 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:25.082992 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6774f38-bbb2-435b-a8a0-563c5d117404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:25.084007 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6774f38-bbb2-435b-a8a0-563c5d117404 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:25.084444 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6774f38-bbb2-435b-a8a0-563c5d117404 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:25.084865 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6774f38-bbb2-435b-a8a0-563c5d117404 None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:25.085788 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6774f38-bbb2-435b-a8a0-563c5d117404 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:25.086409 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6774f38-bbb2-435b-a8a0-563c5d117404 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:25.088105 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6774f38-bbb2-435b-a8a0-563c5d117404 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:25.097656 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 461/933] 10.222.0.25 () {56 vars in 1115 bytes} [Tue Oct 4 03:17:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:25.103385 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6774f38-bbb2-435b-a8a0-563c5d117404 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:25.116088 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff567b6-8553-4f45-923f-5d4468362898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:25.116636 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff567b6-8553-4f45-923f-5d4468362898 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:25.116918 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff567b6-8553-4f45-923f-5d4468362898 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:25.117194 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff567b6-8553-4f45-923f-5d4468362898 None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:25.117892 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff567b6-8553-4f45-923f-5d4468362898 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:25.118203 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff567b6-8553-4f45-923f-5d4468362898 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:25.119693 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff567b6-8553-4f45-923f-5d4468362898 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:25.131114 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 473/934] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Oct 4 03:17:24 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:25.135024 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff567b6-8553-4f45-923f-5d4468362898 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:25.225359 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:25.227274 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6774f38-bbb2-435b-a8a0-563c5d117404 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:25.252322 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff567b6-8553-4f45-923f-5d4468362898 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:25.269009 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b2ea3c-e7db-4c3e-992e-9db462ab7753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:25.270203 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2ea3c-e7db-4c3e-992e-9db462ab7753 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:25.270861 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2ea3c-e7db-4c3e-992e-9db462ab7753 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:25.271545 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2ea3c-e7db-4c3e-992e-9db462ab7753 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:25.287091 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b2ea3c-e7db-4c3e-992e-9db462ab7753 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:25.289651 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b2ea3c-e7db-4c3e-992e-9db462ab7753 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:25.294662 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b4da37-20b5-46ae-813c-f01c82fdb9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:25.295317 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b4da37-20b5-46ae-813c-f01c82fdb9e1 None admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:25.295850 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b4da37-20b5-46ae-813c-f01c82fdb9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:25.296353 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b4da37-20b5-46ae-813c-f01c82fdb9e1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:25.297592 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b4da37-20b5-46ae-813c-f01c82fdb9e1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:25.299187 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b4da37-20b5-46ae-813c-f01c82fdb9e1 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:25.313964 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-a1b2ea3c-e7db-4c3e-992e-9db462ab7753 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:17:25.313964 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:25.313964 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:25.313964 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:25.313964 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:25.313964 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:25.313964 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:25.313964 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:25.313964 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:25.313964 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:25.313964 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:25.313964 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:25.313964 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 03:17:25.313964 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 03:17:25.313964 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 03:17:25.313964 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 03:17:25.314995 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:25.314995 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:25.314995 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:25.314995 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:25.314995 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:25.314995 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:25.314995 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:25.314995 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:25.314995 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:25.314995 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:25.314995 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:25.314995 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:25.314995 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:25.314995 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:25.314995 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:25.314995 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:25.314995 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 03:17:25.315900 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 03:17:25.315900 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:17:25.315900 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:17:25.318417 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 462/935] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:17:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 03:17:25.324179 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b2ea3c-e7db-4c3e-992e-9db462ab7753 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:25.331525 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 474/936] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:17:25 2022] POST /identity/v3/endpoints => generated 347 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:17:25.373888 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:25.447595 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b2ea3c-e7db-4c3e-992e-9db462ab7753 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:25.494146 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d972464-2670-4bf0-a5bb-ecc69aa2b5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:25.494758 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d972464-2670-4bf0-a5bb-ecc69aa2b5b1 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:25.495041 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d972464-2670-4bf0-a5bb-ecc69aa2b5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:25.495318 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d972464-2670-4bf0-a5bb-ecc69aa2b5b1 None admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:25.496130 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d972464-2670-4bf0-a5bb-ecc69aa2b5b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:25.496435 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d972464-2670-4bf0-a5bb-ecc69aa2b5b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:25.497861 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d972464-2670-4bf0-a5bb-ecc69aa2b5b1 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:25.511299 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 463/937] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 03:17:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:17:25.517044 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b4da37-20b5-46ae-813c-f01c82fdb9e1 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:25.641989 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b4da37-20b5-46ae-813c-f01c82fdb9e1 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:25.670711 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6bd03-36a9-406c-91f4-a71b0c9fc82a None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:25.671359 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6bd03-36a9-406c-91f4-a71b0c9fc82a None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:25.671875 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6bd03-36a9-406c-91f4-a71b0c9fc82a None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:25.677907 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 464/938] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:17:25 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:17:25.679588 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d05154-2fd0-4d68-8c46-a8c0a9982107 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:25.680156 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d05154-2fd0-4d68-8c46-a8c0a9982107 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:25.680649 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d05154-2fd0-4d68-8c46-a8c0a9982107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:25.681031 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06865ab-fa2c-48ae-9cc3-061c4d7c1a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:25.681663 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06865ab-fa2c-48ae-9cc3-061c4d7c1a00 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:25.681946 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06865ab-fa2c-48ae-9cc3-061c4d7c1a00 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:25.682216 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06865ab-fa2c-48ae-9cc3-061c4d7c1a00 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:25.684185 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:25.691648 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06865ab-fa2c-48ae-9cc3-061c4d7c1a00 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:25.693586 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06865ab-fa2c-48ae-9cc3-061c4d7c1a00 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:25.707005 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-e06865ab-fa2c-48ae-9cc3-061c4d7c1a00 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 03:17:25.707005 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:25.707005 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:25.707005 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:25.707005 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:25.707005 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:25.707005 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:25.707005 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:25.707005 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:25.707005 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:25.707005 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:25.707005 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:25.707005 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 03:17:25.707005 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 03:17:25.707005 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 03:17:25.707005 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 03:17:25.708819 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:25.708819 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:25.708819 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 03:17:25.708819 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 03:17:25.708819 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 03:17:25.708819 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 03:17:25.708819 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:25.708819 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:25.708819 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:25.708819 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:25.708819 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:25.708819 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:25.708819 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:25.708819 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:25.708819 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:25.708819 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:25.708819 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:25.708819 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:25.709992 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:25.709992 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:25.709992 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 03:17:25.709992 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 03:17:25.709992 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 03:17:25.709992 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 03:17:25.709992 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 03:17:25.709992 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 03:17:25.709992 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 03:17:25.709992 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:17:25.710582 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 475/939] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Oct 4 03:17:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:17:25.711216 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-07d05154-2fd0-4d68-8c46-a8c0a9982107 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:17:25.712573 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-07d05154-2fd0-4d68-8c46-a8c0a9982107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:17:25.715462 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06865ab-fa2c-48ae-9cc3-061c4d7c1a00 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:25.811805 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 465/940] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:17:25 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 03:17:25.824710 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06865ab-fa2c-48ae-9cc3-061c4d7c1a00 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:25.860100 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ab08a1-0879-442e-8563-96023480a6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:25.861037 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab08a1-0879-442e-8563-96023480a6d5 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:25.861517 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab08a1-0879-442e-8563-96023480a6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:25.862023 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab08a1-0879-442e-8563-96023480a6d5 None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:25.863010 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ab08a1-0879-442e-8563-96023480a6d5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:25.863564 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ab08a1-0879-442e-8563-96023480a6d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:25.865241 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ab08a1-0879-442e-8563-96023480a6d5 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:25.884402 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 476/941] 10.222.0.25 () {56 vars in 1149 bytes} [Tue Oct 4 03:17:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:17:25.892168 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d05154-2fd0-4d68-8c46-a8c0a9982107 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:25.910447 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:26.001555 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d05154-2fd0-4d68-8c46-a8c0a9982107 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:26.039114 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11b315b-0337-4ede-a3f6-23d9b5c68e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:26.039832 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b315b-0337-4ede-a3f6-23d9b5c68e7e None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:26.040120 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b315b-0337-4ede-a3f6-23d9b5c68e7e None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:26.040399 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b315b-0337-4ede-a3f6-23d9b5c68e7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:26.050954 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11b315b-0337-4ede-a3f6-23d9b5c68e7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:26.052485 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11b315b-0337-4ede-a3f6-23d9b5c68e7e None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:26.068270 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-f11b315b-0337-4ede-a3f6-23d9b5c68e7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:17:26.068270 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:26.068270 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:26.068270 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:26.068270 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:26.068270 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:26.068270 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:26.068270 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:26.068270 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:26.068270 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:26.068270 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:26.068270 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:26.068270 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 03:17:26.068270 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 03:17:26.068270 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 03:17:26.068270 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 03:17:26.069424 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:26.069424 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:26.069424 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:26.069424 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:26.069424 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:26.069424 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:26.069424 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:26.069424 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:26.069424 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:26.069424 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:26.069424 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:26.069424 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:26.069424 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:26.069424 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:26.069424 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:26.069424 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:26.069424 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 03:17:26.070594 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 03:17:26.070594 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:17:26.070594 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:17:26.070594 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 466/942] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:17:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:17:26.076922 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ab08a1-0879-442e-8563-96023480a6d5 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:26.117442 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11b315b-0337-4ede-a3f6-23d9b5c68e7e None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:26.138511 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:26.190577 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ab08a1-0879-442e-8563-96023480a6d5 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:26.196728 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:26.231350 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ef780a-4c9b-471a-a6a7-381279bbd9d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:26.232170 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef780a-4c9b-471a-a6a7-381279bbd9d8 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:26.232551 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef780a-4c9b-471a-a6a7-381279bbd9d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:26.232927 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef780a-4c9b-471a-a6a7-381279bbd9d8 None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:26.233671 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ef780a-4c9b-471a-a6a7-381279bbd9d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:26.234094 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ef780a-4c9b-471a-a6a7-381279bbd9d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:26.235706 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ef780a-4c9b-471a-a6a7-381279bbd9d8 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:26.237038 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11b315b-0337-4ede-a3f6-23d9b5c68e7e None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:26.255542 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 477/943] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 03:17:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:26.256772 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ef780a-4c9b-471a-a6a7-381279bbd9d8 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:26.283336 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e20c52-32e7-4f60-ba6e-ce025847de39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:26.284109 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e20c52-32e7-4f60-ba6e-ce025847de39 None admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:26.284386 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e20c52-32e7-4f60-ba6e-ce025847de39 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:26.284656 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e20c52-32e7-4f60-ba6e-ce025847de39 None admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:26.285325 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e20c52-32e7-4f60-ba6e-ce025847de39 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:26.286886 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e20c52-32e7-4f60-ba6e-ce025847de39 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:26.290761 dv-cinder-849143-9-smb devstack@keystone.service[81380]: WARNING keystone.server.flask.common [None req-68e20c52-32e7-4f60-ba6e-ce025847de39 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 04 03:17:26.311858 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.sql.core [None req-68e20c52-32e7-4f60-ba6e-ce025847de39 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 04 03:17:26.311858 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 04 03:17:26.311858 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [parameters: {'id': 'aac025c104a04585a7ba60c96a51da11', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 04 03:17:26.311858 dv-cinder-849143-9-smb devstack@keystone.service[81380]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81380) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 04 03:17:26.330787 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-68e20c52-32e7-4f60-ba6e-ce025847de39 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id aac025c104a04585a7ba60c96a51da11.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id aac025c104a04585a7ba60c96a51da11. Oct 04 03:17:26.330787 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:26.330787 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 03:17:26.330787 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 04 03:17:26.330787 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 03:17:26.330787 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 04 03:17:26.330787 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 03:17:26.330787 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application result = self._query(query) Oct 04 03:17:26.330787 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 03:17:26.330787 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application conn.query(q) Oct 04 03:17:26.330787 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 03:17:26.330787 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 03:17:26.330787 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 03:17:26.331963 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application result.read() Oct 04 03:17:26.331963 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 03:17:26.331963 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 04 03:17:26.331963 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 03:17:26.331963 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 04 03:17:26.331963 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 03:17:26.331963 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 04 03:17:26.331963 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 03:17:26.331963 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 04 03:17:26.331963 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 04 03:17:26.331963 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:17:26.331963 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 04 03:17:26.331963 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:17:26.331963 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:26.331963 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 04 03:17:26.331963 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 04 03:17:26.331963 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 04 03:17:26.331963 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 04 03:17:26.333929 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 04 03:17:26.333929 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application next(self.gen) Oct 04 03:17:26.333929 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 04 03:17:26.333929 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application yield resource Oct 04 03:17:26.333929 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 04 03:17:26.333929 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application next(self.gen) Oct 04 03:17:26.333929 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 04 03:17:26.333929 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application self.session.rollback() Oct 04 03:17:26.333929 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 03:17:26.333929 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application self.force_reraise() Oct 04 03:17:26.333929 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 03:17:26.333929 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise self.value Oct 04 03:17:26.333929 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 04 03:17:26.333929 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 04 03:17:26.333929 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 04 03:17:26.333929 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application session.commit() Oct 04 03:17:26.333929 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 04 03:17:26.334901 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 04 03:17:26.334901 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 04 03:17:26.334901 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application self._prepare_impl() Oct 04 03:17:26.334901 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 04 03:17:26.334901 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application self.session.flush() Oct 04 03:17:26.334901 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 04 03:17:26.334901 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application self._flush(objects) Oct 04 03:17:26.334901 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 04 03:17:26.334901 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 04 03:17:26.334901 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 04 03:17:26.334901 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application compat.raise_( Oct 04 03:17:26.334901 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 03:17:26.334901 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception Oct 04 03:17:26.334901 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 04 03:17:26.334901 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application flush_context.execute() Oct 04 03:17:26.334901 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 04 03:17:26.334901 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rec.execute(self) Oct 04 03:17:26.336219 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 04 03:17:26.336219 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 04 03:17:26.336219 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 04 03:17:26.336219 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 04 03:17:26.336219 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 04 03:17:26.336219 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 04 03:17:26.336219 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 04 03:17:26.336219 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 04 03:17:26.336219 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 04 03:17:26.336219 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 04 03:17:26.336219 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 04 03:17:26.336219 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 04 03:17:26.336219 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 04 03:17:26.336219 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 04 03:17:26.336219 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 04 03:17:26.337873 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 04 03:17:26.337873 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 03:17:26.337873 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception Oct 04 03:17:26.337873 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 03:17:26.337873 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 04 03:17:26.337873 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 03:17:26.337873 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 04 03:17:26.337873 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 03:17:26.337873 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application result = self._query(query) Oct 04 03:17:26.337873 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 03:17:26.337873 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application conn.query(q) Oct 04 03:17:26.337873 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 03:17:26.337873 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 03:17:26.337873 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 03:17:26.337873 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application result.read() Oct 04 03:17:26.337873 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 03:17:26.337873 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 04 03:17:26.340068 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 03:17:26.340068 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 04 03:17:26.340068 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 03:17:26.340068 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 04 03:17:26.340068 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 03:17:26.340068 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 04 03:17:26.340068 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 04 03:17:26.340068 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 04 03:17:26.340068 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [parameters: {'id': 'aac025c104a04585a7ba60c96a51da11', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 04 03:17:26.340068 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 04 03:17:26.340068 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:17:26.340068 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 03:17:26.340068 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:17:26.340068 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:26.340068 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 04 03:17:26.342046 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 04 03:17:26.342046 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 04 03:17:26.342046 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 04 03:17:26.342046 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 04 03:17:26.342046 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:17:26.342046 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 03:17:26.342046 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:17:26.342046 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:26.342046 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:26.342046 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:26.342046 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:26.342046 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:26.342046 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:26.342046 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:26.342046 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:26.342046 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:26.342046 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:26.344525 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:26.344525 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 04 03:17:26.344525 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 04 03:17:26.344525 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:26.344525 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:26.344525 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 04 03:17:26.344525 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 04 03:17:26.344525 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id aac025c104a04585a7ba60c96a51da11. Oct 04 03:17:26.344525 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:17:26.347573 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 467/944] 10.222.0.25 () {60 vars in 1140 bytes} [Tue Oct 4 03:17:26 2022] POST /identity/v3/projects => generated 262 bytes in 230 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 04 03:17:26.353459 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e20c52-32e7-4f60-ba6e-ce025847de39 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:26.385472 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ef780a-4c9b-471a-a6a7-381279bbd9d8 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:26.401771 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:26.425920 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de791587-cf24-4759-b157-5412e44048ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:26.427170 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de791587-cf24-4759-b157-5412e44048ff None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:26.427542 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de791587-cf24-4759-b157-5412e44048ff None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:26.427823 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de791587-cf24-4759-b157-5412e44048ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:26.434496 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de791587-cf24-4759-b157-5412e44048ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:26.435948 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de791587-cf24-4759-b157-5412e44048ff None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:26.450044 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-de791587-cf24-4759-b157-5412e44048ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 03:17:26.450044 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:26.450044 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:26.450044 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:26.450044 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:26.450044 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:26.450044 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:26.450044 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:26.450044 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:26.450044 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:26.450044 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:26.450044 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:26.450044 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 03:17:26.450044 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 03:17:26.450044 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 03:17:26.450936 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 03:17:26.450936 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:26.450936 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:26.450936 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:26.450936 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:26.450936 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:26.450936 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:26.450936 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:26.450936 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:26.450936 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:26.450936 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:26.450936 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:26.450936 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:26.450936 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:26.450936 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:26.450936 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:26.450936 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:26.452233 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 03:17:26.452233 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 03:17:26.452233 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 03:17:26.452233 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 03:17:26.452233 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 03:17:26.452233 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 03:17:26.452233 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 03:17:26.452233 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:17:26.452233 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 478/945] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 03:17:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:17:26.452756 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b2af1-a63d-45d6-9d47-41de48a64033 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:26.452756 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b2af1-a63d-45d6-9d47-41de48a64033 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:26.452879 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b2af1-a63d-45d6-9d47-41de48a64033 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:26.454148 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 479/946] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:17:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:17:26.458931 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b2af1-a63d-45d6-9d47-41de48a64033 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:26.474131 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e20c52-32e7-4f60-ba6e-ce025847de39 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:26.500284 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:26.510789 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dd07e9-e51a-4e22-a06f-2c58c8704f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:26.511404 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd07e9-e51a-4e22-a06f-2c58c8704f17 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:26.511713 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd07e9-e51a-4e22-a06f-2c58c8704f17 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:26.511983 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd07e9-e51a-4e22-a06f-2c58c8704f17 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:26.518516 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dd07e9-e51a-4e22-a06f-2c58c8704f17 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:26.520149 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dd07e9-e51a-4e22-a06f-2c58c8704f17 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:26.531798 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-c8dd07e9-e51a-4e22-a06f-2c58c8704f17 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 03:17:26.531798 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:26.531798 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:26.531798 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:26.531798 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:26.531798 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:26.531798 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:26.531798 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:26.531798 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:26.531798 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:26.531798 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:26.531798 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:26.531798 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 03:17:26.531798 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 03:17:26.531798 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 03:17:26.532693 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 03:17:26.532693 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:26.532693 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:26.532693 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:26.532693 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:26.532693 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:26.532693 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:26.532693 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:26.532693 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:26.532693 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:26.532693 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:26.532693 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:26.532693 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:26.532693 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:26.532693 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:26.532693 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:26.532693 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:26.533597 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 03:17:26.533597 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 03:17:26.533597 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 03:17:26.533597 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 03:17:26.533597 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 03:17:26.533597 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 03:17:26.533597 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 03:17:26.533597 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:17:26.535624 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 468/947] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 03:17:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:17:26.539049 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b3e7c0-e3a1-4c20-9e15-9552270b25e5 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:26.539338 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b3e7c0-e3a1-4c20-9e15-9552270b25e5 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:26.539641 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b3e7c0-e3a1-4c20-9e15-9552270b25e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:26.557742 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-07b3e7c0-e3a1-4c20-9e15-9552270b25e5 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:17:26.559248 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-07b3e7c0-e3a1-4c20-9e15-9552270b25e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:17:26.574386 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b2af1-a63d-45d6-9d47-41de48a64033 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:26.616231 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86d08f9-c6cd-400e-874a-2e93252dfa15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:26.617005 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d08f9-c6cd-400e-874a-2e93252dfa15 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:26.617285 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d08f9-c6cd-400e-874a-2e93252dfa15 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:26.617859 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d08f9-c6cd-400e-874a-2e93252dfa15 None admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:26.618547 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86d08f9-c6cd-400e-874a-2e93252dfa15 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:26.618854 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86d08f9-c6cd-400e-874a-2e93252dfa15 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:26.621233 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86d08f9-c6cd-400e-874a-2e93252dfa15 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:26.634080 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 480/948] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 4 03:17:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:26.634912 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86d08f9-c6cd-400e-874a-2e93252dfa15 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:26.643669 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 469/949] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:17:26 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 03:17:26.643669 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b3e7c0-e3a1-4c20-9e15-9552270b25e5 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:26.684587 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:26.766148 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b3e7c0-e3a1-4c20-9e15-9552270b25e5 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:26.772078 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86d08f9-c6cd-400e-874a-2e93252dfa15 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:26.783738 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:26.803270 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe746529-855a-4dc5-8d29-d28a545a5e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:26.803948 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe746529-855a-4dc5-8d29-d28a545a5e09 None admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:26.804229 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe746529-855a-4dc5-8d29-d28a545a5e09 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:26.804502 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe746529-855a-4dc5-8d29-d28a545a5e09 None admin] PATH_INFO: `/v3/projects/80ae15e46620470b9c55fb7fe300fcb6/users/bef61ef12079495ba72b7fcd2717aca2/roles/8d45a720a6c14675a3504853645b8e22` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:26.807086 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe746529-855a-4dc5-8d29-d28a545a5e09 None admin] RBAC: Authorizing `identity:create_grant(project_id=80ae15e46620470b9c55fb7fe300fcb6, user_id=bef61ef12079495ba72b7fcd2717aca2, role_id=8d45a720a6c14675a3504853645b8e22)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:26.808606 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe746529-855a-4dc5-8d29-d28a545a5e09 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:26.814860 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb7d435-d08d-4ffe-8760-1b9c857da99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:26.815523 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb7d435-d08d-4ffe-8760-1b9c857da99a None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:26.815807 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb7d435-d08d-4ffe-8760-1b9c857da99a None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:26.816113 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb7d435-d08d-4ffe-8760-1b9c857da99a None admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:26.816737 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb7d435-d08d-4ffe-8760-1b9c857da99a None admin] RBAC: Adding query filter params (name=service) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:26.817076 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb7d435-d08d-4ffe-8760-1b9c857da99a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:26.819714 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb7d435-d08d-4ffe-8760-1b9c857da99a None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:26.831240 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 470/950] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Oct 4 03:17:26 2022] PUT /identity/v3/projects/80ae15e46620470b9c55fb7fe300fcb6/users/bef61ef12079495ba72b7fcd2717aca2/roles/8d45a720a6c14675a3504853645b8e22 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:17:26.840483 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 481/951] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Oct 4 03:17:26 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:26.940565 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe746529-855a-4dc5-8d29-d28a545a5e09 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:27.073569 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe746529-855a-4dc5-8d29-d28a545a5e09 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:27.109822 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10609766-82eb-4b7a-b482-061849902ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:27.110451 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10609766-82eb-4b7a-b482-061849902ea2 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:27.110733 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10609766-82eb-4b7a-b482-061849902ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:27.111014 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10609766-82eb-4b7a-b482-061849902ea2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:27.111629 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10609766-82eb-4b7a-b482-061849902ea2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:27.112991 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10609766-82eb-4b7a-b482-061849902ea2 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:27.122857 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-10609766-82eb-4b7a-b482-061849902ea2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 03:17:27.122857 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:27.122857 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 03:17:27.122857 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 03:17:27.122857 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 03:17:27.122857 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 03:17:27.122857 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 03:17:27.122857 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 03:17:27.122857 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 03:17:27.122857 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:17:27.122857 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 03:17:27.122857 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:17:27.122857 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:27.122857 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:27.122857 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:27.122857 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:27.122857 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:27.124081 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:27.124081 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:27.124081 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:27.124081 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:27.124081 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:27.124081 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:27.124081 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 03:17:27.124081 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 03:17:27.124081 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 03:17:27.124081 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 03:17:27.124081 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:27.124081 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:27.124081 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:27.124081 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:27.124081 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:27.124081 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:27.125360 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:27.125360 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:27.125360 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:27.125360 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:27.125360 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:27.125360 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:27.125360 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:27.125360 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:27.125360 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:27.125360 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:27.125360 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 03:17:27.125360 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 03:17:27.125360 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 03:17:27.125360 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:17:27.125360 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 471/952] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Oct 4 03:17:26 2022] GET /identity/v3/services/object-store => generated 93 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:17:27.131990 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb7d435-d08d-4ffe-8760-1b9c857da99a None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:27.231859 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:27.243171 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb7d435-d08d-4ffe-8760-1b9c857da99a None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:27.284480 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abde8190-65f7-41b1-b1c9-8cc727ff3aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:27.285101 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde8190-65f7-41b1-b1c9-8cc727ff3aa8 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:27.285381 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde8190-65f7-41b1-b1c9-8cc727ff3aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:27.285657 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde8190-65f7-41b1-b1c9-8cc727ff3aa8 None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:27.286531 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abde8190-65f7-41b1-b1c9-8cc727ff3aa8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:27.287069 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abde8190-65f7-41b1-b1c9-8cc727ff3aa8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:27.289235 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abde8190-65f7-41b1-b1c9-8cc727ff3aa8 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:27.295088 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 482/953] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Oct 4 03:17:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:17:27.300764 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10609766-82eb-4b7a-b482-061849902ea2 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:27.348201 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:27.412683 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10609766-82eb-4b7a-b482-061849902ea2 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:27.448599 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97e4745-81bd-41c4-9866-f181a623fc11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:27.449200 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e4745-81bd-41c4-9866-f181a623fc11 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:27.449476 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e4745-81bd-41c4-9866-f181a623fc11 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:27.449742 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e4745-81bd-41c4-9866-f181a623fc11 None admin] PATH_INFO: `/v3/services` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:27.450356 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97e4745-81bd-41c4-9866-f181a623fc11 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:27.450653 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97e4745-81bd-41c4-9866-f181a623fc11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:27.452031 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97e4745-81bd-41c4-9866-f181a623fc11 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:27.460310 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 472/954] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Oct 4 03:17:27 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:27.465910 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abde8190-65f7-41b1-b1c9-8cc727ff3aa8 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:27.573550 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abde8190-65f7-41b1-b1c9-8cc727ff3aa8 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:27.615549 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29989a96-1234-4cd9-8c77-fb352e6ddde6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:27.616073 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29989a96-1234-4cd9-8c77-fb352e6ddde6 None admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:27.616354 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29989a96-1234-4cd9-8c77-fb352e6ddde6 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:27.616628 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29989a96-1234-4cd9-8c77-fb352e6ddde6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:27.617325 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29989a96-1234-4cd9-8c77-fb352e6ddde6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:27.618733 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29989a96-1234-4cd9-8c77-fb352e6ddde6 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:27.644508 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 483/955] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:17:27 2022] POST /identity/v3/endpoints => generated 349 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:17:27.731467 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a58851-0bea-422b-ab43-85be6dc6b06c None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:27.731843 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a58851-0bea-422b-ab43-85be6dc6b06c None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:27.732034 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a58851-0bea-422b-ab43-85be6dc6b06c None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:27.733758 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 473/956] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:17:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:17:27.740474 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2050a52a-3a6d-4967-8f90-23b7f3f1f1e9 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:27.740811 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2050a52a-3a6d-4967-8f90-23b7f3f1f1e9 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:27.741093 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2050a52a-3a6d-4967-8f90-23b7f3f1f1e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:27.761254 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-2050a52a-3a6d-4967-8f90-23b7f3f1f1e9 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:17:27.762484 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-2050a52a-3a6d-4967-8f90-23b7f3f1f1e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:17:27.773431 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:27.851830 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 484/957] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:17:27 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 03:17:28.117316 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a58851-0bea-422b-ab43-85be6dc6b06c None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:28.223320 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a58851-0bea-422b-ab43-85be6dc6b06c None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:28.226203 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:28.259732 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d1824-ad9f-468b-9d53-4894e2f2f90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:28.260361 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d1824-ad9f-468b-9d53-4894e2f2f90c None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:28.260639 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d1824-ad9f-468b-9d53-4894e2f2f90c None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:28.260910 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d1824-ad9f-468b-9d53-4894e2f2f90c None admin] PATH_INFO: `/v3/services/compute` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:28.261484 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2d1824-ad9f-468b-9d53-4894e2f2f90c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:28.262835 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2d1824-ad9f-468b-9d53-4894e2f2f90c None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:28.272034 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-5a2d1824-ad9f-468b-9d53-4894e2f2f90c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 03:17:28.272034 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:28.272034 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 03:17:28.272034 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 03:17:28.272034 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 03:17:28.272034 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 03:17:28.272034 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 03:17:28.272034 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 03:17:28.272034 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 03:17:28.272034 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:17:28.272034 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 03:17:28.272034 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:17:28.272034 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:28.272034 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:28.272034 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:28.272034 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:28.272034 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:28.273109 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:28.273109 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:28.273109 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:28.273109 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:28.273109 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:28.273109 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:28.273109 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 03:17:28.273109 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 03:17:28.273109 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 03:17:28.273109 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 03:17:28.273109 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:28.273109 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:28.273109 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:28.273109 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:28.273109 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:28.273109 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:28.274009 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:28.274009 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:28.274009 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:28.274009 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:28.274009 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:28.274009 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:28.274009 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:28.274009 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:28.274009 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:28.274009 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:28.274009 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 03:17:28.274009 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 03:17:28.274009 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 03:17:28.274009 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:17:28.278203 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 474/958] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 03:17:28 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:17:28.279512 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2050a52a-3a6d-4967-8f90-23b7f3f1f1e9 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:28.382833 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2050a52a-3a6d-4967-8f90-23b7f3f1f1e9 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:28.420047 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f1c882-ba02-4b48-8ecc-4b77542da53b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:28.420990 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f1c882-ba02-4b48-8ecc-4b77542da53b None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:28.421478 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f1c882-ba02-4b48-8ecc-4b77542da53b None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:28.421984 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f1c882-ba02-4b48-8ecc-4b77542da53b None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:28.422827 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f1c882-ba02-4b48-8ecc-4b77542da53b None admin] RBAC: Adding query filter params (name=compute) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:28.423335 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f1c882-ba02-4b48-8ecc-4b77542da53b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:28.424927 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f1c882-ba02-4b48-8ecc-4b77542da53b None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:28.430287 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 485/959] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Oct 4 03:17:28 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:28.435934 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d1824-ad9f-468b-9d53-4894e2f2f90c None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:28.540879 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d1824-ad9f-468b-9d53-4894e2f2f90c None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:28.576321 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06d8906-a0d7-4159-a8c7-624810c60e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:28.576919 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d8906-a0d7-4159-a8c7-624810c60e67 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:28.577195 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d8906-a0d7-4159-a8c7-624810c60e67 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:28.577466 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d8906-a0d7-4159-a8c7-624810c60e67 None admin] PATH_INFO: `/v3/services` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:28.578085 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06d8906-a0d7-4159-a8c7-624810c60e67 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:28.578384 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06d8906-a0d7-4159-a8c7-624810c60e67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:28.579832 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06d8906-a0d7-4159-a8c7-624810c60e67 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:28.588709 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 475/960] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Oct 4 03:17:28 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:29.096830 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e084c-c7be-410e-a694-8bd24f131078 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:29.097347 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e084c-c7be-410e-a694-8bd24f131078 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:29.097347 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e084c-c7be-410e-a694-8bd24f131078 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:29.099601 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 486/961] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:17:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:17:29.104833 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f399c-4f32-4675-967c-7016354f2d5a None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:29.105118 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f399c-4f32-4675-967c-7016354f2d5a None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:29.105392 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f399c-4f32-4675-967c-7016354f2d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:29.123540 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-7f0f399c-4f32-4675-967c-7016354f2d5a None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:17:29.124713 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-7f0f399c-4f32-4675-967c-7016354f2d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:17:29.153722 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:29.201026 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 476/962] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:17:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 03:17:29.275544 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0e413-531d-44dc-8de5-a07ceb1a4b5e None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:29.275860 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0e413-531d-44dc-8de5-a07ceb1a4b5e None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:29.276099 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0e413-531d-44dc-8de5-a07ceb1a4b5e None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:29.277671 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 487/963] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:17:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:17:29.284898 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd823781-5f50-4141-a2e4-f3b6a4208f1f None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:29.285291 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd823781-5f50-4141-a2e4-f3b6a4208f1f None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:29.285667 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd823781-5f50-4141-a2e4-f3b6a4208f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:29.305047 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-cd823781-5f50-4141-a2e4-f3b6a4208f1f None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:17:29.306230 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-cd823781-5f50-4141-a2e4-f3b6a4208f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:17:29.376877 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 477/964] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:17:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 03:17:29.481032 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb0e413-531d-44dc-8de5-a07ceb1a4b5e None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:29.484010 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:29.593832 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb0e413-531d-44dc-8de5-a07ceb1a4b5e None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:29.630734 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17600141-9c31-45ed-ad29-3a9c6700f57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:29.631279 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17600141-9c31-45ed-ad29-3a9c6700f57b None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:29.631588 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17600141-9c31-45ed-ad29-3a9c6700f57b None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:29.631863 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17600141-9c31-45ed-ad29-3a9c6700f57b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:29.644495 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17600141-9c31-45ed-ad29-3a9c6700f57b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:17:29.650449 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-17600141-9c31-45ed-ad29-3a9c6700f57b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 03:17:29.650449 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:29.650449 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:29.650449 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:29.650449 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:29.650449 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:29.650449 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:29.650449 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:29.650449 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:29.650449 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:29.650449 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:29.650449 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:29.650449 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:17:29.650449 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:17:29.650449 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:17:29.650449 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:17:29.651714 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:17:29.651714 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:17:29.651714 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:17:29.651714 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:17:29.651714 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:29.651714 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:29.651714 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:29.651714 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:29.651714 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:29.651714 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:29.651714 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:29.651714 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:29.651714 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:29.651714 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:29.651714 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:29.651714 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:29.653070 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:29.653070 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:29.653070 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:29.653070 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:29.653070 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:17:29.653070 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:17:29.653070 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:17:29.653070 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:17:29.653070 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:17:29.653070 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:17:29.653070 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 03:17:29.653070 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:17:29.653070 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 488/965] 10.222.0.25 () {56 vars in 1120 bytes} [Tue Oct 4 03:17:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:17:29.657723 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd823781-5f50-4141-a2e4-f3b6a4208f1f None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:29.668095 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17600141-9c31-45ed-ad29-3a9c6700f57b None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:29.738977 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:29.759840 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:29.768898 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd823781-5f50-4141-a2e4-f3b6a4208f1f None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:29.781237 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17600141-9c31-45ed-ad29-3a9c6700f57b None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:29.805165 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95f8aaa-e770-495e-a4f9-6c4738a3bfcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:29.805957 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f8aaa-e770-495e-a4f9-6c4738a3bfcd None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:29.806330 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f8aaa-e770-495e-a4f9-6c4738a3bfcd None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:29.806785 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f8aaa-e770-495e-a4f9-6c4738a3bfcd None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:29.807627 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95f8aaa-e770-495e-a4f9-6c4738a3bfcd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:29.808062 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95f8aaa-e770-495e-a4f9-6c4738a3bfcd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:29.809529 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95f8aaa-e770-495e-a4f9-6c4738a3bfcd None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:29.819187 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 478/966] 10.222.0.25 () {56 vars in 1115 bytes} [Tue Oct 4 03:17:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:29.819622 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2904919-e301-4898-af2a-562203d7c20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:29.820695 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2904919-e301-4898-af2a-562203d7c20d None admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:29.821111 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2904919-e301-4898-af2a-562203d7c20d None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:29.821572 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2904919-e301-4898-af2a-562203d7c20d None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:29.822353 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2904919-e301-4898-af2a-562203d7c20d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:29.823945 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2904919-e301-4898-af2a-562203d7c20d None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:29.824782 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95f8aaa-e770-495e-a4f9-6c4738a3bfcd None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:29.826919 dv-cinder-849143-9-smb devstack@keystone.service[81379]: WARNING keystone.server.flask.common [None req-e2904919-e301-4898-af2a-562203d7c20d None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 04 03:17:29.848727 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.sql.core [None req-e2904919-e301-4898-af2a-562203d7c20d None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 04 03:17:29.848727 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 04 03:17:29.848727 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [parameters: {'user_id': 'd457aa97f469446fac60a4a27b036271', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 04 03:17:29.848727 dv-cinder-849143-9-smb devstack@keystone.service[81379]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81379) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 04 03:17:29.858482 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-e2904919-e301-4898-af2a-562203d7c20d None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 04 03:17:29.858482 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:29.858482 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 03:17:29.858482 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 04 03:17:29.858482 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 03:17:29.858482 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 04 03:17:29.858482 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 03:17:29.858482 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application result = self._query(query) Oct 04 03:17:29.858482 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 03:17:29.858482 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application conn.query(q) Oct 04 03:17:29.858482 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 03:17:29.858482 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 03:17:29.858482 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 03:17:29.858482 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application result.read() Oct 04 03:17:29.858482 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 03:17:29.859654 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 04 03:17:29.859654 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 03:17:29.859654 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 04 03:17:29.859654 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 03:17:29.859654 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 04 03:17:29.859654 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 03:17:29.859654 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 04 03:17:29.859654 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 04 03:17:29.859654 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:17:29.859654 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 04 03:17:29.859654 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:17:29.859654 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:29.859654 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 04 03:17:29.859654 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 04 03:17:29.859654 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 04 03:17:29.859654 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 04 03:17:29.859654 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 04 03:17:29.859654 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application next(self.gen) Oct 04 03:17:29.860865 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 04 03:17:29.860865 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application yield resource Oct 04 03:17:29.860865 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 04 03:17:29.860865 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application next(self.gen) Oct 04 03:17:29.860865 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 04 03:17:29.860865 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self.session.rollback() Oct 04 03:17:29.860865 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 03:17:29.860865 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self.force_reraise() Oct 04 03:17:29.860865 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 03:17:29.860865 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise self.value Oct 04 03:17:29.860865 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 04 03:17:29.860865 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 04 03:17:29.860865 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 04 03:17:29.860865 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application session.commit() Oct 04 03:17:29.860865 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 04 03:17:29.860865 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 04 03:17:29.860865 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 04 03:17:29.861978 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self._prepare_impl() Oct 04 03:17:29.861978 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 04 03:17:29.861978 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self.session.flush() Oct 04 03:17:29.861978 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 04 03:17:29.861978 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self._flush(objects) Oct 04 03:17:29.861978 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 04 03:17:29.861978 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 04 03:17:29.861978 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 04 03:17:29.861978 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application compat.raise_( Oct 04 03:17:29.861978 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 03:17:29.861978 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception Oct 04 03:17:29.861978 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 04 03:17:29.861978 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application flush_context.execute() Oct 04 03:17:29.861978 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 04 03:17:29.861978 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rec.execute(self) Oct 04 03:17:29.861978 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 04 03:17:29.861978 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 04 03:17:29.863108 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 04 03:17:29.863108 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 04 03:17:29.863108 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 04 03:17:29.863108 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 04 03:17:29.863108 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 04 03:17:29.863108 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 04 03:17:29.863108 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 04 03:17:29.863108 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 04 03:17:29.863108 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 04 03:17:29.863108 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 04 03:17:29.863108 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 04 03:17:29.863108 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 04 03:17:29.863108 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 04 03:17:29.863108 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 04 03:17:29.863108 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 03:17:29.863108 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception Oct 04 03:17:29.864750 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 03:17:29.864750 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 04 03:17:29.864750 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 03:17:29.864750 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 04 03:17:29.864750 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 03:17:29.864750 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application result = self._query(query) Oct 04 03:17:29.864750 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 03:17:29.864750 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application conn.query(q) Oct 04 03:17:29.864750 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 03:17:29.864750 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 03:17:29.864750 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 03:17:29.864750 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application result.read() Oct 04 03:17:29.864750 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 03:17:29.864750 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 04 03:17:29.864750 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 03:17:29.864750 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 04 03:17:29.866209 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 03:17:29.866209 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 04 03:17:29.866209 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 03:17:29.866209 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 04 03:17:29.866209 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 04 03:17:29.866209 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 04 03:17:29.866209 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [parameters: {'user_id': 'd457aa97f469446fac60a4a27b036271', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 04 03:17:29.866209 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 04 03:17:29.866209 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:17:29.866209 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 03:17:29.866209 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:17:29.866209 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:29.866209 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:29.866209 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:29.866209 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:29.867286 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:29.867286 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:29.867286 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:29.867286 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:29.867286 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:29.867286 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:29.867286 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:29.867286 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 04 03:17:29.867286 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 04 03:17:29.867286 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:29.867286 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:29.867286 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 03:17:29.867286 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 03:17:29.867286 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 03:17:29.867286 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 03:17:29.867286 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 04 03:17:29.867286 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 04 03:17:29.870109 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 04 03:17:29.870109 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 04 03:17:29.870109 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 04 03:17:29.870109 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 04 03:17:29.870109 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 04 03:17:29.870109 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:17:29.870785 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 489/967] 10.222.0.25 () {60 vars in 1131 bytes} [Tue Oct 4 03:17:29 2022] POST /identity/v3/users => generated 160 bytes in 203 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 04 03:17:29.876905 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2904919-e301-4898-af2a-562203d7c20d None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:29.956973 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95f8aaa-e770-495e-a4f9-6c4738a3bfcd None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:30.002349 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6efa0bb-fc8f-4727-be0a-56b74ff5f88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:30.003551 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6efa0bb-fc8f-4727-be0a-56b74ff5f88f None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:30.003830 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6efa0bb-fc8f-4727-be0a-56b74ff5f88f None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:30.004104 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6efa0bb-fc8f-4727-be0a-56b74ff5f88f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:30.015448 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2904919-e301-4898-af2a-562203d7c20d None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:30.019022 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6efa0bb-fc8f-4727-be0a-56b74ff5f88f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:30.021051 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6efa0bb-fc8f-4727-be0a-56b74ff5f88f None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:30.037922 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-a6efa0bb-fc8f-4727-be0a-56b74ff5f88f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:17:30.037922 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:30.037922 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:30.037922 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:30.037922 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:30.037922 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:30.037922 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:30.037922 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:30.037922 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:30.037922 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:30.037922 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:30.037922 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:30.037922 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 03:17:30.037922 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 03:17:30.037922 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 03:17:30.037922 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 03:17:30.039129 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:30.039129 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:30.039129 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:30.039129 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:30.039129 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:30.039129 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:30.039129 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:30.039129 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:30.039129 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:30.039129 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:30.039129 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:30.039129 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:30.039129 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:30.039129 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:30.039129 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:30.039129 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:30.039129 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 03:17:30.040085 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 03:17:30.040085 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:17:30.040085 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:17:30.040085 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 479/968] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:17:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:17:30.040613 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac8bf21-c010-4704-a012-6a45cf7e9fe4 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:30.040897 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac8bf21-c010-4704-a012-6a45cf7e9fe4 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:30.041172 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac8bf21-c010-4704-a012-6a45cf7e9fe4 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:30.042522 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 480/969] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:17:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:17:30.044572 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac8bf21-c010-4704-a012-6a45cf7e9fe4 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:30.047775 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:30.055982 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:30.062089 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddad557-a3f2-4d49-b239-4530183a818a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:30.062718 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddad557-a3f2-4d49-b239-4530183a818a None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:30.063006 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddad557-a3f2-4d49-b239-4530183a818a None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:30.063280 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddad557-a3f2-4d49-b239-4530183a818a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:30.072494 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddad557-a3f2-4d49-b239-4530183a818a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:30.074565 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddad557-a3f2-4d49-b239-4530183a818a None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:30.089902 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-8ddad557-a3f2-4d49-b239-4530183a818a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 03:17:30.089902 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:30.089902 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:30.089902 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:30.089902 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:30.089902 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:30.089902 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:30.089902 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:30.089902 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:30.089902 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:30.089902 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:30.089902 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:30.089902 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 03:17:30.089902 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 03:17:30.089902 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 03:17:30.089902 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 03:17:30.091034 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:30.091034 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:30.091034 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 03:17:30.091034 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 03:17:30.091034 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 03:17:30.091034 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 03:17:30.091034 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:30.091034 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:30.091034 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:30.091034 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:30.091034 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:30.091034 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:30.091034 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:30.091034 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:30.091034 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:30.091034 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:30.091034 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:30.091034 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:30.092245 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:30.092245 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:30.092245 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 03:17:30.092245 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 03:17:30.092245 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 03:17:30.092245 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 03:17:30.092245 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 03:17:30.092245 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 03:17:30.092245 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 03:17:30.092245 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:17:30.095986 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 490/970] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 03:17:29 2022] GET /identity/v3/users/cinder => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:17:30.096981 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea9819-8505-4816-819a-9196209a77dc None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:30.097880 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea9819-8505-4816-819a-9196209a77dc None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:30.097880 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea9819-8505-4816-819a-9196209a77dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:30.117976 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-a0ea9819-8505-4816-819a-9196209a77dc None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:17:30.120281 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-a0ea9819-8505-4816-819a-9196209a77dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:17:30.158380 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac8bf21-c010-4704-a012-6a45cf7e9fe4 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:30.193020 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e8066a-2856-4e3c-aba0-2367ee8caf93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:30.193698 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e8066a-2856-4e3c-aba0-2367ee8caf93 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:30.194044 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e8066a-2856-4e3c-aba0-2367ee8caf93 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:30.194388 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e8066a-2856-4e3c-aba0-2367ee8caf93 None admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:30.195352 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e8066a-2856-4e3c-aba0-2367ee8caf93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:30.195805 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e8066a-2856-4e3c-aba0-2367ee8caf93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:30.197170 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e8066a-2856-4e3c-aba0-2367ee8caf93 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:30.207630 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 491/971] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:17:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 03:17:30.207630 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ea9819-8505-4816-819a-9196209a77dc None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:30.224965 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 481/972] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 03:17:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:17:30.225984 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e8066a-2856-4e3c-aba0-2367ee8caf93 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:30.304120 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:30.325273 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ea9819-8505-4816-819a-9196209a77dc None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:30.342763 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:30.359943 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e8066a-2856-4e3c-aba0-2367ee8caf93 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:30.367652 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c53f1c-e940-45e6-bef1-1307c6ee168e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:30.368263 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c53f1c-e940-45e6-bef1-1307c6ee168e None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:30.368546 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c53f1c-e940-45e6-bef1-1307c6ee168e None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:30.368820 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c53f1c-e940-45e6-bef1-1307c6ee168e None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:30.369518 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c53f1c-e940-45e6-bef1-1307c6ee168e None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:30.369834 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c53f1c-e940-45e6-bef1-1307c6ee168e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:30.371704 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c53f1c-e940-45e6-bef1-1307c6ee168e None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:30.401428 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e7d039-9651-4247-a236-26d0d5e076da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:30.402410 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7d039-9651-4247-a236-26d0d5e076da None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:30.402889 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7d039-9651-4247-a236-26d0d5e076da None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:30.403379 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7d039-9651-4247-a236-26d0d5e076da None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:30.412991 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e7d039-9651-4247-a236-26d0d5e076da None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:30.414736 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e7d039-9651-4247-a236-26d0d5e076da None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:30.423928 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 492/973] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Oct 4 03:17:30 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:30.428175 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-e3e7d039-9651-4247-a236-26d0d5e076da None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 03:17:30.428175 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:30.428175 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:30.428175 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:30.428175 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:30.428175 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:30.428175 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:30.428175 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:30.428175 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:30.428175 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:30.428175 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:30.428175 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:30.428175 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 03:17:30.428175 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 03:17:30.428175 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 03:17:30.428175 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 03:17:30.429208 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:30.429208 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:30.429208 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 03:17:30.429208 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 03:17:30.429208 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 03:17:30.429208 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 03:17:30.429208 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:30.429208 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:30.429208 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:30.429208 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:30.429208 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:30.429208 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:30.429208 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:30.429208 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:30.429208 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:30.429208 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:30.429208 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:30.429208 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:30.430145 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:30.430145 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:30.430145 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 03:17:30.430145 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 03:17:30.430145 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 03:17:30.430145 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 03:17:30.430145 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 03:17:30.430145 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 03:17:30.430145 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 03:17:30.430145 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:17:30.432661 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 482/974] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Oct 4 03:17:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:17:30.440182 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c53f1c-e940-45e6-bef1-1307c6ee168e None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:30.503101 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e7d039-9651-4247-a236-26d0d5e076da None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:30.562105 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c53f1c-e940-45e6-bef1-1307c6ee168e None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:30.606132 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47f9d6b-1cce-4ceb-b86c-fff2c3c63b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:30.606989 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f9d6b-1cce-4ceb-b86c-fff2c3c63b20 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:30.607103 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f9d6b-1cce-4ceb-b86c-fff2c3c63b20 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:30.607303 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f9d6b-1cce-4ceb-b86c-fff2c3c63b20 None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:30.608109 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47f9d6b-1cce-4ceb-b86c-fff2c3c63b20 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:30.608429 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47f9d6b-1cce-4ceb-b86c-fff2c3c63b20 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:30.613965 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47f9d6b-1cce-4ceb-b86c-fff2c3c63b20 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:30.639544 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e7d039-9651-4247-a236-26d0d5e076da None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:30.642456 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 493/975] 10.222.0.25 () {56 vars in 1149 bytes} [Tue Oct 4 03:17:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:30.648859 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47f9d6b-1cce-4ceb-b86c-fff2c3c63b20 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:30.680936 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:30.689862 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e247a-86a3-45a2-85b3-b877aa42e607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:30.690513 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e247a-86a3-45a2-85b3-b877aa42e607 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:30.690798 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e247a-86a3-45a2-85b3-b877aa42e607 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:30.691069 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e247a-86a3-45a2-85b3-b877aa42e607 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:30.691790 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127e247a-86a3-45a2-85b3-b877aa42e607 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:30.693134 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:30.693660 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127e247a-86a3-45a2-85b3-b877aa42e607 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:30.703672 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-127e247a-86a3-45a2-85b3-b877aa42e607 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 03:17:30.703672 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:30.703672 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 03:17:30.703672 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 03:17:30.703672 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 03:17:30.703672 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 03:17:30.703672 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 03:17:30.703672 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 03:17:30.703672 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 03:17:30.703672 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:17:30.703672 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 03:17:30.703672 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:17:30.703672 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:30.703672 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:30.703672 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:30.703672 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:30.703672 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:30.704825 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:30.704825 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:30.704825 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:30.704825 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:30.704825 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:30.704825 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:30.704825 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 03:17:30.704825 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 03:17:30.704825 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 03:17:30.704825 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 03:17:30.704825 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:30.704825 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:30.704825 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:30.704825 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:30.704825 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:30.704825 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:30.705690 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:30.705690 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:30.705690 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:30.705690 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:30.705690 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:30.705690 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:30.705690 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:30.705690 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:30.705690 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:30.705690 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:30.705690 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 03:17:30.705690 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 03:17:30.705690 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 03:17:30.705690 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:17:30.705690 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 483/976] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Oct 4 03:17:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 03:17:30.712445 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e247a-86a3-45a2-85b3-b877aa42e607 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:30.790322 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47f9d6b-1cce-4ceb-b86c-fff2c3c63b20 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:30.825713 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02498fd-b80f-42bb-9f36-ab9765dd195a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:30.826319 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02498fd-b80f-42bb-9f36-ab9765dd195a None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:30.826594 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02498fd-b80f-42bb-9f36-ab9765dd195a None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:30.826860 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02498fd-b80f-42bb-9f36-ab9765dd195a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:30.834685 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e247a-86a3-45a2-85b3-b877aa42e607 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:30.868777 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb22060-1cda-442c-aece-53e383cbfaa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:30.869368 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb22060-1cda-442c-aece-53e383cbfaa9 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:30.869661 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb22060-1cda-442c-aece-53e383cbfaa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:30.869925 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb22060-1cda-442c-aece-53e383cbfaa9 None admin] PATH_INFO: `/v3/services` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:30.870545 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb22060-1cda-442c-aece-53e383cbfaa9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:30.870865 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb22060-1cda-442c-aece-53e383cbfaa9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:30.872252 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb22060-1cda-442c-aece-53e383cbfaa9 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:30.876975 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 484/977] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Oct 4 03:17:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:30.878097 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c365d3d-47fc-4554-8016-32e2b55a11ca None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:30.878452 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c365d3d-47fc-4554-8016-32e2b55a11ca None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:30.878728 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c365d3d-47fc-4554-8016-32e2b55a11ca None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:30.880286 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 485/978] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:17:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:17:30.885181 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c365d3d-47fc-4554-8016-32e2b55a11ca None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:30.904500 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02498fd-b80f-42bb-9f36-ab9765dd195a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:30.905940 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02498fd-b80f-42bb-9f36-ab9765dd195a None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:30.934940 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:30.939839 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:30.985254 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c365d3d-47fc-4554-8016-32e2b55a11ca None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:31.004193 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 494/979] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 03:17:30 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 04 03:17:31.006039 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d00a7-98ac-43a3-8408-dd89de9086da None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:31.006429 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d00a7-98ac-43a3-8408-dd89de9086da None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:31.007038 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d00a7-98ac-43a3-8408-dd89de9086da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:31.020227 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2b6321-a2aa-4317-90a2-1f512d89dee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:31.020827 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b6321-a2aa-4317-90a2-1f512d89dee3 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:31.021114 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b6321-a2aa-4317-90a2-1f512d89dee3 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:31.021372 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b6321-a2aa-4317-90a2-1f512d89dee3 None admin] PATH_INFO: `/v3/services` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:31.021987 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2b6321-a2aa-4317-90a2-1f512d89dee3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:31.022284 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2b6321-a2aa-4317-90a2-1f512d89dee3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:31.023655 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2b6321-a2aa-4317-90a2-1f512d89dee3 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:31.025681 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-250d00a7-98ac-43a3-8408-dd89de9086da None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:17:31.026886 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-250d00a7-98ac-43a3-8408-dd89de9086da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:17:31.028313 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 486/980] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Oct 4 03:17:30 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:31.029070 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2b6321-a2aa-4317-90a2-1f512d89dee3 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:31.095711 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 495/981] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:17:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 03:17:31.096463 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d00a7-98ac-43a3-8408-dd89de9086da None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:31.139836 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2b6321-a2aa-4317-90a2-1f512d89dee3 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:31.157702 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:31.160229 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:31.178549 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a80ff-9977-4d4d-ae33-38f3639e67cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:31.179306 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a80ff-9977-4d4d-ae33-38f3639e67cb None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:31.180120 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a80ff-9977-4d4d-ae33-38f3639e67cb None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:31.180500 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a80ff-9977-4d4d-ae33-38f3639e67cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:31.192000 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163a80ff-9977-4d4d-ae33-38f3639e67cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:31.193934 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163a80ff-9977-4d4d-ae33-38f3639e67cb None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:31.207447 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d00a7-98ac-43a3-8408-dd89de9086da None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:31.214906 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-163a80ff-9977-4d4d-ae33-38f3639e67cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:17:31.214906 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:31.214906 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:31.214906 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:31.214906 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:31.214906 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:31.214906 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:31.214906 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:31.214906 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:31.214906 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:31.214906 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:31.214906 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:31.214906 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 03:17:31.214906 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 03:17:31.214906 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 03:17:31.214906 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 03:17:31.216099 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:31.216099 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:31.216099 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:31.216099 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:31.216099 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:31.216099 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:31.216099 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:31.216099 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:31.216099 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:31.216099 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:31.216099 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:31.216099 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:31.216099 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:31.216099 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:31.216099 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:31.216099 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:31.216099 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 03:17:31.217275 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 03:17:31.217275 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:17:31.217275 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:17:31.220870 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 487/982] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:17:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:17:31.221491 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a80ff-9977-4d4d-ae33-38f3639e67cb None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:31.248791 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bced28e-ac2c-4611-b4c5-9fbfe5731f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:31.249543 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bced28e-ac2c-4611-b4c5-9fbfe5731f42 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:31.249919 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bced28e-ac2c-4611-b4c5-9fbfe5731f42 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:31.250290 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bced28e-ac2c-4611-b4c5-9fbfe5731f42 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:31.251090 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bced28e-ac2c-4611-b4c5-9fbfe5731f42 None admin] RBAC: Adding query filter params (interface=admin, service_id=a53fd6b1a5f74eb1981a39e42d63320b, region_id=RegionOne) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:31.251514 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bced28e-ac2c-4611-b4c5-9fbfe5731f42 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:31.253135 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bced28e-ac2c-4611-b4c5-9fbfe5731f42 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:31.258283 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 496/983] 10.222.0.25 () {56 vars in 1249 bytes} [Tue Oct 4 03:17:31 2022] GET /identity/v3/endpoints?service_id=a53fd6b1a5f74eb1981a39e42d63320b&interface=admin®ion_id=RegionOne => generated 193 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:31.263819 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bced28e-ac2c-4611-b4c5-9fbfe5731f42 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:31.329181 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a80ff-9977-4d4d-ae33-38f3639e67cb None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:31.365597 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3239a50a-f39e-48b7-81c8-94930addcada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:31.366511 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239a50a-f39e-48b7-81c8-94930addcada None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:31.366795 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239a50a-f39e-48b7-81c8-94930addcada None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:31.367096 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239a50a-f39e-48b7-81c8-94930addcada None admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:31.367760 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3239a50a-f39e-48b7-81c8-94930addcada None admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:31.368071 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3239a50a-f39e-48b7-81c8-94930addcada None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:31.369012 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bced28e-ac2c-4611-b4c5-9fbfe5731f42 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:31.369425 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3239a50a-f39e-48b7-81c8-94930addcada None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:31.382096 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 488/984] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 03:17:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:17:31.382747 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3239a50a-f39e-48b7-81c8-94930addcada None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:31.393738 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:31.404882 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ef9883-a7cf-4136-91b0-813b4585c9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:31.405486 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef9883-a7cf-4136-91b0-813b4585c9ab None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:31.405770 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef9883-a7cf-4136-91b0-813b4585c9ab None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:31.406046 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef9883-a7cf-4136-91b0-813b4585c9ab None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:31.406649 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ef9883-a7cf-4136-91b0-813b4585c9ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:31.408042 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ef9883-a7cf-4136-91b0-813b4585c9ab None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:31.414444 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 497/985] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Oct 4 03:17:31 2022] GET /identity/v3/services => generated 1497 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 03:17:31.414965 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:31.415206 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ef9883-a7cf-4136-91b0-813b4585c9ab None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:31.494418 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3239a50a-f39e-48b7-81c8-94930addcada None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:31.532641 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b499111-7d3f-4935-bad6-d860283ac9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:31.533421 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b499111-7d3f-4935-bad6-d860283ac9b6 None admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:31.533704 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b499111-7d3f-4935-bad6-d860283ac9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:31.534061 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b499111-7d3f-4935-bad6-d860283ac9b6 None admin] PATH_INFO: `/v3/services` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:31.534635 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b499111-7d3f-4935-bad6-d860283ac9b6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:31.536139 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b499111-7d3f-4935-bad6-d860283ac9b6 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:31.542375 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ef9883-a7cf-4136-91b0-813b4585c9ab None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:31.553757 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 489/986] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Oct 4 03:17:31 2022] POST /identity/v3/services => generated 242 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:17:31.601477 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eea5bf-c5cc-4eb6-94e3-1c455ada78ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:31.602277 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eea5bf-c5cc-4eb6-94e3-1c455ada78ee None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:31.602564 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eea5bf-c5cc-4eb6-94e3-1c455ada78ee None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:31.602839 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eea5bf-c5cc-4eb6-94e3-1c455ada78ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:31.610721 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eea5bf-c5cc-4eb6-94e3-1c455ada78ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:31.612300 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eea5bf-c5cc-4eb6-94e3-1c455ada78ee None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:31.626307 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-11eea5bf-c5cc-4eb6-94e3-1c455ada78ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 03:17:31.626307 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:31.626307 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:31.626307 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:31.626307 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:31.626307 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:31.626307 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:31.626307 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:31.626307 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:31.626307 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:31.626307 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:31.626307 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:31.626307 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 03:17:31.626307 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 03:17:31.626307 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 03:17:31.627537 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 03:17:31.627537 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:31.627537 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:31.627537 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:31.627537 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:31.627537 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:31.627537 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:31.627537 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:31.627537 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:31.627537 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:31.627537 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:31.627537 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:31.627537 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:31.627537 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:31.627537 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:31.627537 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:31.627537 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:31.628683 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 03:17:31.628683 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 03:17:31.628683 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 03:17:31.628683 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 03:17:31.628683 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 03:17:31.628683 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 03:17:31.628683 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 03:17:31.628683 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:17:31.628683 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 498/987] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 03:17:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:17:31.634407 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b499111-7d3f-4935-bad6-d860283ac9b6 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:31.740900 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:31.752305 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b499111-7d3f-4935-bad6-d860283ac9b6 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:31.788548 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c52349-df60-490c-9bb0-03bfcb184adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:31.789157 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c52349-df60-490c-9bb0-03bfcb184adf None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:31.789435 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c52349-df60-490c-9bb0-03bfcb184adf None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:31.789706 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c52349-df60-490c-9bb0-03bfcb184adf None admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:31.790395 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c52349-df60-490c-9bb0-03bfcb184adf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:31.790699 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c52349-df60-490c-9bb0-03bfcb184adf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:31.792148 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c52349-df60-490c-9bb0-03bfcb184adf None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:31.804044 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 490/988] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 4 03:17:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:31.810292 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eea5bf-c5cc-4eb6-94e3-1c455ada78ee None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:31.858501 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:31.915016 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eea5bf-c5cc-4eb6-94e3-1c455ada78ee None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:31.949919 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec32989a-3f07-49db-877d-8dc9a0654b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:31.950666 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec32989a-3f07-49db-877d-8dc9a0654b0e None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:31.951073 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec32989a-3f07-49db-877d-8dc9a0654b0e None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:31.951447 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec32989a-3f07-49db-877d-8dc9a0654b0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:31.952324 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec32989a-3f07-49db-877d-8dc9a0654b0e None admin] RBAC: Adding query filter params (role.id=8d45a720a6c14675a3504853645b8e22, scope.project.id=80ae15e46620470b9c55fb7fe300fcb6, user.id=bef61ef12079495ba72b7fcd2717aca2) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:31.952734 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec32989a-3f07-49db-877d-8dc9a0654b0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:31.954236 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec32989a-3f07-49db-877d-8dc9a0654b0e None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:31.967513 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 499/989] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 03:17:31 2022] GET /identity/v3/role_assignments?user.id=bef61ef12079495ba72b7fcd2717aca2&scope.project.id=80ae15e46620470b9c55fb7fe300fcb6&role.id=8d45a720a6c14675a3504853645b8e22 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:33.663531 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32cd7d-22d1-4918-9756-0473c9cd4e0f None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:33.664068 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32cd7d-22d1-4918-9756-0473c9cd4e0f None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:33.664068 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32cd7d-22d1-4918-9756-0473c9cd4e0f None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:33.665453 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 491/990] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:17:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:17:33.670634 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f8fd0-2244-461d-935c-9df2b782de84 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:33.671015 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f8fd0-2244-461d-935c-9df2b782de84 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:33.671182 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f8fd0-2244-461d-935c-9df2b782de84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:33.690249 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-561f8fd0-2244-461d-935c-9df2b782de84 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:17:33.691449 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-561f8fd0-2244-461d-935c-9df2b782de84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:17:33.743106 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87aeee9-cc91-4e40-bd8c-3e1b6124eae5 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:33.743388 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87aeee9-cc91-4e40-bd8c-3e1b6124eae5 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:33.743696 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87aeee9-cc91-4e40-bd8c-3e1b6124eae5 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:33.745157 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 492/991] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:17:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 03:17:33.750033 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc56c2f-f7db-4638-afc4-68be0c257602 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:33.750393 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc56c2f-f7db-4638-afc4-68be0c257602 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:33.750680 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc56c2f-f7db-4638-afc4-68be0c257602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:33.764115 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 500/992] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:17:33 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 03:17:33.769570 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-5dc56c2f-f7db-4638-afc4-68be0c257602 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:17:33.771031 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-5dc56c2f-f7db-4638-afc4-68be0c257602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:17:33.839517 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 493/993] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:17:33 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 03:17:34.031269 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561f8fd0-2244-461d-935c-9df2b782de84 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:34.074544 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:34.110016 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc56c2f-f7db-4638-afc4-68be0c257602 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:34.138300 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561f8fd0-2244-461d-935c-9df2b782de84 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:34.175078 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c670ab87-37df-4527-bde9-5a34d0b32d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:34.175755 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c670ab87-37df-4527-bde9-5a34d0b32d65 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:34.176038 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c670ab87-37df-4527-bde9-5a34d0b32d65 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:34.176313 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c670ab87-37df-4527-bde9-5a34d0b32d65 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:34.176941 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c670ab87-37df-4527-bde9-5a34d0b32d65 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:34.178294 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c670ab87-37df-4527-bde9-5a34d0b32d65 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:34.186879 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-c670ab87-37df-4527-bde9-5a34d0b32d65 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 03:17:34.186879 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:34.186879 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 03:17:34.186879 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 03:17:34.186879 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 03:17:34.186879 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 03:17:34.186879 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 03:17:34.186879 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 03:17:34.186879 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 03:17:34.186879 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:17:34.186879 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 03:17:34.186879 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:17:34.186879 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:34.186879 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:34.186879 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:34.186879 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:34.186879 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:34.188068 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:34.188068 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:34.188068 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:34.188068 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:34.188068 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:34.188068 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:34.188068 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 03:17:34.188068 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 03:17:34.188068 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 03:17:34.188068 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 03:17:34.188068 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:34.188068 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:34.188068 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:34.188068 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:34.188068 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:34.188068 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:34.188931 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:34.188931 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:34.188931 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:34.188931 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:34.188931 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:34.188931 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:34.188931 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:34.188931 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:34.188931 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:34.188931 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:34.188931 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 03:17:34.188931 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 03:17:34.188931 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 03:17:34.188931 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:17:34.188931 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 501/994] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Oct 4 03:17:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:17:34.189739 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef7e91-6c0e-4210-8880-ac55bdc118b5 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:34.189739 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef7e91-6c0e-4210-8880-ac55bdc118b5 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:34.189739 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef7e91-6c0e-4210-8880-ac55bdc118b5 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:34.191031 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 502/995] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:17:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:17:34.194442 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ef7e91-6c0e-4210-8880-ac55bdc118b5 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:34.198230 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:34.218506 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc56c2f-f7db-4638-afc4-68be0c257602 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:34.254398 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd98067-79f6-4201-99c8-cefc50c196e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:34.255772 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd98067-79f6-4201-99c8-cefc50c196e6 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:34.256055 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd98067-79f6-4201-99c8-cefc50c196e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:34.256338 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd98067-79f6-4201-99c8-cefc50c196e6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:34.256941 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd98067-79f6-4201-99c8-cefc50c196e6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:34.258308 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd98067-79f6-4201-99c8-cefc50c196e6 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:34.266900 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-9dd98067-79f6-4201-99c8-cefc50c196e6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 03:17:34.266900 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:34.266900 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 03:17:34.266900 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 03:17:34.266900 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 03:17:34.266900 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 03:17:34.266900 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 03:17:34.266900 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 03:17:34.266900 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 03:17:34.266900 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:17:34.266900 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 03:17:34.266900 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:17:34.266900 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:34.266900 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:34.266900 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:34.266900 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:34.266900 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:34.268190 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:34.268190 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:34.268190 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:34.268190 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:34.268190 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:34.268190 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:34.268190 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 03:17:34.268190 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 03:17:34.268190 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 03:17:34.268190 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 03:17:34.268190 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:34.268190 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:34.268190 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:34.268190 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:34.268190 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:34.268190 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:34.269030 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:34.269030 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:34.269030 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:34.269030 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:34.269030 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:34.269030 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:34.269030 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:34.269030 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:34.269030 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:34.269030 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:34.269030 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 03:17:34.269030 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 03:17:34.269030 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 03:17:34.269030 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:17:34.269030 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 494/996] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 03:17:34 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 03:17:34.269828 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ca9e3-8148-4e3c-93eb-d5ca413f2da7 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:34.269828 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ca9e3-8148-4e3c-93eb-d5ca413f2da7 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:34.270861 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ca9e3-8148-4e3c-93eb-d5ca413f2da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:34.288479 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-2b2ca9e3-8148-4e3c-93eb-d5ca413f2da7 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:17:34.289599 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-2b2ca9e3-8148-4e3c-93eb-d5ca413f2da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:17:34.297672 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ef7e91-6c0e-4210-8880-ac55bdc118b5 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:34.299181 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:34.333757 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9de2cc-b538-49b5-a6fa-9c92bb994868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:34.334348 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9de2cc-b538-49b5-a6fa-9c92bb994868 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:34.334628 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9de2cc-b538-49b5-a6fa-9c92bb994868 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:34.334903 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9de2cc-b538-49b5-a6fa-9c92bb994868 None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:34.335547 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9de2cc-b538-49b5-a6fa-9c92bb994868 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:34.335851 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9de2cc-b538-49b5-a6fa-9c92bb994868 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:34.337221 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9de2cc-b538-49b5-a6fa-9c92bb994868 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:34.341819 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 503/997] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Oct 4 03:17:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:17:34.342581 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9de2cc-b538-49b5-a6fa-9c92bb994868 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:34.358668 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 495/998] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:17:34 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 03:17:34.359507 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2ca9e3-8148-4e3c-93eb-d5ca413f2da7 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:34.438319 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:34.456356 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9de2cc-b538-49b5-a6fa-9c92bb994868 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:34.466044 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2ca9e3-8148-4e3c-93eb-d5ca413f2da7 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:34.493415 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c94ed32-f86f-4879-b07b-e4000ae88c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:34.494019 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c94ed32-f86f-4879-b07b-e4000ae88c20 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:34.494302 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c94ed32-f86f-4879-b07b-e4000ae88c20 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:34.494582 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c94ed32-f86f-4879-b07b-e4000ae88c20 None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:34.495457 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c94ed32-f86f-4879-b07b-e4000ae88c20 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:34.495790 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c94ed32-f86f-4879-b07b-e4000ae88c20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:34.497877 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c94ed32-f86f-4879-b07b-e4000ae88c20 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:34.500971 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bec5c7-968d-43e8-9e6a-06caa53ba870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:34.501628 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bec5c7-968d-43e8-9e6a-06caa53ba870 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:34.501913 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bec5c7-968d-43e8-9e6a-06caa53ba870 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:34.502191 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bec5c7-968d-43e8-9e6a-06caa53ba870 None admin] PATH_INFO: `/v3/services` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:34.507635 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bec5c7-968d-43e8-9e6a-06caa53ba870 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:34.507784 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 504/999] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Oct 4 03:17:34 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:34.507898 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bec5c7-968d-43e8-9e6a-06caa53ba870 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:34.507898 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bec5c7-968d-43e8-9e6a-06caa53ba870 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:34.508426 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c94ed32-f86f-4879-b07b-e4000ae88c20 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:34.512063 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 496/1000] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Oct 4 03:17:34 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:34.517531 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bec5c7-968d-43e8-9e6a-06caa53ba870 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:34.541954 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:34.613688 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c94ed32-f86f-4879-b07b-e4000ae88c20 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:34.619915 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bec5c7-968d-43e8-9e6a-06caa53ba870 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:34.649155 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2ff413-c29f-44f4-b4ab-be2196f781fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:34.649759 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ff413-c29f-44f4-b4ab-be2196f781fb None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:34.650042 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ff413-c29f-44f4-b4ab-be2196f781fb None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:34.650324 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ff413-c29f-44f4-b4ab-be2196f781fb None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:34.650949 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2ff413-c29f-44f4-b4ab-be2196f781fb None admin] RBAC: Adding query filter params (type=compute) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:34.651255 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2ff413-c29f-44f4-b4ab-be2196f781fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:34.652638 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2ff413-c29f-44f4-b4ab-be2196f781fb None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:34.657383 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 505/1001] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Oct 4 03:17:34 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:17:34.657599 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1e04c5-64c7-40ff-b4f7-c524188d48c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:34.658161 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2ff413-c29f-44f4-b4ab-be2196f781fb None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:34.658260 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e04c5-64c7-40ff-b4f7-c524188d48c1 None admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:34.658533 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e04c5-64c7-40ff-b4f7-c524188d48c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:34.658810 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e04c5-64c7-40ff-b4f7-c524188d48c1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:34.659471 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1e04c5-64c7-40ff-b4f7-c524188d48c1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:34.660866 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1e04c5-64c7-40ff-b4f7-c524188d48c1 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:34.672737 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:34.683817 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 497/1002] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:17:34 2022] POST /identity/v3/endpoints => generated 325 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 03:17:34.684968 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1e04c5-64c7-40ff-b4f7-c524188d48c1 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:34.770856 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:34.780097 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2ff413-c29f-44f4-b4ab-be2196f781fb None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:34.806707 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1e04c5-64c7-40ff-b4f7-c524188d48c1 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:34.825682 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609ec3db-0f9e-42bd-ab1a-c1e3ab1aa51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:34.827028 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ec3db-0f9e-42bd-ab1a-c1e3ab1aa51c None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:34.827454 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ec3db-0f9e-42bd-ab1a-c1e3ab1aa51c None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:34.827903 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ec3db-0f9e-42bd-ab1a-c1e3ab1aa51c None admin] PATH_INFO: `/v3/services/image` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:34.828634 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609ec3db-0f9e-42bd-ab1a-c1e3ab1aa51c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:34.830784 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609ec3db-0f9e-42bd-ab1a-c1e3ab1aa51c None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:34.842936 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-609ec3db-0f9e-42bd-ab1a-c1e3ab1aa51c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 03:17:34.842936 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:34.842936 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 03:17:34.842936 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 03:17:34.842936 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 03:17:34.842936 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 03:17:34.842936 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 03:17:34.842936 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 03:17:34.842936 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 03:17:34.842936 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:17:34.842936 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 03:17:34.842936 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:17:34.842936 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:34.842936 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:34.842936 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:34.842936 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:34.842936 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:34.844211 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:34.844211 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:34.844211 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:34.844211 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:34.844211 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:34.844211 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:34.844211 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 03:17:34.844211 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 03:17:34.844211 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 03:17:34.844211 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 03:17:34.844211 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:34.844211 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:34.844211 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:34.844211 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:34.844211 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:34.844211 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:34.845237 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:34.845237 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:34.845237 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:34.845237 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:34.845237 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:34.845237 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:34.845237 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:34.845237 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:34.845237 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:34.845237 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:34.845237 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 03:17:34.845237 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 03:17:34.845237 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 03:17:34.845237 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:17:34.846137 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb03ea9-ff4c-404b-a79d-bc9542e41142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:34.846137 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb03ea9-ff4c-404b-a79d-bc9542e41142 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:34.846137 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb03ea9-ff4c-404b-a79d-bc9542e41142 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:34.846387 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb03ea9-ff4c-404b-a79d-bc9542e41142 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:34.846890 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb03ea9-ff4c-404b-a79d-bc9542e41142 None admin] RBAC: Adding query filter params (interface=public, service_id=af17d171d4c240bdb81981e8888f1312, region_id=RegionOne) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:34.847195 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb03ea9-ff4c-404b-a79d-bc9542e41142 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:34.848020 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 506/1003] 10.222.0.25 () {56 vars in 1105 bytes} [Tue Oct 4 03:17:34 2022] GET /identity/v3/services/image => generated 86 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:17:34.849237 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb03ea9-ff4c-404b-a79d-bc9542e41142 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:34.854431 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609ec3db-0f9e-42bd-ab1a-c1e3ab1aa51c None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:34.855803 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 498/1004] 10.222.0.25 () {56 vars in 1251 bytes} [Tue Oct 4 03:17:34 2022] GET /identity/v3/endpoints?service_id=af17d171d4c240bdb81981e8888f1312&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:34.861242 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb03ea9-ff4c-404b-a79d-bc9542e41142 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:34.924330 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:34.964391 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609ec3db-0f9e-42bd-ab1a-c1e3ab1aa51c None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:34.969540 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb03ea9-ff4c-404b-a79d-bc9542e41142 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:35.001729 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77308fdc-7311-40e4-a35c-0a59ba8bd147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:35.002302 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77308fdc-7311-40e4-a35c-0a59ba8bd147 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:35.002588 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77308fdc-7311-40e4-a35c-0a59ba8bd147 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:35.002860 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77308fdc-7311-40e4-a35c-0a59ba8bd147 None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:35.003473 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77308fdc-7311-40e4-a35c-0a59ba8bd147 None admin] RBAC: Adding query filter params (name=image) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:35.003788 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f06d880-cc27-4377-97f3-8d5b1e38a6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:35.003903 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77308fdc-7311-40e4-a35c-0a59ba8bd147 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:35.004394 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f06d880-cc27-4377-97f3-8d5b1e38a6e6 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:35.005216 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f06d880-cc27-4377-97f3-8d5b1e38a6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:35.005488 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f06d880-cc27-4377-97f3-8d5b1e38a6e6 None admin] PATH_INFO: `/v3/services` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:35.005667 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77308fdc-7311-40e4-a35c-0a59ba8bd147 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:35.006085 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f06d880-cc27-4377-97f3-8d5b1e38a6e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:35.007437 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f06d880-cc27-4377-97f3-8d5b1e38a6e6 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:35.010945 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 507/1005] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:17:34 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:17:35.016332 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77308fdc-7311-40e4-a35c-0a59ba8bd147 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:35.023891 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 499/1006] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Oct 4 03:17:34 2022] GET /identity/v3/services => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 03:17:35.045014 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:35.131843 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77308fdc-7311-40e4-a35c-0a59ba8bd147 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:35.169371 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa10be7-457a-49ce-a768-6a0b27df4965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:35.169990 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa10be7-457a-49ce-a768-6a0b27df4965 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:35.170266 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa10be7-457a-49ce-a768-6a0b27df4965 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:35.170537 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa10be7-457a-49ce-a768-6a0b27df4965 None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:35.171174 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa10be7-457a-49ce-a768-6a0b27df4965 None admin] RBAC: Adding query filter params (type=image) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:35.171477 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa10be7-457a-49ce-a768-6a0b27df4965 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:35.172862 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa10be7-457a-49ce-a768-6a0b27df4965 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:35.183748 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 508/1007] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:17:35 2022] GET /identity/v3/services?type=image => generated 122 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:17:36.860702 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ec7fa-311c-4616-958b-5d2e805521ed None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:36.861237 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ec7fa-311c-4616-958b-5d2e805521ed None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:36.861237 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ec7fa-311c-4616-958b-5d2e805521ed None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:36.862739 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 500/1008] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:17:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:17:36.868302 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d76f9-443f-430c-966f-88a62de6ac88 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:36.868712 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d76f9-443f-430c-966f-88a62de6ac88 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:36.868889 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d76f9-443f-430c-966f-88a62de6ac88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:36.886761 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-af1d76f9-443f-430c-966f-88a62de6ac88 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:17:36.887896 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-af1d76f9-443f-430c-966f-88a62de6ac88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:17:36.962333 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 509/1009] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:17:36 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 03:17:37.195136 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e985d45-450e-4e4b-94bc-8609e5fe42d0 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:37.195435 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e985d45-450e-4e4b-94bc-8609e5fe42d0 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:37.195641 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e985d45-450e-4e4b-94bc-8609e5fe42d0 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:37.197135 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 501/1010] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:17:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:17:37.202052 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6fc2b6-f33d-4603-8405-4878bf829ff0 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:37.202340 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6fc2b6-f33d-4603-8405-4878bf829ff0 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:37.202615 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6fc2b6-f33d-4603-8405-4878bf829ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:37.221221 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-ad6fc2b6-f33d-4603-8405-4878bf829ff0 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:17:37.222444 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-ad6fc2b6-f33d-4603-8405-4878bf829ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:17:37.229311 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e985d45-450e-4e4b-94bc-8609e5fe42d0 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:37.236853 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:37.303776 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 510/1011] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:17:37 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 03:17:37.338346 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e985d45-450e-4e4b-94bc-8609e5fe42d0 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:37.343766 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a785e-b9ad-41d9-b214-1781022be0c0 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:37.344056 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a785e-b9ad-41d9-b214-1781022be0c0 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:37.344331 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a785e-b9ad-41d9-b214-1781022be0c0 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:37.345675 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 511/1012] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:17:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 03:17:37.351042 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e9b7a-5213-4957-ad93-304b8bb570af None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:37.351331 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e9b7a-5213-4957-ad93-304b8bb570af None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:37.351639 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e9b7a-5213-4957-ad93-304b8bb570af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:37.362302 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:37.369928 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-b60e9b7a-5213-4957-ad93-304b8bb570af None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:17:37.371119 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-b60e9b7a-5213-4957-ad93-304b8bb570af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:17:37.375611 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa4f8e0-ca2e-453c-b2bb-3ab4c948538f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:37.376238 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa4f8e0-ca2e-453c-b2bb-3ab4c948538f None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:37.376512 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa4f8e0-ca2e-453c-b2bb-3ab4c948538f None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:37.376782 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa4f8e0-ca2e-453c-b2bb-3ab4c948538f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:37.377884 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa4f8e0-ca2e-453c-b2bb-3ab4c948538f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:37.379292 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa4f8e0-ca2e-453c-b2bb-3ab4c948538f None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:37.381115 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 502/1013] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:17:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:17:37.387167 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa4f8e0-ca2e-453c-b2bb-3ab4c948538f None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:37.440679 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 512/1014] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:17:37 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 03:17:37.493581 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa4f8e0-ca2e-453c-b2bb-3ab4c948538f None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:37.527762 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe17e04-83c9-499c-b716-794bc6c9b179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:37.528363 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe17e04-83c9-499c-b716-794bc6c9b179 None admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:37.528643 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe17e04-83c9-499c-b716-794bc6c9b179 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:37.528916 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe17e04-83c9-499c-b716-794bc6c9b179 None admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:37.529557 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe17e04-83c9-499c-b716-794bc6c9b179 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:37.530963 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe17e04-83c9-499c-b716-794bc6c9b179 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:37.567615 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 503/1015] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Oct 4 03:17:37 2022] POST /identity/v3/projects => generated 311 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:17:37.574832 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60e9b7a-5213-4957-ad93-304b8bb570af None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:37.670630 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:37.698507 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60e9b7a-5213-4957-ad93-304b8bb570af None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:37.708254 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe17e04-83c9-499c-b716-794bc6c9b179 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:37.738428 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1702bf-bd03-4ac1-babc-02b734df4053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:37.739595 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1702bf-bd03-4ac1-babc-02b734df4053 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:37.739879 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1702bf-bd03-4ac1-babc-02b734df4053 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:37.740243 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1702bf-bd03-4ac1-babc-02b734df4053 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:37.740879 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1702bf-bd03-4ac1-babc-02b734df4053 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:37.742242 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1702bf-bd03-4ac1-babc-02b734df4053 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:37.751481 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-5a1702bf-bd03-4ac1-babc-02b734df4053 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 03:17:37.751481 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:37.751481 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 03:17:37.751481 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 03:17:37.751481 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 03:17:37.751481 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 03:17:37.751481 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 03:17:37.751481 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 03:17:37.751481 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 03:17:37.751481 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:17:37.751481 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 03:17:37.751481 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:17:37.751481 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:37.751481 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:37.751481 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:37.751481 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:37.751481 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:37.752636 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:37.752636 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:37.752636 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:37.752636 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:37.752636 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:37.752636 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:37.752636 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 03:17:37.752636 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 03:17:37.752636 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 03:17:37.752636 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 03:17:37.752636 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:37.752636 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:37.752636 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:37.752636 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:37.752636 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:37.752636 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:37.753828 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:37.753828 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:37.753828 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:37.753828 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:37.753828 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:37.753828 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:37.753828 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:37.753828 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:37.753828 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:37.753828 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:37.753828 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 03:17:37.753828 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 03:17:37.753828 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 03:17:37.753828 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:17:37.753828 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 513/1016] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 03:17:37 2022] GET /identity/v3/services/compute => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:17:37.759345 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1702bf-bd03-4ac1-babc-02b734df4053 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:37.766955 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:37.833187 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe17e04-83c9-499c-b716-794bc6c9b179 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:37.869477 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c528f-62e4-4ab6-8e86-df085b63e81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:37.870112 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c528f-62e4-4ab6-8e86-df085b63e81d None admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:37.870357 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c528f-62e4-4ab6-8e86-df085b63e81d None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:37.870636 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c528f-62e4-4ab6-8e86-df085b63e81d None admin] PATH_INFO: `/v3/services` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:37.871307 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51c528f-62e4-4ab6-8e86-df085b63e81d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:37.872710 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51c528f-62e4-4ab6-8e86-df085b63e81d None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:37.874126 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1702bf-bd03-4ac1-babc-02b734df4053 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:37.889447 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 504/1017] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Oct 4 03:17:37 2022] POST /identity/v3/services => generated 242 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 03:17:37.924337 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21bae57-79c7-440f-bd59-eb1777f325eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:37.925416 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21bae57-79c7-440f-bd59-eb1777f325eb None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:37.925964 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21bae57-79c7-440f-bd59-eb1777f325eb None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:37.927069 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21bae57-79c7-440f-bd59-eb1777f325eb None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:37.928059 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21bae57-79c7-440f-bd59-eb1777f325eb None admin] RBAC: Adding query filter params (name=compute) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:37.928579 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21bae57-79c7-440f-bd59-eb1777f325eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:37.930255 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21bae57-79c7-440f-bd59-eb1777f325eb None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:37.932851 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:37.937990 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 514/1018] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Oct 4 03:17:37 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:17:37.943540 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c528f-62e4-4ab6-8e86-df085b63e81d None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:38.062033 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c528f-62e4-4ab6-8e86-df085b63e81d None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:38.063542 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:38.100728 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da36cd7-65f1-410b-bd28-6db7ce941208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:38.101345 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da36cd7-65f1-410b-bd28-6db7ce941208 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:38.101622 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da36cd7-65f1-410b-bd28-6db7ce941208 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:38.101901 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da36cd7-65f1-410b-bd28-6db7ce941208 None admin] PATH_INFO: `/v3/services` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:38.102522 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da36cd7-65f1-410b-bd28-6db7ce941208 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:38.102823 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da36cd7-65f1-410b-bd28-6db7ce941208 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:38.104209 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da36cd7-65f1-410b-bd28-6db7ce941208 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:38.109720 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 505/1019] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Oct 4 03:17:37 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:38.116247 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21bae57-79c7-440f-bd59-eb1777f325eb None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:38.216585 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21bae57-79c7-440f-bd59-eb1777f325eb None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:38.250365 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54733100-0520-4a8e-8804-3a5ce30258fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:38.251022 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54733100-0520-4a8e-8804-3a5ce30258fb None admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:38.251302 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54733100-0520-4a8e-8804-3a5ce30258fb None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:38.251600 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54733100-0520-4a8e-8804-3a5ce30258fb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:38.252312 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54733100-0520-4a8e-8804-3a5ce30258fb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:38.253653 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54733100-0520-4a8e-8804-3a5ce30258fb None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:38.283514 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 515/1020] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:17:38 2022] POST /identity/v3/endpoints => generated 334 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 03:17:39.856483 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb3b7fe-bca1-4547-bd29-a9ddd08a62c1 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:39.857018 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb3b7fe-bca1-4547-bd29-a9ddd08a62c1 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:39.857018 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb3b7fe-bca1-4547-bd29-a9ddd08a62c1 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:39.858397 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 506/1021] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:17:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:17:39.863703 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6653e51a-4b7b-41f2-b7c6-28444c8f7e6c None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:39.864589 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6653e51a-4b7b-41f2-b7c6-28444c8f7e6c None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:39.864589 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6653e51a-4b7b-41f2-b7c6-28444c8f7e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:39.882604 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-6653e51a-4b7b-41f2-b7c6-28444c8f7e6c None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:17:39.883818 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-6653e51a-4b7b-41f2-b7c6-28444c8f7e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:17:39.937617 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:39.966149 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 516/1022] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:17:39 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 03:17:40.055566 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312155e8-9eea-48a1-a679-1fb0b7c85a3c None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:40.055920 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312155e8-9eea-48a1-a679-1fb0b7c85a3c None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:40.056117 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312155e8-9eea-48a1-a679-1fb0b7c85a3c None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:40.057488 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 507/1023] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:17:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:17:40.062553 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5dc52e-38c0-4cb5-9e64-213f1c2c09e8 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:40.062842 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5dc52e-38c0-4cb5-9e64-213f1c2c09e8 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:40.063118 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5dc52e-38c0-4cb5-9e64-213f1c2c09e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:40.081838 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-6e5dc52e-38c0-4cb5-9e64-213f1c2c09e8 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:17:40.083060 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-6e5dc52e-38c0-4cb5-9e64-213f1c2c09e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:17:40.149459 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 517/1024] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:17:40 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 03:17:40.240276 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312155e8-9eea-48a1-a679-1fb0b7c85a3c None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:40.344061 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312155e8-9eea-48a1-a679-1fb0b7c85a3c None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:40.378819 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885743ed-72ad-4094-bedf-eafca4e02b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:40.379479 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885743ed-72ad-4094-bedf-eafca4e02b1d None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:40.379788 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885743ed-72ad-4094-bedf-eafca4e02b1d None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:40.380062 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885743ed-72ad-4094-bedf-eafca4e02b1d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:40.381175 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885743ed-72ad-4094-bedf-eafca4e02b1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:40.382590 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885743ed-72ad-4094-bedf-eafca4e02b1d None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:40.384380 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 508/1025] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:17:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:40.389807 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5dc52e-38c0-4cb5-9e64-213f1c2c09e8 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:40.418267 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885743ed-72ad-4094-bedf-eafca4e02b1d None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:40.456200 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:40.499928 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5dc52e-38c0-4cb5-9e64-213f1c2c09e8 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:40.514718 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:40.524105 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885743ed-72ad-4094-bedf-eafca4e02b1d None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:40.543100 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a067d0-fc05-4303-8564-01c53a0859b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:40.543747 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a067d0-fc05-4303-8564-01c53a0859b8 None admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:40.544024 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a067d0-fc05-4303-8564-01c53a0859b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:40.544293 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a067d0-fc05-4303-8564-01c53a0859b8 None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:40.544954 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a067d0-fc05-4303-8564-01c53a0859b8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:40.546364 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a067d0-fc05-4303-8564-01c53a0859b8 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:40.563990 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d21adf-a7a7-4fe5-a356-38892e8985a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:40.564608 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d21adf-a7a7-4fe5-a356-38892e8985a0 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:40.564892 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d21adf-a7a7-4fe5-a356-38892e8985a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:40.565163 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d21adf-a7a7-4fe5-a356-38892e8985a0 None admin] PATH_INFO: `/v3/services/image` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:40.565731 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d21adf-a7a7-4fe5-a356-38892e8985a0 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:40.567159 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d21adf-a7a7-4fe5-a356-38892e8985a0 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:40.567293 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 518/1026] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Oct 4 03:17:40 2022] POST /identity/v3/users => generated 285 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:17:40.568517 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed1b48-6166-4ed9-9e68-bfcc89423230 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:40.568807 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed1b48-6166-4ed9-9e68-bfcc89423230 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:40.569078 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed1b48-6166-4ed9-9e68-bfcc89423230 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:40.570541 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 519/1027] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:17:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:17:40.576207 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92fed8e-3f7d-46cc-893e-549c4a19cbbf None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:40.576494 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92fed8e-3f7d-46cc-893e-549c4a19cbbf None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:40.576769 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92fed8e-3f7d-46cc-893e-549c4a19cbbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:40.587157 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-d2d21adf-a7a7-4fe5-a356-38892e8985a0 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 03:17:40.587157 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:40.587157 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 03:17:40.587157 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 03:17:40.587157 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 03:17:40.587157 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 03:17:40.587157 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 03:17:40.587157 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 03:17:40.587157 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 03:17:40.587157 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:17:40.587157 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 03:17:40.587157 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:17:40.587157 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:40.587157 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:40.587157 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:40.587157 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:40.587157 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:40.588478 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:40.588478 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:40.588478 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:40.588478 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:40.588478 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:40.588478 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:40.588478 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 03:17:40.588478 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 03:17:40.588478 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 03:17:40.588478 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 03:17:40.588478 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:40.588478 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:40.588478 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:40.588478 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:40.588478 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:40.588478 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:40.589649 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:40.589649 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:40.589649 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:40.589649 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:40.589649 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:40.589649 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:40.589649 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:40.589649 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:40.589649 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:40.589649 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:40.589649 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 03:17:40.589649 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 03:17:40.589649 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 03:17:40.589649 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:17:40.593687 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 509/1028] 10.222.0.25 () {56 vars in 1105 bytes} [Tue Oct 4 03:17:40 2022] GET /identity/v3/services/image => generated 86 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 03:17:40.594668 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d21adf-a7a7-4fe5-a356-38892e8985a0 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:40.597153 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-d92fed8e-3f7d-46cc-893e-549c4a19cbbf None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:17:40.599292 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-d92fed8e-3f7d-46cc-893e-549c4a19cbbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:17:40.684196 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 520/1029] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:17:40 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 03:17:40.722390 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:40.727358 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d21adf-a7a7-4fe5-a356-38892e8985a0 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:40.766084 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc7950-3fdf-4d97-8efd-03fa096c0daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:40.766615 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc7950-3fdf-4d97-8efd-03fa096c0daf None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:40.766893 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc7950-3fdf-4d97-8efd-03fa096c0daf None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:40.767163 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc7950-3fdf-4d97-8efd-03fa096c0daf None admin] PATH_INFO: `/v3/services` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:40.767857 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bc7950-3fdf-4d97-8efd-03fa096c0daf None admin] RBAC: Adding query filter params (name=image) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:40.768159 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bc7950-3fdf-4d97-8efd-03fa096c0daf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:40.769505 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bc7950-3fdf-4d97-8efd-03fa096c0daf None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:40.774687 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 510/1030] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:17:40 2022] GET /identity/v3/services?name=image => generated 122 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:40.781256 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92fed8e-3f7d-46cc-893e-549c4a19cbbf None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:40.889044 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:40.893300 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92fed8e-3f7d-46cc-893e-549c4a19cbbf None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:40.930384 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a7238-7ed9-4ae5-9abb-8e7d4d8eb51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:40.930986 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a7238-7ed9-4ae5-9abb-8e7d4d8eb51e None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:40.931270 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a7238-7ed9-4ae5-9abb-8e7d4d8eb51e None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:40.931564 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a7238-7ed9-4ae5-9abb-8e7d4d8eb51e None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:40.932194 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9a7238-7ed9-4ae5-9abb-8e7d4d8eb51e None admin] RBAC: Adding query filter params (type=image) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:40.932502 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9a7238-7ed9-4ae5-9abb-8e7d4d8eb51e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:40.933857 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9a7238-7ed9-4ae5-9abb-8e7d4d8eb51e None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:40.943727 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 521/1031] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:17:40 2022] GET /identity/v3/services?type=image => generated 350 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:40.944675 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc7950-3fdf-4d97-8efd-03fa096c0daf None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:40.957736 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a7238-7ed9-4ae5-9abb-8e7d4d8eb51e None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:41.062632 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a7238-7ed9-4ae5-9abb-8e7d4d8eb51e None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:41.065431 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc7950-3fdf-4d97-8efd-03fa096c0daf None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:41.100078 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43096802-09c1-4aa1-a852-b70376885172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:41.100758 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43096802-09c1-4aa1-a852-b70376885172 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:41.101040 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43096802-09c1-4aa1-a852-b70376885172 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:41.101312 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43096802-09c1-4aa1-a852-b70376885172 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:41.101925 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bb7f86-1005-4197-86e6-b92b430bce3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:41.102497 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb7f86-1005-4197-86e6-b92b430bce3d None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:41.102777 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb7f86-1005-4197-86e6-b92b430bce3d None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:41.103046 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb7f86-1005-4197-86e6-b92b430bce3d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:41.103762 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bb7f86-1005-4197-86e6-b92b430bce3d None admin] RBAC: Adding query filter params (interface=public, service_id=4e26ad529f9a47d8974c15d79bfc5252, region_id=RegionOne) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:41.104066 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bb7f86-1005-4197-86e6-b92b430bce3d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:41.105464 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bb7f86-1005-4197-86e6-b92b430bce3d None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:41.115982 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 511/1032] 10.222.0.25 () {56 vars in 1251 bytes} [Tue Oct 4 03:17:40 2022] GET /identity/v3/endpoints?service_id=4e26ad529f9a47d8974c15d79bfc5252&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:41.116146 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43096802-09c1-4aa1-a852-b70376885172 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:17:41.117026 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bb7f86-1005-4197-86e6-b92b430bce3d None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:41.118163 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-43096802-09c1-4aa1-a852-b70376885172 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 03:17:41.118163 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:41.118163 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:41.118163 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:41.118163 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:41.118163 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:41.118163 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:41.118163 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:41.118163 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:41.118163 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:41.118163 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:41.118163 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:41.118163 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:17:41.118163 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:17:41.118163 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:17:41.118163 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:17:41.119087 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:17:41.119087 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:17:41.119087 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:17:41.119087 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:17:41.119087 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:41.119087 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:41.119087 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:41.119087 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:41.119087 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:41.119087 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:41.119087 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:41.119087 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:41.119087 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:41.119087 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:41.119087 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:41.119087 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:41.120005 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:41.120005 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:41.120005 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:41.120005 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:41.120005 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:17:41.120005 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:17:41.120005 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:17:41.120005 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:17:41.120005 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:17:41.120005 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:17:41.120005 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 03:17:41.120005 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:17:41.120005 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 522/1033] 10.222.0.25 () {56 vars in 1120 bytes} [Tue Oct 4 03:17:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 03:17:41.125849 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43096802-09c1-4aa1-a852-b70376885172 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:41.153671 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:41.158279 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:41.241826 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43096802-09c1-4aa1-a852-b70376885172 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:41.245045 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bb7f86-1005-4197-86e6-b92b430bce3d None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:41.280297 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89382b12-2f36-4a83-b356-6058b8dc735a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:41.280523 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877d7966-ff55-4546-b402-b1dd532ca784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:41.280899 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89382b12-2f36-4a83-b356-6058b8dc735a None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:41.281020 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877d7966-ff55-4546-b402-b1dd532ca784 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:41.281175 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89382b12-2f36-4a83-b356-6058b8dc735a None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:41.281271 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877d7966-ff55-4546-b402-b1dd532ca784 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:41.281471 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877d7966-ff55-4546-b402-b1dd532ca784 None admin] PATH_INFO: `/v3/services` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:41.281567 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89382b12-2f36-4a83-b356-6058b8dc735a None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:41.282074 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877d7966-ff55-4546-b402-b1dd532ca784 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:41.282171 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89382b12-2f36-4a83-b356-6058b8dc735a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:41.282429 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89382b12-2f36-4a83-b356-6058b8dc735a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:41.283430 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877d7966-ff55-4546-b402-b1dd532ca784 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:41.283807 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89382b12-2f36-4a83-b356-6058b8dc735a None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:41.291879 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 512/1034] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Oct 4 03:17:41 2022] GET /identity/v3/services => generated 1957 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:17:41.295539 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 523/1035] 10.222.0.25 () {56 vars in 1115 bytes} [Tue Oct 4 03:17:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:17:41.303382 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877d7966-ff55-4546-b402-b1dd532ca784 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:41.408036 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:41.419795 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877d7966-ff55-4546-b402-b1dd532ca784 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:41.457037 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057ff12d-7fd8-48e5-88db-0d13f54d3abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:41.458193 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ff12d-7fd8-48e5-88db-0d13f54d3abb None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:41.458476 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ff12d-7fd8-48e5-88db-0d13f54d3abb None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:41.458751 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ff12d-7fd8-48e5-88db-0d13f54d3abb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:41.470536 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057ff12d-7fd8-48e5-88db-0d13f54d3abb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:41.472024 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057ff12d-7fd8-48e5-88db-0d13f54d3abb None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:41.487418 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-057ff12d-7fd8-48e5-88db-0d13f54d3abb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:17:41.487418 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:41.487418 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:41.487418 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:41.487418 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:41.487418 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:41.487418 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:41.487418 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:41.487418 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:41.487418 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:41.487418 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:41.487418 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:41.487418 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 03:17:41.487418 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 03:17:41.487418 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 03:17:41.487418 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 03:17:41.488584 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:41.488584 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:41.488584 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:41.488584 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:41.488584 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:41.488584 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:41.488584 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:41.488584 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:41.488584 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:41.488584 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:41.488584 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:41.488584 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:41.488584 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:41.488584 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:41.488584 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:41.488584 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:41.488584 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 03:17:41.490227 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 03:17:41.490227 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:17:41.490227 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:17:41.491643 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 513/1036] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:17:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:17:41.497441 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89382b12-2f36-4a83-b356-6058b8dc735a None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:41.586734 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:41.604711 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89382b12-2f36-4a83-b356-6058b8dc735a None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:41.646318 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab720dfb-3fd6-492a-a75b-e2836f633035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:41.646932 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab720dfb-3fd6-492a-a75b-e2836f633035 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:41.647216 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab720dfb-3fd6-492a-a75b-e2836f633035 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:41.647506 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab720dfb-3fd6-492a-a75b-e2836f633035 None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:41.648169 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab720dfb-3fd6-492a-a75b-e2836f633035 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:41.648476 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab720dfb-3fd6-492a-a75b-e2836f633035 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:41.649875 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab720dfb-3fd6-492a-a75b-e2836f633035 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:41.667596 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 524/1037] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 03:17:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:17:41.669391 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057ff12d-7fd8-48e5-88db-0d13f54d3abb None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:41.769301 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057ff12d-7fd8-48e5-88db-0d13f54d3abb None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:41.805130 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f897dec-de9d-4063-9325-b9679a4ea815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:41.805751 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f897dec-de9d-4063-9325-b9679a4ea815 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:41.806030 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f897dec-de9d-4063-9325-b9679a4ea815 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:41.806300 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f897dec-de9d-4063-9325-b9679a4ea815 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:41.814386 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f897dec-de9d-4063-9325-b9679a4ea815 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:41.815842 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f897dec-de9d-4063-9325-b9679a4ea815 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:41.827331 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-8f897dec-de9d-4063-9325-b9679a4ea815 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 03:17:41.827331 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:41.827331 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:41.827331 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:41.827331 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:41.827331 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:41.827331 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:41.827331 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:41.827331 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:41.827331 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:41.827331 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:41.827331 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:41.827331 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 03:17:41.827331 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 03:17:41.827331 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 03:17:41.827331 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 03:17:41.828420 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:41.828420 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:41.828420 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 03:17:41.828420 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 03:17:41.828420 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 03:17:41.828420 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 03:17:41.828420 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:41.828420 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:41.828420 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:41.828420 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:41.828420 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:41.828420 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:41.828420 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:41.828420 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:41.828420 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:41.828420 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:41.828420 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:41.828420 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:41.829390 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:41.829390 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:41.829390 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 03:17:41.829390 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 03:17:41.829390 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 03:17:41.829390 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 03:17:41.829390 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 03:17:41.829390 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 03:17:41.829390 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 03:17:41.829390 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:17:41.833393 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 514/1038] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Oct 4 03:17:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:17:41.834504 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab720dfb-3fd6-492a-a75b-e2836f633035 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:41.935858 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab720dfb-3fd6-492a-a75b-e2836f633035 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:41.970301 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819215ac-97f3-4d39-a4b1-941a1d5951b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:41.970909 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819215ac-97f3-4d39-a4b1-941a1d5951b3 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:41.971191 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819215ac-97f3-4d39-a4b1-941a1d5951b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:41.971466 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819215ac-97f3-4d39-a4b1-941a1d5951b3 None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:41.972214 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819215ac-97f3-4d39-a4b1-941a1d5951b3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:41.972523 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819215ac-97f3-4d39-a4b1-941a1d5951b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:41.974584 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819215ac-97f3-4d39-a4b1-941a1d5951b3 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:41.997365 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 525/1039] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Oct 4 03:17:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:17:41.998850 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f897dec-de9d-4063-9325-b9679a4ea815 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:42.001843 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:42.100695 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f897dec-de9d-4063-9325-b9679a4ea815 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:42.133341 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a5f9c6-0406-46b0-9f23-329640d53224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:42.134050 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5f9c6-0406-46b0-9f23-329640d53224 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:42.134249 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5f9c6-0406-46b0-9f23-329640d53224 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:42.134493 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5f9c6-0406-46b0-9f23-329640d53224 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:42.203957 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a5f9c6-0406-46b0-9f23-329640d53224 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:42.205325 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a5f9c6-0406-46b0-9f23-329640d53224 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:42.207170 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:42.313371 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 515/1040] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 03:17:41 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 04 03:17:42.314698 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819215ac-97f3-4d39-a4b1-941a1d5951b3 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:42.317610 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:42.416674 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819215ac-97f3-4d39-a4b1-941a1d5951b3 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:42.452169 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f890ea00-3062-4714-9531-ac3317522114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:42.453158 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f890ea00-3062-4714-9531-ac3317522114 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:42.453645 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f890ea00-3062-4714-9531-ac3317522114 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:42.454225 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f890ea00-3062-4714-9531-ac3317522114 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:42.464576 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f890ea00-3062-4714-9531-ac3317522114 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:42.466303 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f890ea00-3062-4714-9531-ac3317522114 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:42.481513 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-f890ea00-3062-4714-9531-ac3317522114 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:17:42.481513 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:42.481513 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:42.481513 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:42.481513 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:42.481513 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:42.481513 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:42.481513 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:42.481513 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:42.481513 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:42.481513 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:42.481513 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:42.481513 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 03:17:42.481513 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 03:17:42.481513 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 03:17:42.481513 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 03:17:42.482574 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:42.482574 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:42.482574 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:42.482574 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:42.482574 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:42.482574 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:42.482574 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:42.482574 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:42.482574 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:42.482574 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:42.482574 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:42.482574 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:42.482574 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:42.482574 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:42.482574 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:42.482574 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:42.482574 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 03:17:42.488180 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 03:17:42.488180 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:17:42.488180 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:17:42.488180 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 526/1041] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:17:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:17:42.489483 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a5f9c6-0406-46b0-9f23-329640d53224 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:42.592073 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a5f9c6-0406-46b0-9f23-329640d53224 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:42.593608 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:42.628366 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cb4335-122b-4649-8d10-128770f9710c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:42.628966 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb4335-122b-4649-8d10-128770f9710c None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:42.629271 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb4335-122b-4649-8d10-128770f9710c None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:42.629628 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb4335-122b-4649-8d10-128770f9710c None admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:42.631536 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cb4335-122b-4649-8d10-128770f9710c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:42.631536 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cb4335-122b-4649-8d10-128770f9710c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:42.633072 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cb4335-122b-4649-8d10-128770f9710c None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:42.649172 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 516/1042] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 03:17:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:42.654995 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f890ea00-3062-4714-9531-ac3317522114 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:42.712689 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:42.763970 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f890ea00-3062-4714-9531-ac3317522114 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:42.798515 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e79b24-afc5-4aad-a1dd-6b6897d87145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:42.799187 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e79b24-afc5-4aad-a1dd-6b6897d87145 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:42.799466 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e79b24-afc5-4aad-a1dd-6b6897d87145 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:42.799760 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e79b24-afc5-4aad-a1dd-6b6897d87145 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:42.807142 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e79b24-afc5-4aad-a1dd-6b6897d87145 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:42.808578 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e79b24-afc5-4aad-a1dd-6b6897d87145 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:42.819638 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-44e79b24-afc5-4aad-a1dd-6b6897d87145 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 03:17:42.819638 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:42.819638 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:42.819638 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:42.819638 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:42.819638 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:42.819638 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:42.819638 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:42.819638 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:42.819638 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:42.819638 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:42.819638 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:42.819638 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 03:17:42.819638 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 03:17:42.819638 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 03:17:42.820788 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 03:17:42.820788 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:42.820788 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:42.820788 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:42.820788 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:42.820788 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:42.820788 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:42.820788 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:42.820788 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:42.820788 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:42.820788 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:42.820788 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:42.820788 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:42.820788 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:42.820788 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:42.820788 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:42.820788 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:42.826496 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 03:17:42.826496 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 03:17:42.826496 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 03:17:42.826496 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 03:17:42.826496 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 03:17:42.826496 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 03:17:42.826496 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 03:17:42.826496 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:17:42.826496 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 527/1043] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 03:17:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 03:17:42.828579 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cb4335-122b-4649-8d10-128770f9710c None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:42.860650 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac101adf-35f6-4986-a331-acd467c15519 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:42.860993 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac101adf-35f6-4986-a331-acd467c15519 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:42.861209 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac101adf-35f6-4986-a331-acd467c15519 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:42.863311 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 528/1044] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:17:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 03:17:42.870087 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a19a3-4199-48b2-9a2b-7eca63c234d8 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:42.870625 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a19a3-4199-48b2-9a2b-7eca63c234d8 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:42.871104 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a19a3-4199-48b2-9a2b-7eca63c234d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:42.895594 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-aa7a19a3-4199-48b2-9a2b-7eca63c234d8 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:17:42.897147 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-aa7a19a3-4199-48b2-9a2b-7eca63c234d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:17:42.939886 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cb4335-122b-4649-8d10-128770f9710c None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:42.972771 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 529/1045] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:17:42 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 03:17:42.981135 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9792c4-b28b-4478-8151-ba92c02ffe9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:42.981744 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9792c4-b28b-4478-8151-ba92c02ffe9a None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:42.982032 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9792c4-b28b-4478-8151-ba92c02ffe9a None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:42.982309 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9792c4-b28b-4478-8151-ba92c02ffe9a None admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:42.983000 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9792c4-b28b-4478-8151-ba92c02ffe9a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:42.983307 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9792c4-b28b-4478-8151-ba92c02ffe9a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:42.984760 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9792c4-b28b-4478-8151-ba92c02ffe9a None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:43.002677 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 517/1046] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 4 03:17:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:43.005668 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7a19a3-4199-48b2-9a2b-7eca63c234d8 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:43.053414 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:43.109269 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7a19a3-4199-48b2-9a2b-7eca63c234d8 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:43.144510 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d74864-63a1-40ca-84bd-e4ec14f4ef37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:43.145251 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d74864-63a1-40ca-84bd-e4ec14f4ef37 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:43.145668 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d74864-63a1-40ca-84bd-e4ec14f4ef37 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:43.146026 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d74864-63a1-40ca-84bd-e4ec14f4ef37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:43.146750 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d74864-63a1-40ca-84bd-e4ec14f4ef37 None admin] RBAC: Adding query filter params (role.id=8d45a720a6c14675a3504853645b8e22, scope.project.id=80ae15e46620470b9c55fb7fe300fcb6, user.id=2c1f412befb9418fa66a2aabf475aa90) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:43.147061 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d74864-63a1-40ca-84bd-e4ec14f4ef37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:43.148500 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d74864-63a1-40ca-84bd-e4ec14f4ef37 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:43.159736 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 530/1047] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 03:17:43 2022] GET /identity/v3/role_assignments?user.id=2c1f412befb9418fa66a2aabf475aa90&scope.project.id=80ae15e46620470b9c55fb7fe300fcb6&role.id=8d45a720a6c14675a3504853645b8e22 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:17:43.259246 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9792c4-b28b-4478-8151-ba92c02ffe9a None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:43.285911 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:43.372154 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9792c4-b28b-4478-8151-ba92c02ffe9a None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:43.409379 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809068e5-a9fd-4f19-8297-2e680424d56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:43.410005 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809068e5-a9fd-4f19-8297-2e680424d56d None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:43.410282 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809068e5-a9fd-4f19-8297-2e680424d56d None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:43.410590 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809068e5-a9fd-4f19-8297-2e680424d56d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:43.421230 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809068e5-a9fd-4f19-8297-2e680424d56d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:17:43.425976 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-809068e5-a9fd-4f19-8297-2e680424d56d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 03:17:43.425976 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:43.425976 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:43.425976 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:43.425976 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:43.425976 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:43.425976 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:43.425976 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:43.425976 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:43.425976 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:43.425976 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:43.425976 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:43.425976 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:17:43.425976 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:17:43.425976 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:17:43.425976 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:17:43.427381 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:17:43.427381 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:17:43.427381 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:17:43.427381 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:17:43.427381 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:43.427381 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:43.427381 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:43.427381 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:43.427381 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:43.427381 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:43.427381 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:43.427381 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:43.427381 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:43.427381 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:43.427381 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:43.427381 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:43.428551 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:43.428551 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:43.428551 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:43.428551 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:43.428551 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:17:43.428551 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:17:43.428551 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:17:43.428551 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:17:43.428551 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:17:43.428551 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:17:43.428551 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 03:17:43.428551 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:17:43.428551 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 518/1048] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 4 03:17:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:17:43.435207 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d74864-63a1-40ca-84bd-e4ec14f4ef37 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:43.482491 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02638af3-4ac5-4eb1-ac04-815f874d8437 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:43.482821 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02638af3-4ac5-4eb1-ac04-815f874d8437 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:43.483041 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02638af3-4ac5-4eb1-ac04-815f874d8437 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:43.484517 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 519/1049] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:17:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 03:17:43.489494 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b28c8-b8a6-41eb-acc1-8a50912d2473 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:43.489700 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b28c8-b8a6-41eb-acc1-8a50912d2473 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:43.489953 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b28c8-b8a6-41eb-acc1-8a50912d2473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:43.507921 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-617b28c8-b8a6-41eb-acc1-8a50912d2473 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:17:43.509102 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-617b28c8-b8a6-41eb-acc1-8a50912d2473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:17:43.543648 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d74864-63a1-40ca-84bd-e4ec14f4ef37 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:43.553670 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:43.579920 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8513991-377d-474c-9bb8-01d41742f312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:43.580511 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8513991-377d-474c-9bb8-01d41742f312 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:43.580791 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8513991-377d-474c-9bb8-01d41742f312 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:43.581166 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8513991-377d-474c-9bb8-01d41742f312 None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:43.581738 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8513991-377d-474c-9bb8-01d41742f312 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:43.582037 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8513991-377d-474c-9bb8-01d41742f312 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:43.583511 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8513991-377d-474c-9bb8-01d41742f312 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:43.596611 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 531/1050] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 03:17:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:43.596792 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 520/1051] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:17:43 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 03:17:43.604458 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8513991-377d-474c-9bb8-01d41742f312 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:43.710729 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8513991-377d-474c-9bb8-01d41742f312 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:43.745272 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c13ea2-8529-4ce6-91a4-08287eade89b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:43.745894 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c13ea2-8529-4ce6-91a4-08287eade89b None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:43.746176 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c13ea2-8529-4ce6-91a4-08287eade89b None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:43.746449 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c13ea2-8529-4ce6-91a4-08287eade89b None admin] PATH_INFO: `/v3/users/a712ac52611145a4a2f9cece80ce99b7` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:43.760488 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c13ea2-8529-4ce6-91a4-08287eade89b None admin] RBAC: Authorizing `identity:get_user(user_id=a712ac52611145a4a2f9cece80ce99b7)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:43.761976 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c13ea2-8529-4ce6-91a4-08287eade89b None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:43.763790 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 532/1052] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 03:17:43 2022] GET /identity/v3/users/a712ac52611145a4a2f9cece80ce99b7 => generated 285 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:43.769468 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b28c8-b8a6-41eb-acc1-8a50912d2473 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:43.784836 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:43.860242 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c13ea2-8529-4ce6-91a4-08287eade89b None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:43.872093 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b28c8-b8a6-41eb-acc1-8a50912d2473 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:43.889383 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:43.908965 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90306257-9bbd-45b8-942e-dbc5b3b101e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:43.909559 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90306257-9bbd-45b8-942e-dbc5b3b101e8 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:43.909844 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90306257-9bbd-45b8-942e-dbc5b3b101e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:43.910120 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90306257-9bbd-45b8-942e-dbc5b3b101e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:43.970303 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c13ea2-8529-4ce6-91a4-08287eade89b None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:43.979663 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90306257-9bbd-45b8-942e-dbc5b3b101e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:43.981111 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90306257-9bbd-45b8-942e-dbc5b3b101e8 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:43.994409 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:44.008343 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814ef98a-2d6f-4ce5-b955-355c42190259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:44.008984 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ef98a-2d6f-4ce5-b955-355c42190259 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:44.009224 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ef98a-2d6f-4ce5-b955-355c42190259 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:44.009495 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ef98a-2d6f-4ce5-b955-355c42190259 None admin] PATH_INFO: `/v3/services/image` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:44.010074 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814ef98a-2d6f-4ce5-b955-355c42190259 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:44.011433 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814ef98a-2d6f-4ce5-b955-355c42190259 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:44.020512 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-814ef98a-2d6f-4ce5-b955-355c42190259 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 03:17:44.020512 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:44.020512 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 03:17:44.020512 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 03:17:44.020512 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 03:17:44.020512 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 03:17:44.020512 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 03:17:44.020512 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 03:17:44.020512 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 03:17:44.020512 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:17:44.020512 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 03:17:44.020512 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:17:44.020512 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:44.020512 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:44.020512 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:44.020512 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:44.020512 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:44.021510 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:44.021510 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:44.021510 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:44.021510 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:44.021510 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:44.021510 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:44.021510 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 03:17:44.021510 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 03:17:44.021510 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 03:17:44.021510 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 03:17:44.021510 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:44.021510 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:44.021510 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:44.021510 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:44.021510 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:44.021510 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:44.022359 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:44.022359 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:44.022359 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:44.022359 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:44.022359 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:44.022359 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:44.022359 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:44.022359 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:44.022359 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:44.022359 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:44.022359 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 03:17:44.022359 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 03:17:44.022359 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 03:17:44.022359 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:17:44.022359 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 533/1053] 10.222.0.25 () {56 vars in 1105 bytes} [Tue Oct 4 03:17:43 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 03:17:44.027936 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814ef98a-2d6f-4ce5-b955-355c42190259 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:44.094019 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 521/1054] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 03:17:43 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 03:17:44.100343 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90306257-9bbd-45b8-942e-dbc5b3b101e8 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:44.134473 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:44.143423 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814ef98a-2d6f-4ce5-b955-355c42190259 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:44.180446 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccd960e-a17f-4df0-bb53-4b1c19e683f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:44.181049 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd960e-a17f-4df0-bb53-4b1c19e683f0 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:44.181333 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd960e-a17f-4df0-bb53-4b1c19e683f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:44.181609 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd960e-a17f-4df0-bb53-4b1c19e683f0 None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:44.182245 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccd960e-a17f-4df0-bb53-4b1c19e683f0 None admin] RBAC: Adding query filter params (name=image) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:44.182549 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccd960e-a17f-4df0-bb53-4b1c19e683f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:44.183938 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccd960e-a17f-4df0-bb53-4b1c19e683f0 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:44.190002 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 534/1055] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:17:44 2022] GET /identity/v3/services?name=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:17:44.195509 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccd960e-a17f-4df0-bb53-4b1c19e683f0 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:44.212710 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90306257-9bbd-45b8-942e-dbc5b3b101e8 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:44.227513 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:44.252100 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5cf997-fe52-41bc-8d31-e8243ff541a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:44.252728 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5cf997-fe52-41bc-8d31-e8243ff541a9 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:44.253008 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5cf997-fe52-41bc-8d31-e8243ff541a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:44.253285 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5cf997-fe52-41bc-8d31-e8243ff541a9 None admin] PATH_INFO: `/v3/projects/ec443268285846be8ec6531cd3cb4aef` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:44.254449 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5cf997-fe52-41bc-8d31-e8243ff541a9 None admin] RBAC: Authorizing `identity:get_project(project_id=ec443268285846be8ec6531cd3cb4aef)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:44.256148 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5cf997-fe52-41bc-8d31-e8243ff541a9 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:44.258115 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 522/1056] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 03:17:44 2022] GET /identity/v3/projects/ec443268285846be8ec6531cd3cb4aef => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:17:44.263754 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5cf997-fe52-41bc-8d31-e8243ff541a9 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:44.309953 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccd960e-a17f-4df0-bb53-4b1c19e683f0 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:44.345482 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b276c27-93dc-4a45-8f6c-314775dea2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:44.346178 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b276c27-93dc-4a45-8f6c-314775dea2ab None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:44.346471 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b276c27-93dc-4a45-8f6c-314775dea2ab None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:44.346747 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b276c27-93dc-4a45-8f6c-314775dea2ab None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:44.347379 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b276c27-93dc-4a45-8f6c-314775dea2ab None admin] RBAC: Adding query filter params (type=image) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:44.347718 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b276c27-93dc-4a45-8f6c-314775dea2ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:44.349204 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b276c27-93dc-4a45-8f6c-314775dea2ab None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:44.355138 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 535/1057] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:17:44 2022] GET /identity/v3/services?type=image => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:17:44.360508 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b276c27-93dc-4a45-8f6c-314775dea2ab None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:44.375440 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5cf997-fe52-41bc-8d31-e8243ff541a9 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:44.385192 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:44.414909 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d055d0b-f0e9-41d8-9cf0-1d3806135e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:44.415467 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d055d0b-f0e9-41d8-9cf0-1d3806135e9a None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:44.415835 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d055d0b-f0e9-41d8-9cf0-1d3806135e9a None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:44.416315 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d055d0b-f0e9-41d8-9cf0-1d3806135e9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:44.416865 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d055d0b-f0e9-41d8-9cf0-1d3806135e9a None admin] RBAC: Adding query filter params (role.id=fe9379cda35c4ff78576fe48b60bea3c, scope.project.id=ec443268285846be8ec6531cd3cb4aef, user.id=a712ac52611145a4a2f9cece80ce99b7) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:44.417179 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d055d0b-f0e9-41d8-9cf0-1d3806135e9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:44.418594 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d055d0b-f0e9-41d8-9cf0-1d3806135e9a None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:44.424534 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 523/1058] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 03:17:44 2022] GET /identity/v3/role_assignments?user.id=a712ac52611145a4a2f9cece80ce99b7&scope.project.id=ec443268285846be8ec6531cd3cb4aef&role.id=fe9379cda35c4ff78576fe48b60bea3c => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:17:44.474142 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b276c27-93dc-4a45-8f6c-314775dea2ab None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:44.511787 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fefeee-a760-424f-8492-49c4a3ab1a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:44.512410 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fefeee-a760-424f-8492-49c4a3ab1a34 None admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:44.512694 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fefeee-a760-424f-8492-49c4a3ab1a34 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:44.512969 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fefeee-a760-424f-8492-49c4a3ab1a34 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:44.513646 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fefeee-a760-424f-8492-49c4a3ab1a34 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:44.515026 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fefeee-a760-424f-8492-49c4a3ab1a34 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:44.547518 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 536/1059] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:17:44 2022] POST /identity/v3/endpoints => generated 327 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 03:17:45.322583 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b45417-735f-42a8-beec-5867dd69b6f6 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:45.323171 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b45417-735f-42a8-beec-5867dd69b6f6 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:45.323171 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b45417-735f-42a8-beec-5867dd69b6f6 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:45.324817 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 524/1060] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:17:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:17:45.330505 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49319cc5-7fbc-483f-b6ad-9e7674d40b07 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:45.330991 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49319cc5-7fbc-483f-b6ad-9e7674d40b07 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:45.331150 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49319cc5-7fbc-483f-b6ad-9e7674d40b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:45.350391 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-49319cc5-7fbc-483f-b6ad-9e7674d40b07 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:17:45.351596 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-49319cc5-7fbc-483f-b6ad-9e7674d40b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:17:45.422950 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 537/1061] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:17:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 03:17:45.689672 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b45417-735f-42a8-beec-5867dd69b6f6 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:45.738685 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:45.796214 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b45417-735f-42a8-beec-5867dd69b6f6 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:45.831023 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275042af-f344-4a61-888a-4caa0b01cad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:45.831680 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275042af-f344-4a61-888a-4caa0b01cad6 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:45.831962 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275042af-f344-4a61-888a-4caa0b01cad6 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:45.832233 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275042af-f344-4a61-888a-4caa0b01cad6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:45.842972 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275042af-f344-4a61-888a-4caa0b01cad6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:17:45.847676 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-275042af-f344-4a61-888a-4caa0b01cad6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 03:17:45.847676 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:45.847676 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:45.847676 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:45.847676 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:45.847676 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:45.847676 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:45.847676 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:45.847676 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:45.847676 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:45.847676 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:45.847676 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:45.847676 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:17:45.847676 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:17:45.847676 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:17:45.847676 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:17:45.849291 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:17:45.849291 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:17:45.849291 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:17:45.849291 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:17:45.849291 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:45.849291 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:45.849291 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:45.849291 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:45.849291 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:45.849291 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:45.849291 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:45.849291 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:45.849291 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:45.849291 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:45.849291 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:45.849291 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:45.850145 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:45.850145 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:45.850145 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:45.850145 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:45.850145 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:17:45.850145 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:17:45.850145 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:17:45.850145 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:17:45.850145 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:17:45.850145 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:17:45.850145 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 03:17:45.850145 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:17:45.851394 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 525/1062] 10.222.0.25 () {56 vars in 1120 bytes} [Tue Oct 4 03:17:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:17:45.855237 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49319cc5-7fbc-483f-b6ad-9e7674d40b07 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:45.857423 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:45.955712 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49319cc5-7fbc-483f-b6ad-9e7674d40b07 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:45.989795 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840fcc48-02bf-4210-be18-2f52c9b0c02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:45.990438 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840fcc48-02bf-4210-be18-2f52c9b0c02d None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:45.990719 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840fcc48-02bf-4210-be18-2f52c9b0c02d None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:45.990987 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840fcc48-02bf-4210-be18-2f52c9b0c02d None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:45.991682 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840fcc48-02bf-4210-be18-2f52c9b0c02d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:45.991983 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840fcc48-02bf-4210-be18-2f52c9b0c02d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:45.993329 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840fcc48-02bf-4210-be18-2f52c9b0c02d None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:46.006628 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 538/1063] 10.222.0.25 () {56 vars in 1115 bytes} [Tue Oct 4 03:17:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:46.007425 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275042af-f344-4a61-888a-4caa0b01cad6 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:46.108911 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275042af-f344-4a61-888a-4caa0b01cad6 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:46.111225 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:46.145617 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec548c-ca28-4dba-9abe-0039059b4228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:46.146290 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec548c-ca28-4dba-9abe-0039059b4228 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:46.146577 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec548c-ca28-4dba-9abe-0039059b4228 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:46.146850 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec548c-ca28-4dba-9abe-0039059b4228 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:46.156842 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceec548c-ca28-4dba-9abe-0039059b4228 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:46.158286 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceec548c-ca28-4dba-9abe-0039059b4228 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:46.173011 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-ceec548c-ca28-4dba-9abe-0039059b4228 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:17:46.173011 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:46.173011 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:46.173011 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:46.173011 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:46.173011 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:46.173011 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:46.173011 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:46.173011 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:46.173011 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:46.173011 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:46.173011 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:46.173011 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 03:17:46.173011 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 03:17:46.173011 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 03:17:46.173011 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 03:17:46.173994 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:46.173994 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:46.173994 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:46.173994 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:46.173994 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:46.173994 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:46.173994 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:46.173994 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:46.173994 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:46.173994 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:46.173994 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:46.173994 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:46.173994 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:46.173994 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:46.173994 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:46.173994 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:46.173994 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 03:17:46.174883 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 03:17:46.174883 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:17:46.174883 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:17:46.174883 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 526/1064] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:17:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:17:46.181056 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840fcc48-02bf-4210-be18-2f52c9b0c02d None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:46.244576 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:46.284089 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840fcc48-02bf-4210-be18-2f52c9b0c02d None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:46.317638 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e450a9-d7c8-4ed4-ab9e-f3c27c97596a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:46.318300 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e450a9-d7c8-4ed4-ab9e-f3c27c97596a None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:46.318587 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e450a9-d7c8-4ed4-ab9e-f3c27c97596a None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:46.318862 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e450a9-d7c8-4ed4-ab9e-f3c27c97596a None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:46.319508 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e450a9-d7c8-4ed4-ab9e-f3c27c97596a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:46.320082 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e450a9-d7c8-4ed4-ab9e-f3c27c97596a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:46.321443 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e450a9-d7c8-4ed4-ab9e-f3c27c97596a None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:46.338419 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 539/1065] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 03:17:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:17:46.340117 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec548c-ca28-4dba-9abe-0039059b4228 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:46.441093 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec548c-ca28-4dba-9abe-0039059b4228 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:46.475729 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a249f1f8-f73b-4061-b4d2-868b9ad6ad83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:46.476361 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a249f1f8-f73b-4061-b4d2-868b9ad6ad83 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:46.476647 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a249f1f8-f73b-4061-b4d2-868b9ad6ad83 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:46.476921 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a249f1f8-f73b-4061-b4d2-868b9ad6ad83 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:46.484677 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a249f1f8-f73b-4061-b4d2-868b9ad6ad83 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:46.486142 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a249f1f8-f73b-4061-b4d2-868b9ad6ad83 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:46.499383 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-a249f1f8-f73b-4061-b4d2-868b9ad6ad83 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 03:17:46.499383 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:46.499383 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:46.499383 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:46.499383 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:46.499383 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:46.499383 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:46.499383 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:46.499383 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:46.499383 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:46.499383 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:46.499383 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:46.499383 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 03:17:46.499383 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 03:17:46.499383 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 03:17:46.499383 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 03:17:46.500440 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:46.500440 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:46.500440 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 03:17:46.500440 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 03:17:46.500440 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 03:17:46.500440 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 03:17:46.500440 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:46.500440 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:46.500440 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:46.500440 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:46.500440 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:46.500440 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:46.500440 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:46.500440 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:46.500440 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:46.500440 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:46.500440 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:46.500440 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:46.501385 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:46.501385 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:46.501385 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 03:17:46.501385 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 03:17:46.501385 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 03:17:46.501385 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 03:17:46.501385 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 03:17:46.501385 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 03:17:46.501385 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 03:17:46.501385 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:17:46.501385 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 527/1066] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Oct 4 03:17:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:17:46.508676 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e450a9-d7c8-4ed4-ab9e-f3c27c97596a None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:46.609122 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e450a9-d7c8-4ed4-ab9e-f3c27c97596a None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:46.611147 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72771d96-3ed9-4817-a6d7-58744a8ef774 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:46.611438 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72771d96-3ed9-4817-a6d7-58744a8ef774 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:46.611741 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72771d96-3ed9-4817-a6d7-58744a8ef774 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:46.613116 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 528/1067] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:17:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 03:17:46.619093 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a872c60-3114-4c8c-bdcd-04c598784c73 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:46.619379 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a872c60-3114-4c8c-bdcd-04c598784c73 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:46.619688 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a872c60-3114-4c8c-bdcd-04c598784c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:46.639167 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-9a872c60-3114-4c8c-bdcd-04c598784c73 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:17:46.640541 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-9a872c60-3114-4c8c-bdcd-04c598784c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:17:46.645227 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:46.652967 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:46.660804 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc44f2a-760a-4c12-b08d-37545a204575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:46.661506 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc44f2a-760a-4c12-b08d-37545a204575 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:46.661804 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc44f2a-760a-4c12-b08d-37545a204575 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:46.662068 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc44f2a-760a-4c12-b08d-37545a204575 None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:46.662876 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc44f2a-760a-4c12-b08d-37545a204575 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:46.663186 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc44f2a-760a-4c12-b08d-37545a204575 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:46.664709 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc44f2a-760a-4c12-b08d-37545a204575 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:46.693220 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 540/1068] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Oct 4 03:17:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:17:46.694468 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc44f2a-760a-4c12-b08d-37545a204575 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:46.729464 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 529/1069] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:17:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 03:17:46.791242 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bb4305-3bb9-4b05-a80f-93d8685ca0e1 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:46.791808 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bb4305-3bb9-4b05-a80f-93d8685ca0e1 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:46.792079 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bb4305-3bb9-4b05-a80f-93d8685ca0e1 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:46.793427 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 530/1070] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:17:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 03:17:46.798336 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774caf6-77e5-4d3a-9a39-baa4d4af35e4 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:46.798622 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774caf6-77e5-4d3a-9a39-baa4d4af35e4 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:46.798897 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774caf6-77e5-4d3a-9a39-baa4d4af35e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:46.799376 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc44f2a-760a-4c12-b08d-37545a204575 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:46.817168 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-4774caf6-77e5-4d3a-9a39-baa4d4af35e4 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:17:46.818541 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-4774caf6-77e5-4d3a-9a39-baa4d4af35e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:17:46.835649 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18573d98-2d85-4a22-80b8-dbb4f3229634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:46.836280 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18573d98-2d85-4a22-80b8-dbb4f3229634 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:46.836564 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18573d98-2d85-4a22-80b8-dbb4f3229634 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:46.836836 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18573d98-2d85-4a22-80b8-dbb4f3229634 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:46.847595 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18573d98-2d85-4a22-80b8-dbb4f3229634 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:46.849527 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18573d98-2d85-4a22-80b8-dbb4f3229634 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:46.865423 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-18573d98-2d85-4a22-80b8-dbb4f3229634 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:17:46.865423 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:46.865423 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:46.865423 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:46.865423 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:46.865423 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:46.865423 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:46.865423 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:46.865423 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:46.865423 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:46.865423 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:46.865423 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:46.865423 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 03:17:46.865423 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 03:17:46.865423 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 03:17:46.865423 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 03:17:46.866397 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:46.866397 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:46.866397 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:46.866397 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:46.866397 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:46.866397 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:46.866397 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:46.866397 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:46.866397 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:46.866397 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:46.866397 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:46.866397 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:46.866397 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:46.866397 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:46.866397 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:46.866397 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:46.866397 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 03:17:46.867330 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 03:17:46.867330 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:17:46.867330 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:17:46.867330 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 541/1071] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:17:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 03:17:46.872066 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18573d98-2d85-4a22-80b8-dbb4f3229634 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:46.894843 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 531/1072] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:17:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 03:17:46.907331 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:46.975684 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18573d98-2d85-4a22-80b8-dbb4f3229634 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:47.000693 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4774caf6-77e5-4d3a-9a39-baa4d4af35e4 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:47.010548 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7fd194-24f3-4358-8095-0f06b4a3e9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:47.011148 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7fd194-24f3-4358-8095-0f06b4a3e9ff None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:47.011425 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7fd194-24f3-4358-8095-0f06b4a3e9ff None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:47.012117 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7fd194-24f3-4358-8095-0f06b4a3e9ff None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:47.012762 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7fd194-24f3-4358-8095-0f06b4a3e9ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:47.013067 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7fd194-24f3-4358-8095-0f06b4a3e9ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:47.014773 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7fd194-24f3-4358-8095-0f06b4a3e9ff None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:47.027625 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 542/1073] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 03:17:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:47.033627 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7fd194-24f3-4358-8095-0f06b4a3e9ff None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:47.100902 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:47.127878 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4774caf6-77e5-4d3a-9a39-baa4d4af35e4 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:47.129809 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:47.137759 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7fd194-24f3-4358-8095-0f06b4a3e9ff None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:47.166191 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adcae0f-9c43-488b-afa8-e7601eac702f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:47.166816 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adcae0f-9c43-488b-afa8-e7601eac702f None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:47.167101 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adcae0f-9c43-488b-afa8-e7601eac702f None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:47.167375 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adcae0f-9c43-488b-afa8-e7601eac702f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:47.174156 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318209a9-3557-4ac4-b5aa-c4ea47557a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:47.174778 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318209a9-3557-4ac4-b5aa-c4ea47557a26 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:47.175054 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318209a9-3557-4ac4-b5aa-c4ea47557a26 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:47.175323 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318209a9-3557-4ac4-b5aa-c4ea47557a26 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:47.178158 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adcae0f-9c43-488b-afa8-e7601eac702f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:17:47.182494 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318209a9-3557-4ac4-b5aa-c4ea47557a26 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:47.182941 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-1adcae0f-9c43-488b-afa8-e7601eac702f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 03:17:47.182941 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:47.182941 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:47.182941 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:47.182941 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:47.182941 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:47.182941 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:47.182941 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:47.182941 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:47.182941 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:47.182941 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:47.182941 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:47.182941 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:17:47.182941 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:17:47.182941 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:17:47.182941 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:17:47.184077 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:17:47.184077 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:17:47.184077 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:17:47.184077 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:17:47.184077 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:47.184077 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:47.184077 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:47.184077 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:47.184077 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:47.184077 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:47.184077 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:47.184077 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:47.184077 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:47.184077 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:47.184077 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:47.184077 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:47.185228 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:47.185228 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:47.185228 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:47.185228 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:47.185228 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:17:47.185228 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:17:47.185228 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:17:47.185228 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:17:47.185228 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:17:47.185228 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:17:47.185228 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 03:17:47.185228 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:17:47.186027 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318209a9-3557-4ac4-b5aa-c4ea47557a26 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:47.189104 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 532/1074] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 4 03:17:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:17:47.189806 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adcae0f-9c43-488b-afa8-e7601eac702f None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:47.197631 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-318209a9-3557-4ac4-b5aa-c4ea47557a26 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 03:17:47.197631 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:47.197631 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:47.197631 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:47.197631 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:47.197631 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:47.197631 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:47.197631 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:47.197631 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:47.197631 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:47.197631 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:47.197631 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:47.197631 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 03:17:47.197631 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 03:17:47.197631 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 03:17:47.198750 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 03:17:47.198750 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:47.198750 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:47.198750 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:47.198750 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:47.198750 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:47.198750 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:47.198750 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:47.198750 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:47.198750 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:47.198750 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:47.198750 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:47.198750 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:47.198750 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:47.198750 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:47.198750 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:47.198750 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:47.200184 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 03:17:47.200184 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 03:17:47.200184 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 03:17:47.200184 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 03:17:47.200184 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 03:17:47.200184 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 03:17:47.200184 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 03:17:47.200184 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:17:47.200184 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 543/1075] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 03:17:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 03:17:47.200184 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318209a9-3557-4ac4-b5aa-c4ea47557a26 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:47.294212 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adcae0f-9c43-488b-afa8-e7601eac702f None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:47.304966 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318209a9-3557-4ac4-b5aa-c4ea47557a26 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:47.329468 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f612d52c-76d9-4bdb-aeea-bb1439db4569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:47.330063 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f612d52c-76d9-4bdb-aeea-bb1439db4569 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:47.330345 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f612d52c-76d9-4bdb-aeea-bb1439db4569 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:47.330621 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f612d52c-76d9-4bdb-aeea-bb1439db4569 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:47.334638 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:47.339150 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1364a30-f08f-4fa5-95c3-058f55d27c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:47.340205 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1364a30-f08f-4fa5-95c3-058f55d27c89 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:47.340489 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1364a30-f08f-4fa5-95c3-058f55d27c89 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:47.340765 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1364a30-f08f-4fa5-95c3-058f55d27c89 None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:47.341441 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1364a30-f08f-4fa5-95c3-058f55d27c89 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:47.341750 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1364a30-f08f-4fa5-95c3-058f55d27c89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:47.343136 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1364a30-f08f-4fa5-95c3-058f55d27c89 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:47.351825 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 544/1076] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 03:17:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:47.352694 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1364a30-f08f-4fa5-95c3-058f55d27c89 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:47.373711 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:47.400231 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f612d52c-76d9-4bdb-aeea-bb1439db4569 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:47.401680 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f612d52c-76d9-4bdb-aeea-bb1439db4569 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:47.456285 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1364a30-f08f-4fa5-95c3-058f55d27c89 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:47.489864 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f16a962-c619-4283-a0a6-67ea830cf628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:47.490465 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16a962-c619-4283-a0a6-67ea830cf628 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:47.490754 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16a962-c619-4283-a0a6-67ea830cf628 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:47.491028 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16a962-c619-4283-a0a6-67ea830cf628 None admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:47.491756 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f16a962-c619-4283-a0a6-67ea830cf628 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:47.492066 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f16a962-c619-4283-a0a6-67ea830cf628 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:47.493485 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f16a962-c619-4283-a0a6-67ea830cf628 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:47.501764 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 533/1077] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 03:17:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 03:17:47.502417 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f612d52c-76d9-4bdb-aeea-bb1439db4569 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:47.509924 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 545/1078] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 4 03:17:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:47.510731 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f16a962-c619-4283-a0a6-67ea830cf628 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:47.537649 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:47.589822 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:47.602126 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f612d52c-76d9-4bdb-aeea-bb1439db4569 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:47.614396 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f16a962-c619-4283-a0a6-67ea830cf628 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:47.638648 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2ba391-f67b-4012-a951-a120c7c85a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:47.639282 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ba391-f67b-4012-a951-a120c7c85a53 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:47.639594 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ba391-f67b-4012-a951-a120c7c85a53 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:47.639870 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ba391-f67b-4012-a951-a120c7c85a53 None admin] PATH_INFO: `/v3/users/a712ac52611145a4a2f9cece80ce99b7` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:47.641002 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2ba391-f67b-4012-a951-a120c7c85a53 None admin] RBAC: Authorizing `identity:get_user(user_id=a712ac52611145a4a2f9cece80ce99b7)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:47.642425 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2ba391-f67b-4012-a951-a120c7c85a53 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:47.644042 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 534/1079] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 03:17:47 2022] GET /identity/v3/users/a712ac52611145a4a2f9cece80ce99b7 => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:47.644814 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2ba391-f67b-4012-a951-a120c7c85a53 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:47.650573 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ffaa4-8377-4467-acf7-fbf06493495d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:47.651193 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ffaa4-8377-4467-acf7-fbf06493495d None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:47.651471 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ffaa4-8377-4467-acf7-fbf06493495d None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:47.651776 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ffaa4-8377-4467-acf7-fbf06493495d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:47.663311 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3ffaa4-8377-4467-acf7-fbf06493495d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:47.664770 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3ffaa4-8377-4467-acf7-fbf06493495d None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:47.678755 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-9b3ffaa4-8377-4467-acf7-fbf06493495d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:17:47.678755 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:47.678755 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:47.678755 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:47.678755 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:47.678755 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:47.678755 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:47.678755 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:47.678755 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:47.678755 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:47.678755 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:47.678755 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:47.678755 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 03:17:47.678755 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 03:17:47.678755 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 03:17:47.678755 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 03:17:47.679750 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:47.679750 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:47.679750 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:47.679750 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:47.679750 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:47.679750 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:47.679750 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:47.679750 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:47.679750 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:47.679750 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:47.679750 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:47.679750 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:47.679750 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:47.679750 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:47.679750 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:47.679750 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:47.679750 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 03:17:47.680675 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 03:17:47.680675 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:17:47.680675 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:17:47.680675 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 546/1080] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:17:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:17:47.680675 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ffaa4-8377-4467-acf7-fbf06493495d None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:47.749318 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2ba391-f67b-4012-a951-a120c7c85a53 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:47.751632 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:47.783567 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ffaa4-8377-4467-acf7-fbf06493495d None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:47.784004 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d52f78-478d-4036-9fd7-5931972f0215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:47.784655 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d52f78-478d-4036-9fd7-5931972f0215 None admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:47.784943 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d52f78-478d-4036-9fd7-5931972f0215 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:47.785218 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d52f78-478d-4036-9fd7-5931972f0215 None admin] PATH_INFO: `/v3/projects/80ae15e46620470b9c55fb7fe300fcb6/users/2c1f412befb9418fa66a2aabf475aa90/roles/8d45a720a6c14675a3504853645b8e22` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:47.787494 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d52f78-478d-4036-9fd7-5931972f0215 None admin] RBAC: Authorizing `identity:create_grant(project_id=80ae15e46620470b9c55fb7fe300fcb6, user_id=2c1f412befb9418fa66a2aabf475aa90, role_id=8d45a720a6c14675a3504853645b8e22)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:47.788943 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d52f78-478d-4036-9fd7-5931972f0215 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:47.803370 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 535/1081] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Oct 4 03:17:47 2022] PUT /identity/v3/projects/80ae15e46620470b9c55fb7fe300fcb6/users/2c1f412befb9418fa66a2aabf475aa90/roles/8d45a720a6c14675a3504853645b8e22 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:17:47.804204 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d52f78-478d-4036-9fd7-5931972f0215 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:47.825597 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:47.836183 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53da41a-e930-47c5-8c36-4ccf9472af4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:47.836830 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53da41a-e930-47c5-8c36-4ccf9472af4d None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:47.837112 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53da41a-e930-47c5-8c36-4ccf9472af4d None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:47.837386 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53da41a-e930-47c5-8c36-4ccf9472af4d None admin] PATH_INFO: `/v3/projects/ec443268285846be8ec6531cd3cb4aef` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:47.838561 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53da41a-e930-47c5-8c36-4ccf9472af4d None admin] RBAC: Authorizing `identity:get_project(project_id=ec443268285846be8ec6531cd3cb4aef)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:47.840264 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53da41a-e930-47c5-8c36-4ccf9472af4d None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:47.841919 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 547/1082] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 03:17:47 2022] GET /identity/v3/projects/ec443268285846be8ec6531cd3cb4aef => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:47.848233 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53da41a-e930-47c5-8c36-4ccf9472af4d None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:47.924935 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d52f78-478d-4036-9fd7-5931972f0215 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:47.962484 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3874721-0194-4819-b59c-1d466dfefeca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:47.963114 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3874721-0194-4819-b59c-1d466dfefeca None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:47.963396 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3874721-0194-4819-b59c-1d466dfefeca None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:47.963692 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3874721-0194-4819-b59c-1d466dfefeca None admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:47.964345 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3874721-0194-4819-b59c-1d466dfefeca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:47.964637 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3874721-0194-4819-b59c-1d466dfefeca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:47.966051 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3874721-0194-4819-b59c-1d466dfefeca None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:47.970798 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53da41a-e930-47c5-8c36-4ccf9472af4d None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:47.980213 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 536/1083] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 03:17:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:48.011833 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9792495d-10d2-47b7-973d-2ca51c525020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:48.012527 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9792495d-10d2-47b7-973d-2ca51c525020 None admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:48.012811 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9792495d-10d2-47b7-973d-2ca51c525020 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:48.013092 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9792495d-10d2-47b7-973d-2ca51c525020 None admin] PATH_INFO: `/v3/projects/ec443268285846be8ec6531cd3cb4aef/users/a712ac52611145a4a2f9cece80ce99b7/roles/fe9379cda35c4ff78576fe48b60bea3c` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:48.015663 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9792495d-10d2-47b7-973d-2ca51c525020 None admin] RBAC: Authorizing `identity:create_grant(project_id=ec443268285846be8ec6531cd3cb4aef, user_id=a712ac52611145a4a2f9cece80ce99b7, role_id=fe9379cda35c4ff78576fe48b60bea3c)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:48.017122 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9792495d-10d2-47b7-973d-2ca51c525020 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:48.033651 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 548/1084] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Oct 4 03:17:47 2022] PUT /identity/v3/projects/ec443268285846be8ec6531cd3cb4aef/users/a712ac52611145a4a2f9cece80ce99b7/roles/fe9379cda35c4ff78576fe48b60bea3c => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 03:17:49.964622 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c14025f-e325-49d3-9bb1-ac3d00245bf9 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:49.965131 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c14025f-e325-49d3-9bb1-ac3d00245bf9 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:49.965131 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c14025f-e325-49d3-9bb1-ac3d00245bf9 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:49.966533 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 537/1085] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:17:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:17:49.971585 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d33daa-67c9-4fe4-9d92-732625f6ed18 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:49.971968 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d33daa-67c9-4fe4-9d92-732625f6ed18 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:49.972265 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d33daa-67c9-4fe4-9d92-732625f6ed18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:49.991503 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-12d33daa-67c9-4fe4-9d92-732625f6ed18 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:17:49.992710 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-12d33daa-67c9-4fe4-9d92-732625f6ed18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:17:50.041991 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:50.060002 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 549/1086] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:17:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 03:17:50.207984 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516f3e2-4e0e-4b27-8aa6-b70881c793e9 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:50.208260 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516f3e2-4e0e-4b27-8aa6-b70881c793e9 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:50.208534 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516f3e2-4e0e-4b27-8aa6-b70881c793e9 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:50.210035 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 538/1087] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:17:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:17:50.215057 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c7a4c-975d-4600-9afe-4b45f71fb9c5 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:50.215294 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c7a4c-975d-4600-9afe-4b45f71fb9c5 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:50.215598 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c7a4c-975d-4600-9afe-4b45f71fb9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:50.233839 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-5b8c7a4c-975d-4600-9afe-4b45f71fb9c5 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:17:50.235079 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-5b8c7a4c-975d-4600-9afe-4b45f71fb9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:17:50.301909 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 550/1088] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:17:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 03:17:50.339662 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3516f3e2-4e0e-4b27-8aa6-b70881c793e9 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:50.365238 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:50.444751 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3516f3e2-4e0e-4b27-8aa6-b70881c793e9 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:50.478870 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3091054a-10a0-4b0f-9fb4-c9e7f271d5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:50.479516 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091054a-10a0-4b0f-9fb4-c9e7f271d5b2 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:50.479802 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091054a-10a0-4b0f-9fb4-c9e7f271d5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:50.480078 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091054a-10a0-4b0f-9fb4-c9e7f271d5b2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:50.490056 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3091054a-10a0-4b0f-9fb4-c9e7f271d5b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:17:50.495291 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-3091054a-10a0-4b0f-9fb4-c9e7f271d5b2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 03:17:50.495291 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:50.495291 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:50.495291 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:50.495291 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:50.495291 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:50.495291 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:50.495291 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:50.495291 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:50.495291 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:50.495291 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:50.495291 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:50.495291 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:17:50.495291 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:17:50.495291 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:17:50.495291 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:17:50.496405 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:17:50.496405 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:17:50.496405 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:17:50.496405 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:17:50.496405 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:50.496405 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:50.496405 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:50.496405 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:50.496405 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:50.496405 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:50.496405 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:50.496405 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:50.496405 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:50.496405 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:50.496405 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:50.496405 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:50.497542 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:50.497542 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:50.497542 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:50.497542 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:50.497542 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:17:50.497542 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:17:50.497542 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:17:50.497542 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:17:50.497542 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:17:50.497542 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:17:50.497542 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 03:17:50.497542 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:17:50.499627 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 539/1089] 10.222.0.25 () {56 vars in 1120 bytes} [Tue Oct 4 03:17:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:17:50.502362 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8c7a4c-975d-4600-9afe-4b45f71fb9c5 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:50.583564 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3091054a-10a0-4b0f-9fb4-c9e7f271d5b2 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:50.602984 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8c7a4c-975d-4600-9afe-4b45f71fb9c5 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:50.619870 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:50.639460 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eefd40-8085-4942-a43b-c2f66aaaa205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:50.640089 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eefd40-8085-4942-a43b-c2f66aaaa205 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:50.640372 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eefd40-8085-4942-a43b-c2f66aaaa205 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:50.640642 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eefd40-8085-4942-a43b-c2f66aaaa205 None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:50.641333 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eefd40-8085-4942-a43b-c2f66aaaa205 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:50.641638 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eefd40-8085-4942-a43b-c2f66aaaa205 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:50.642988 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eefd40-8085-4942-a43b-c2f66aaaa205 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:50.652174 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 551/1090] 10.222.0.25 () {56 vars in 1115 bytes} [Tue Oct 4 03:17:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:50.657797 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eefd40-8085-4942-a43b-c2f66aaaa205 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:50.670866 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:50.686743 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3091054a-10a0-4b0f-9fb4-c9e7f271d5b2 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:50.721114 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7a8cf9-2e03-433b-973f-dbffbce5dbc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:50.721726 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a8cf9-2e03-433b-973f-dbffbce5dbc5 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:50.722014 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a8cf9-2e03-433b-973f-dbffbce5dbc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:50.722290 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a8cf9-2e03-433b-973f-dbffbce5dbc5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:50.732539 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7a8cf9-2e03-433b-973f-dbffbce5dbc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:17:50.737229 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-cc7a8cf9-2e03-433b-973f-dbffbce5dbc5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 03:17:50.737229 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:50.737229 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:50.737229 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:50.737229 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:50.737229 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:50.737229 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:50.737229 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:50.737229 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:50.737229 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:50.737229 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:50.737229 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:50.737229 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:17:50.737229 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:17:50.737229 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:17:50.737229 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:17:50.738157 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:17:50.738157 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:17:50.738157 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:17:50.738157 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:17:50.738157 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:50.738157 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:50.738157 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:50.738157 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:50.738157 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:50.738157 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:50.738157 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:50.738157 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:50.738157 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:50.738157 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:50.738157 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:50.738157 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:50.739315 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:50.739315 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:50.739315 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:50.739315 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:50.739315 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:17:50.739315 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:17:50.739315 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:17:50.739315 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:17:50.739315 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:17:50.739315 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:17:50.739315 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 03:17:50.739315 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:17:50.739315 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 540/1091] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 4 03:17:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 03:17:50.744412 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7a8cf9-2e03-433b-973f-dbffbce5dbc5 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:50.758703 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eefd40-8085-4942-a43b-c2f66aaaa205 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:50.792839 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6908b49-e6ce-4a97-99d8-69ebd9746f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:50.793452 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6908b49-e6ce-4a97-99d8-69ebd9746f44 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:50.793729 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6908b49-e6ce-4a97-99d8-69ebd9746f44 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:50.793996 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6908b49-e6ce-4a97-99d8-69ebd9746f44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:50.806686 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6908b49-e6ce-4a97-99d8-69ebd9746f44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:50.808321 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6908b49-e6ce-4a97-99d8-69ebd9746f44 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:50.822996 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-f6908b49-e6ce-4a97-99d8-69ebd9746f44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:17:50.822996 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:50.822996 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:50.822996 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:50.822996 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:50.822996 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:50.822996 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:50.822996 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:50.822996 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:50.822996 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:50.822996 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:50.822996 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:50.822996 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 03:17:50.822996 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 03:17:50.822996 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 03:17:50.822996 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 03:17:50.824036 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:50.824036 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:50.824036 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:50.824036 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:50.824036 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:50.824036 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:50.824036 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:50.824036 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:50.824036 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:50.824036 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:50.824036 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:50.824036 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:50.824036 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:50.824036 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:50.824036 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:50.824036 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:50.824036 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 03:17:50.825267 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 03:17:50.825267 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:17:50.825267 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:17:50.825267 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 552/1092] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:17:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:17:50.829727 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6908b49-e6ce-4a97-99d8-69ebd9746f44 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:50.849243 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7a8cf9-2e03-433b-973f-dbffbce5dbc5 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:50.859386 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:50.889258 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bda6b2-d6b7-4284-9fc4-67d4a2f9389f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:50.889854 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bda6b2-d6b7-4284-9fc4-67d4a2f9389f None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:50.890133 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bda6b2-d6b7-4284-9fc4-67d4a2f9389f None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:50.890405 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bda6b2-d6b7-4284-9fc4-67d4a2f9389f None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:50.891061 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bda6b2-d6b7-4284-9fc4-67d4a2f9389f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:50.891366 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bda6b2-d6b7-4284-9fc4-67d4a2f9389f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:50.892741 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bda6b2-d6b7-4284-9fc4-67d4a2f9389f None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:50.900940 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 541/1093] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 03:17:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:17:50.906671 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bda6b2-d6b7-4284-9fc4-67d4a2f9389f None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:50.916527 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:50.930357 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6908b49-e6ce-4a97-99d8-69ebd9746f44 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:50.964042 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03f35e4-c1fa-4ad6-b829-49f01060e40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:50.964636 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f35e4-c1fa-4ad6-b829-49f01060e40c None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:50.964917 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f35e4-c1fa-4ad6-b829-49f01060e40c None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:50.965189 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f35e4-c1fa-4ad6-b829-49f01060e40c None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:50.965815 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03f35e4-c1fa-4ad6-b829-49f01060e40c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:50.966119 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03f35e4-c1fa-4ad6-b829-49f01060e40c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:50.967515 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03f35e4-c1fa-4ad6-b829-49f01060e40c None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:50.979048 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 553/1094] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 03:17:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:17:50.984816 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03f35e4-c1fa-4ad6-b829-49f01060e40c None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:51.007469 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bda6b2-d6b7-4284-9fc4-67d4a2f9389f None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:51.039977 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e3618a-2531-4e74-a015-eb3ef53169f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:51.040592 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e3618a-2531-4e74-a015-eb3ef53169f4 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:51.040871 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e3618a-2531-4e74-a015-eb3ef53169f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:51.041140 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e3618a-2531-4e74-a015-eb3ef53169f4 None admin] PATH_INFO: `/v3/users/a712ac52611145a4a2f9cece80ce99b7` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:51.042256 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e3618a-2531-4e74-a015-eb3ef53169f4 None admin] RBAC: Authorizing `identity:get_user(user_id=a712ac52611145a4a2f9cece80ce99b7)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:51.043695 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e3618a-2531-4e74-a015-eb3ef53169f4 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:51.045239 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 542/1095] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 03:17:50 2022] GET /identity/v3/users/a712ac52611145a4a2f9cece80ce99b7 => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:17:51.050903 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e3618a-2531-4e74-a015-eb3ef53169f4 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:51.074092 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:51.084224 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03f35e4-c1fa-4ad6-b829-49f01060e40c None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:51.117328 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2cc49b-cada-4f0d-95e6-654602c7b53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:51.117944 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2cc49b-cada-4f0d-95e6-654602c7b53a None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:51.118225 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2cc49b-cada-4f0d-95e6-654602c7b53a None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:51.118497 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2cc49b-cada-4f0d-95e6-654602c7b53a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:51.124030 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:51.125358 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2cc49b-cada-4f0d-95e6-654602c7b53a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:51.126878 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2cc49b-cada-4f0d-95e6-654602c7b53a None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:51.138355 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-1c2cc49b-cada-4f0d-95e6-654602c7b53a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 03:17:51.138355 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:51.138355 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:51.138355 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:51.138355 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:51.138355 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:51.138355 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:51.138355 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:51.138355 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:51.138355 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:51.138355 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:51.138355 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:51.138355 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 03:17:51.138355 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 03:17:51.138355 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 03:17:51.138355 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 03:17:51.139393 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:51.139393 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:51.139393 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 03:17:51.139393 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 03:17:51.139393 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 03:17:51.139393 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 03:17:51.139393 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:51.139393 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:51.139393 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:51.139393 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:51.139393 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:51.139393 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:51.139393 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:51.139393 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:51.139393 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:51.139393 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:51.139393 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:51.139393 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:51.140877 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:51.140877 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:51.140877 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 03:17:51.140877 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 03:17:51.140877 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 03:17:51.140877 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 03:17:51.140877 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 03:17:51.140877 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 03:17:51.140877 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 03:17:51.140877 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:17:51.140877 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 554/1096] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Oct 4 03:17:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 03:17:51.145626 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2cc49b-cada-4f0d-95e6-654602c7b53a None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:51.149223 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e3618a-2531-4e74-a015-eb3ef53169f4 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:51.182217 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dba5ab6-fd15-4832-b582-faf4c1e661f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:51.182805 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba5ab6-fd15-4832-b582-faf4c1e661f0 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:51.183083 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba5ab6-fd15-4832-b582-faf4c1e661f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:51.183378 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba5ab6-fd15-4832-b582-faf4c1e661f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:51.242954 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2cc49b-cada-4f0d-95e6-654602c7b53a None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:51.249449 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dba5ab6-fd15-4832-b582-faf4c1e661f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:51.250894 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dba5ab6-fd15-4832-b582-faf4c1e661f0 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:51.278689 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bdb498-7463-4958-be5e-43fa078bda7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:51.279313 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bdb498-7463-4958-be5e-43fa078bda7d None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:51.279612 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bdb498-7463-4958-be5e-43fa078bda7d None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:51.279893 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bdb498-7463-4958-be5e-43fa078bda7d None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:51.280618 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bdb498-7463-4958-be5e-43fa078bda7d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:51.280925 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bdb498-7463-4958-be5e-43fa078bda7d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:51.282335 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bdb498-7463-4958-be5e-43fa078bda7d None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:51.300668 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 555/1097] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Oct 4 03:17:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:17:51.306717 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bdb498-7463-4958-be5e-43fa078bda7d None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:51.316668 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:51.328188 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:51.354776 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 543/1098] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 03:17:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 04 03:17:51.360527 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dba5ab6-fd15-4832-b582-faf4c1e661f0 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:51.404218 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bdb498-7463-4958-be5e-43fa078bda7d None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:51.439377 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a60dc9d-22e1-4fc2-a240-b20e0fae4fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:51.440017 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60dc9d-22e1-4fc2-a240-b20e0fae4fd4 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:51.440295 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60dc9d-22e1-4fc2-a240-b20e0fae4fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:51.440567 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60dc9d-22e1-4fc2-a240-b20e0fae4fd4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:51.462433 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dba5ab6-fd15-4832-b582-faf4c1e661f0 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:51.496322 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6602c2eb-fd51-4ee7-9d8f-097c5dc2d00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:51.496867 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6602c2eb-fd51-4ee7-9d8f-097c5dc2d00d None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:51.497147 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6602c2eb-fd51-4ee7-9d8f-097c5dc2d00d None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:51.497420 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6602c2eb-fd51-4ee7-9d8f-097c5dc2d00d None admin] PATH_INFO: `/v3/projects/ec443268285846be8ec6531cd3cb4aef` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:51.498592 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6602c2eb-fd51-4ee7-9d8f-097c5dc2d00d None admin] RBAC: Authorizing `identity:get_project(project_id=ec443268285846be8ec6531cd3cb4aef)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:51.500139 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6602c2eb-fd51-4ee7-9d8f-097c5dc2d00d None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:51.501769 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 544/1099] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 03:17:51 2022] GET /identity/v3/projects/ec443268285846be8ec6531cd3cb4aef => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:17:51.507999 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6602c2eb-fd51-4ee7-9d8f-097c5dc2d00d None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:51.513710 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a60dc9d-22e1-4fc2-a240-b20e0fae4fd4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:51.515198 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a60dc9d-22e1-4fc2-a240-b20e0fae4fd4 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:51.524904 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:51.550674 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:51.610151 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6602c2eb-fd51-4ee7-9d8f-097c5dc2d00d None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:51.621308 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 556/1100] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 03:17:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 04 03:17:51.627018 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a60dc9d-22e1-4fc2-a240-b20e0fae4fd4 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:51.644467 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcea98e-b362-4904-92ad-f5fa62cc58c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:51.645848 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcea98e-b362-4904-92ad-f5fa62cc58c7 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:51.646037 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcea98e-b362-4904-92ad-f5fa62cc58c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:51.646254 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcea98e-b362-4904-92ad-f5fa62cc58c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:51.646961 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcea98e-b362-4904-92ad-f5fa62cc58c7 None admin] RBAC: Adding query filter params (role.id=fe9379cda35c4ff78576fe48b60bea3c, scope.project.id=ec443268285846be8ec6531cd3cb4aef, user.id=a712ac52611145a4a2f9cece80ce99b7) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:51.647263 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcea98e-b362-4904-92ad-f5fa62cc58c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:51.648691 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcea98e-b362-4904-92ad-f5fa62cc58c7 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:51.654349 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 545/1101] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 03:17:51 2022] GET /identity/v3/role_assignments?user.id=a712ac52611145a4a2f9cece80ce99b7&scope.project.id=ec443268285846be8ec6531cd3cb4aef&role.id=fe9379cda35c4ff78576fe48b60bea3c => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:51.736326 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a60dc9d-22e1-4fc2-a240-b20e0fae4fd4 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:51.747702 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:51.774579 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf0038-500a-49b1-af3c-6b23b8cbda52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:51.775219 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf0038-500a-49b1-af3c-6b23b8cbda52 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:51.775521 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf0038-500a-49b1-af3c-6b23b8cbda52 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:51.775799 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf0038-500a-49b1-af3c-6b23b8cbda52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:51.790155 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbf0038-500a-49b1-af3c-6b23b8cbda52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:51.791667 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbf0038-500a-49b1-af3c-6b23b8cbda52 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:51.808562 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-2bbf0038-500a-49b1-af3c-6b23b8cbda52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:17:51.808562 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:51.808562 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:51.808562 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:51.808562 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:51.808562 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:51.808562 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:51.808562 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:51.808562 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:51.808562 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:51.808562 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:51.808562 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:51.808562 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 03:17:51.808562 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 03:17:51.808562 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 03:17:51.808562 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 03:17:51.809786 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:51.809786 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:51.809786 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:51.809786 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:51.809786 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:51.809786 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:51.809786 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:51.809786 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:51.809786 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:51.809786 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:51.809786 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:51.809786 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:51.809786 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:51.809786 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:51.809786 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:51.809786 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:51.809786 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 03:17:51.810907 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 03:17:51.810907 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:17:51.810907 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:17:51.814463 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 557/1102] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:17:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 03:17:51.815754 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcea98e-b362-4904-92ad-f5fa62cc58c7 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:51.918175 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcea98e-b362-4904-92ad-f5fa62cc58c7 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:51.925022 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:51.952814 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13df6ba6-5757-445c-b7e7-e9eae39ac03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:51.953407 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df6ba6-5757-445c-b7e7-e9eae39ac03e None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:51.953684 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df6ba6-5757-445c-b7e7-e9eae39ac03e None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:51.953955 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df6ba6-5757-445c-b7e7-e9eae39ac03e None admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:51.954584 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13df6ba6-5757-445c-b7e7-e9eae39ac03e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:51.954886 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13df6ba6-5757-445c-b7e7-e9eae39ac03e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:51.956267 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13df6ba6-5757-445c-b7e7-e9eae39ac03e None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:51.967973 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 546/1103] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 03:17:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:51.974189 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf0038-500a-49b1-af3c-6b23b8cbda52 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:52.070967 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf0038-500a-49b1-af3c-6b23b8cbda52 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:52.103079 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e25e85-fee9-48c7-94bb-d10127c46c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:52.103722 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e25e85-fee9-48c7-94bb-d10127c46c20 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:52.104002 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e25e85-fee9-48c7-94bb-d10127c46c20 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:52.104271 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e25e85-fee9-48c7-94bb-d10127c46c20 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:52.110644 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e25e85-fee9-48c7-94bb-d10127c46c20 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:52.112088 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e25e85-fee9-48c7-94bb-d10127c46c20 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:52.123332 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-f8e25e85-fee9-48c7-94bb-d10127c46c20 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 03:17:52.123332 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:17:52.123332 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:17:52.123332 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:17:52.123332 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:17:52.123332 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:17:52.123332 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:17:52.123332 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:17:52.123332 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:17:52.123332 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:17:52.123332 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:17:52.123332 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:17:52.123332 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 03:17:52.123332 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 03:17:52.123332 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 03:17:52.124281 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 03:17:52.124281 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:17:52.124281 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:17:52.124281 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:17:52.124281 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:17:52.124281 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:17:52.124281 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:17:52.124281 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:17:52.124281 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:17:52.124281 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:17:52.124281 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:17:52.124281 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:17:52.124281 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:17:52.124281 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:17:52.124281 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:17:52.124281 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:17:52.124281 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:17:52.125604 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 03:17:52.125604 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 03:17:52.125604 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 03:17:52.125604 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 03:17:52.125604 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 03:17:52.125604 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 03:17:52.125604 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 03:17:52.125604 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:17:52.125604 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 558/1104] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 03:17:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 03:17:52.130968 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13df6ba6-5757-445c-b7e7-e9eae39ac03e None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:52.230637 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13df6ba6-5757-445c-b7e7-e9eae39ac03e None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:52.263626 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc4bafe-c8b5-4118-932f-c1d83b85f089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:52.264218 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4bafe-c8b5-4118-932f-c1d83b85f089 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:52.264495 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4bafe-c8b5-4118-932f-c1d83b85f089 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:52.264764 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4bafe-c8b5-4118-932f-c1d83b85f089 None admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:52.265441 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc4bafe-c8b5-4118-932f-c1d83b85f089 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:52.265742 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc4bafe-c8b5-4118-932f-c1d83b85f089 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:52.267147 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc4bafe-c8b5-4118-932f-c1d83b85f089 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:52.278838 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 547/1105] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 4 03:17:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:52.285100 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e25e85-fee9-48c7-94bb-d10127c46c20 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:52.308970 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:52.387019 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e25e85-fee9-48c7-94bb-d10127c46c20 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:52.421312 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d657c99d-5ba9-4b21-9f89-a97724f734d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:52.421908 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657c99d-5ba9-4b21-9f89-a97724f734d3 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:52.422186 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657c99d-5ba9-4b21-9f89-a97724f734d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:52.422457 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657c99d-5ba9-4b21-9f89-a97724f734d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:52.423166 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d657c99d-5ba9-4b21-9f89-a97724f734d3 None admin] RBAC: Adding query filter params (role.id=8d45a720a6c14675a3504853645b8e22, scope.project.id=80ae15e46620470b9c55fb7fe300fcb6, user.id=2c1f412befb9418fa66a2aabf475aa90) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:52.423470 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d657c99d-5ba9-4b21-9f89-a97724f734d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:52.424902 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d657c99d-5ba9-4b21-9f89-a97724f734d3 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:52.430693 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 559/1106] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 03:17:52 2022] GET /identity/v3/role_assignments?user.id=2c1f412befb9418fa66a2aabf475aa90&scope.project.id=80ae15e46620470b9c55fb7fe300fcb6&role.id=8d45a720a6c14675a3504853645b8e22 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:53.858241 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7465f3-0b8f-427f-bad2-4afae4c1c6ae None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:53.858759 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7465f3-0b8f-427f-bad2-4afae4c1c6ae None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:53.858759 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7465f3-0b8f-427f-bad2-4afae4c1c6ae None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:53.860144 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 548/1107] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:17:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:17:53.866172 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0db77-dae2-407d-b626-4a4c1ce8cdfe None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:53.866588 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0db77-dae2-407d-b626-4a4c1ce8cdfe None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:53.866712 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0db77-dae2-407d-b626-4a4c1ce8cdfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:53.884505 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-c4d0db77-dae2-407d-b626-4a4c1ce8cdfe None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:17:53.885638 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-c4d0db77-dae2-407d-b626-4a4c1ce8cdfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:17:53.949271 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 560/1108] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:17:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 03:17:54.221135 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7465f3-0b8f-427f-bad2-4afae4c1c6ae None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:54.248483 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:54.320313 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7465f3-0b8f-427f-bad2-4afae4c1c6ae None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:54.352906 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4518fa4-62fb-4bfa-b4e4-b63cd067d77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:54.353510 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4518fa4-62fb-4bfa-b4e4-b63cd067d77e None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:54.353786 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4518fa4-62fb-4bfa-b4e4-b63cd067d77e None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:54.354055 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4518fa4-62fb-4bfa-b4e4-b63cd067d77e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:54.355138 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4518fa4-62fb-4bfa-b4e4-b63cd067d77e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:54.356565 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4518fa4-62fb-4bfa-b4e4-b63cd067d77e None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:54.358105 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 549/1109] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:17:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:54.363983 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d0db77-dae2-407d-b626-4a4c1ce8cdfe None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:54.378371 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:54.460069 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d0db77-dae2-407d-b626-4a4c1ce8cdfe None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:54.492138 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c214f8-02e4-4538-add4-78d13f8aca89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:54.492668 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c214f8-02e4-4538-add4-78d13f8aca89 None admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:54.492948 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c214f8-02e4-4538-add4-78d13f8aca89 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:54.493220 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c214f8-02e4-4538-add4-78d13f8aca89 None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:54.493854 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c214f8-02e4-4538-add4-78d13f8aca89 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:54.495263 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c214f8-02e4-4538-add4-78d13f8aca89 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:54.515753 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 561/1110] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Oct 4 03:17:54 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:17:56.680919 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c8b7bf-e9e1-4fd7-8aa6-fb0f4e5cb545 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:56.681436 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c8b7bf-e9e1-4fd7-8aa6-fb0f4e5cb545 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:56.681436 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c8b7bf-e9e1-4fd7-8aa6-fb0f4e5cb545 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:56.682774 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 550/1111] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:17:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:17:56.687913 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eef1ec-2d60-400d-a9f9-dab715ed54fc None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:56.688348 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eef1ec-2d60-400d-a9f9-dab715ed54fc None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:56.688468 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eef1ec-2d60-400d-a9f9-dab715ed54fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:56.707890 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-26eef1ec-2d60-400d-a9f9-dab715ed54fc None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:17:56.709094 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-26eef1ec-2d60-400d-a9f9-dab715ed54fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:17:56.773937 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:56.779082 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 562/1112] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:17:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 03:17:57.059367 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c8b7bf-e9e1-4fd7-8aa6-fb0f4e5cb545 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:57.156436 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:57.164653 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c8b7bf-e9e1-4fd7-8aa6-fb0f4e5cb545 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:57.199096 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e48e817-f530-4d0a-a2c6-e5bd6ffba077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:57.199729 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e48e817-f530-4d0a-a2c6-e5bd6ffba077 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:57.200012 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e48e817-f530-4d0a-a2c6-e5bd6ffba077 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:57.200284 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e48e817-f530-4d0a-a2c6-e5bd6ffba077 None admin] PATH_INFO: `/v3/roles/f2332a9a00b74fe0846d7211dd3850cb` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:57.201655 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e48e817-f530-4d0a-a2c6-e5bd6ffba077 None admin] RBAC: Authorizing `identity:get_role(role_id=f2332a9a00b74fe0846d7211dd3850cb)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:57.203011 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e48e817-f530-4d0a-a2c6-e5bd6ffba077 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:57.204341 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 551/1113] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 03:17:57 2022] GET /identity/v3/roles/f2332a9a00b74fe0846d7211dd3850cb => generated 223 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:57.210708 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eef1ec-2d60-400d-a9f9-dab715ed54fc None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:57.314079 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eef1ec-2d60-400d-a9f9-dab715ed54fc None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:57.346734 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb080490-421a-42ff-ad7d-6193e044f069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:57.347345 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb080490-421a-42ff-ad7d-6193e044f069 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:57.348183 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb080490-421a-42ff-ad7d-6193e044f069 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:57.348945 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb080490-421a-42ff-ad7d-6193e044f069 None admin] PATH_INFO: `/v3/users/db759c70543247079e15bb2806ae9599` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:57.362281 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb080490-421a-42ff-ad7d-6193e044f069 None admin] RBAC: Authorizing `identity:get_user(user_id=db759c70543247079e15bb2806ae9599)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:57.364563 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb080490-421a-42ff-ad7d-6193e044f069 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:57.366181 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 563/1114] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 03:17:57 2022] GET /identity/v3/users/db759c70543247079e15bb2806ae9599 => generated 286 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:57.372115 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e48e817-f530-4d0a-a2c6-e5bd6ffba077 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:57.471161 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e48e817-f530-4d0a-a2c6-e5bd6ffba077 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:57.505206 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a61318-bbd4-49d4-8ad9-c3dc624046dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:57.505792 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a61318-bbd4-49d4-8ad9-c3dc624046dc None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:57.506073 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a61318-bbd4-49d4-8ad9-c3dc624046dc None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:57.506347 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a61318-bbd4-49d4-8ad9-c3dc624046dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:57.534726 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:57.573564 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a61318-bbd4-49d4-8ad9-c3dc624046dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:57.574936 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a61318-bbd4-49d4-8ad9-c3dc624046dc None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:57.671825 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 552/1115] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 03:17:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 03:17:57.678205 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb080490-421a-42ff-ad7d-6193e044f069 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:57.734935 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:57.775943 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb080490-421a-42ff-ad7d-6193e044f069 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:57.809291 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1804cc6c-e4a4-4cba-b379-8b2be3b9c208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:57.809897 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804cc6c-e4a4-4cba-b379-8b2be3b9c208 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:57.810176 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804cc6c-e4a4-4cba-b379-8b2be3b9c208 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:57.810447 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804cc6c-e4a4-4cba-b379-8b2be3b9c208 None admin] PATH_INFO: `/v3/projects/ec443268285846be8ec6531cd3cb4aef` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:57.811575 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1804cc6c-e4a4-4cba-b379-8b2be3b9c208 None admin] RBAC: Authorizing `identity:get_project(project_id=ec443268285846be8ec6531cd3cb4aef)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:57.812973 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1804cc6c-e4a4-4cba-b379-8b2be3b9c208 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:57.814551 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 564/1116] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 03:17:57 2022] GET /identity/v3/projects/ec443268285846be8ec6531cd3cb4aef => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:17:57.822038 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a61318-bbd4-49d4-8ad9-c3dc624046dc None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:17:57.880417 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:17:57.916641 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a61318-bbd4-49d4-8ad9-c3dc624046dc None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:17:57.950219 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb31cde2-870d-4783-a29e-8581c3936dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:17:57.950799 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31cde2-870d-4783-a29e-8581c3936dde None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:17:57.951076 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31cde2-870d-4783-a29e-8581c3936dde None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:17:57.951344 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31cde2-870d-4783-a29e-8581c3936dde None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:17:57.952078 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb31cde2-870d-4783-a29e-8581c3936dde None admin] RBAC: Adding query filter params (role.id=f2332a9a00b74fe0846d7211dd3850cb, scope.project.id=ec443268285846be8ec6531cd3cb4aef, user.id=db759c70543247079e15bb2806ae9599) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:17:57.952383 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb31cde2-870d-4783-a29e-8581c3936dde None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:17:57.953773 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb31cde2-870d-4783-a29e-8581c3936dde None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:17:57.958975 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 553/1117] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 03:17:57 2022] GET /identity/v3/role_assignments?user.id=db759c70543247079e15bb2806ae9599&scope.project.id=ec443268285846be8ec6531cd3cb4aef&role.id=f2332a9a00b74fe0846d7211dd3850cb => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:18:00.079053 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f41f42-e295-4180-8d04-c2017db26bfb None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:18:00.079624 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f41f42-e295-4180-8d04-c2017db26bfb None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:18:00.079624 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f41f42-e295-4180-8d04-c2017db26bfb None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:18:00.080965 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 565/1118] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:18:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:18:00.086709 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd506c22-d124-4dcc-961c-cf4e7bf9b48a None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:18:00.087114 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd506c22-d124-4dcc-961c-cf4e7bf9b48a None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:18:00.087255 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd506c22-d124-4dcc-961c-cf4e7bf9b48a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:18:00.105399 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-cd506c22-d124-4dcc-961c-cf4e7bf9b48a None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:18:00.106559 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-cd506c22-d124-4dcc-961c-cf4e7bf9b48a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:18:00.169998 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 554/1119] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:18:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 03:18:00.438245 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f41f42-e295-4180-8d04-c2017db26bfb None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:18:00.538573 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f41f42-e295-4180-8d04-c2017db26bfb None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:18:00.562758 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:18:00.572456 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da19e9fe-9538-49c6-a15a-b5354559fb44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:18:00.573072 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19e9fe-9538-49c6-a15a-b5354559fb44 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:18:00.573353 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19e9fe-9538-49c6-a15a-b5354559fb44 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:18:00.573628 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19e9fe-9538-49c6-a15a-b5354559fb44 None admin] PATH_INFO: `/v3/roles/f2332a9a00b74fe0846d7211dd3850cb` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:18:00.575012 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da19e9fe-9538-49c6-a15a-b5354559fb44 None admin] RBAC: Authorizing `identity:get_role(role_id=f2332a9a00b74fe0846d7211dd3850cb)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:18:00.576390 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da19e9fe-9538-49c6-a15a-b5354559fb44 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:18:00.577683 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 566/1120] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 03:18:00 2022] GET /identity/v3/roles/f2332a9a00b74fe0846d7211dd3850cb => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:18:00.584585 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd506c22-d124-4dcc-961c-cf4e7bf9b48a None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:18:00.640109 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:18:00.684046 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd506c22-d124-4dcc-961c-cf4e7bf9b48a None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:18:00.719987 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b39c74-4b61-4322-be8d-2cb62d52189b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:18:00.721042 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b39c74-4b61-4322-be8d-2cb62d52189b None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:18:00.721540 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b39c74-4b61-4322-be8d-2cb62d52189b None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:18:00.721841 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b39c74-4b61-4322-be8d-2cb62d52189b None admin] PATH_INFO: `/v3/users/db759c70543247079e15bb2806ae9599` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:18:00.723633 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b39c74-4b61-4322-be8d-2cb62d52189b None admin] RBAC: Authorizing `identity:get_user(user_id=db759c70543247079e15bb2806ae9599)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:18:00.725625 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b39c74-4b61-4322-be8d-2cb62d52189b None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:18:00.728023 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 555/1121] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 03:18:00 2022] GET /identity/v3/users/db759c70543247079e15bb2806ae9599 => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:18:00.733822 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da19e9fe-9538-49c6-a15a-b5354559fb44 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:18:00.832530 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da19e9fe-9538-49c6-a15a-b5354559fb44 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:18:00.865471 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65b76a4-2e79-4582-8125-51954a608aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:18:00.866083 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b76a4-2e79-4582-8125-51954a608aa3 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:18:00.866421 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b76a4-2e79-4582-8125-51954a608aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:18:00.866703 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b76a4-2e79-4582-8125-51954a608aa3 None admin] PATH_INFO: `/v3/projects/ec443268285846be8ec6531cd3cb4aef` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:18:00.867852 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65b76a4-2e79-4582-8125-51954a608aa3 None admin] RBAC: Authorizing `identity:get_project(project_id=ec443268285846be8ec6531cd3cb4aef)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:18:00.869260 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65b76a4-2e79-4582-8125-51954a608aa3 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:18:00.870891 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 567/1122] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 03:18:00 2022] GET /identity/v3/projects/ec443268285846be8ec6531cd3cb4aef => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:18:00.876741 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b39c74-4b61-4322-be8d-2cb62d52189b None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:18:00.975295 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b39c74-4b61-4322-be8d-2cb62d52189b None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:18:00.997641 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:18:01.009393 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0c2d95-14ab-42ae-a125-18084dc96abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:18:01.010035 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c2d95-14ab-42ae-a125-18084dc96abc None admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:18:01.010317 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c2d95-14ab-42ae-a125-18084dc96abc None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:18:01.010593 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c2d95-14ab-42ae-a125-18084dc96abc None admin] PATH_INFO: `/v3/projects/ec443268285846be8ec6531cd3cb4aef/users/db759c70543247079e15bb2806ae9599/roles/f2332a9a00b74fe0846d7211dd3850cb` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:18:01.012766 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0c2d95-14ab-42ae-a125-18084dc96abc None admin] RBAC: Authorizing `identity:create_grant(project_id=ec443268285846be8ec6531cd3cb4aef, user_id=db759c70543247079e15bb2806ae9599, role_id=f2332a9a00b74fe0846d7211dd3850cb)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:18:01.014653 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0c2d95-14ab-42ae-a125-18084dc96abc None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:18:01.032257 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 556/1123] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Oct 4 03:18:00 2022] PUT /identity/v3/projects/ec443268285846be8ec6531cd3cb4aef/users/db759c70543247079e15bb2806ae9599/roles/f2332a9a00b74fe0846d7211dd3850cb => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:18:03.158197 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04dc45-32e0-439a-92c4-7ffb863e670d None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:18:03.158728 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04dc45-32e0-439a-92c4-7ffb863e670d None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:18:03.158728 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04dc45-32e0-439a-92c4-7ffb863e670d None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:18:03.160727 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 568/1124] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:18:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:18:03.166575 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7171ac9-386b-40d4-8704-1a7d7ce4974e None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:18:03.167047 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7171ac9-386b-40d4-8704-1a7d7ce4974e None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:18:03.167150 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7171ac9-386b-40d4-8704-1a7d7ce4974e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:18:03.185884 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-c7171ac9-386b-40d4-8704-1a7d7ce4974e None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:18:03.187064 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-c7171ac9-386b-40d4-8704-1a7d7ce4974e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:18:03.260816 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 557/1125] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:18:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 03:18:03.553559 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc04dc45-32e0-439a-92c4-7ffb863e670d None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:18:03.624140 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:18:03.673050 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc04dc45-32e0-439a-92c4-7ffb863e670d None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:18:03.709353 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e685555-7b1c-41ad-ae8e-4d5fd4cd3306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:18:03.709973 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e685555-7b1c-41ad-ae8e-4d5fd4cd3306 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:18:03.710253 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e685555-7b1c-41ad-ae8e-4d5fd4cd3306 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:18:03.710527 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e685555-7b1c-41ad-ae8e-4d5fd4cd3306 None admin] PATH_INFO: `/v3/roles/f2332a9a00b74fe0846d7211dd3850cb` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:18:03.711956 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e685555-7b1c-41ad-ae8e-4d5fd4cd3306 None admin] RBAC: Authorizing `identity:get_role(role_id=f2332a9a00b74fe0846d7211dd3850cb)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:18:03.722294 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e685555-7b1c-41ad-ae8e-4d5fd4cd3306 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:18:03.723722 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 569/1126] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 03:18:03 2022] GET /identity/v3/roles/f2332a9a00b74fe0846d7211dd3850cb => generated 223 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:18:03.732444 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7171ac9-386b-40d4-8704-1a7d7ce4974e None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:18:03.830418 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7171ac9-386b-40d4-8704-1a7d7ce4974e None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:18:03.844422 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:18:03.865605 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaa5534-123f-47aa-b151-c82c752f7657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:18:03.866218 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa5534-123f-47aa-b151-c82c752f7657 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:18:03.866503 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa5534-123f-47aa-b151-c82c752f7657 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:18:03.866776 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa5534-123f-47aa-b151-c82c752f7657 None admin] PATH_INFO: `/v3/users/db759c70543247079e15bb2806ae9599` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:18:03.867923 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaa5534-123f-47aa-b151-c82c752f7657 None admin] RBAC: Authorizing `identity:get_user(user_id=db759c70543247079e15bb2806ae9599)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:18:03.869341 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaa5534-123f-47aa-b151-c82c752f7657 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:18:03.870913 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 558/1127] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 03:18:03 2022] GET /identity/v3/users/db759c70543247079e15bb2806ae9599 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:18:03.876738 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e685555-7b1c-41ad-ae8e-4d5fd4cd3306 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:18:03.972488 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e685555-7b1c-41ad-ae8e-4d5fd4cd3306 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:18:04.004517 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:18:04.006058 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb28179-c7cc-44f9-bd7a-d54eb30e6ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:18:04.006636 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb28179-c7cc-44f9-bd7a-d54eb30e6ceb None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:18:04.006939 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb28179-c7cc-44f9-bd7a-d54eb30e6ceb None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:18:04.007190 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb28179-c7cc-44f9-bd7a-d54eb30e6ceb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:18:04.072063 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb28179-c7cc-44f9-bd7a-d54eb30e6ceb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:18:04.073494 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb28179-c7cc-44f9-bd7a-d54eb30e6ceb None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:18:04.167857 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 570/1128] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 03:18:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 03:18:04.173768 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaa5534-123f-47aa-b151-c82c752f7657 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:18:04.270755 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaa5534-123f-47aa-b151-c82c752f7657 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:18:04.302885 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab747106-09b7-48d9-b680-e92f38748810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:18:04.303510 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab747106-09b7-48d9-b680-e92f38748810 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:18:04.303785 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab747106-09b7-48d9-b680-e92f38748810 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:18:04.304056 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab747106-09b7-48d9-b680-e92f38748810 None admin] PATH_INFO: `/v3/projects/ec443268285846be8ec6531cd3cb4aef` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:18:04.305151 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab747106-09b7-48d9-b680-e92f38748810 None admin] RBAC: Authorizing `identity:get_project(project_id=ec443268285846be8ec6531cd3cb4aef)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:18:04.306558 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab747106-09b7-48d9-b680-e92f38748810 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:18:04.308174 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 559/1129] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 03:18:04 2022] GET /identity/v3/projects/ec443268285846be8ec6531cd3cb4aef => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:18:04.314208 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb28179-c7cc-44f9-bd7a-d54eb30e6ceb None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:18:04.344404 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:18:04.413125 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb28179-c7cc-44f9-bd7a-d54eb30e6ceb None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:18:04.446810 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ef21fc-5bbe-49cd-beb9-b1ce60801fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:18:04.447331 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef21fc-5bbe-49cd-beb9-b1ce60801fd5 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:18:04.447643 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef21fc-5bbe-49cd-beb9-b1ce60801fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:18:04.447918 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef21fc-5bbe-49cd-beb9-b1ce60801fd5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:18:04.448629 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ef21fc-5bbe-49cd-beb9-b1ce60801fd5 None admin] RBAC: Adding query filter params (role.id=f2332a9a00b74fe0846d7211dd3850cb, scope.project.id=ec443268285846be8ec6531cd3cb4aef, user.id=db759c70543247079e15bb2806ae9599) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:18:04.448938 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ef21fc-5bbe-49cd-beb9-b1ce60801fd5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:18:04.450333 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ef21fc-5bbe-49cd-beb9-b1ce60801fd5 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:18:04.455839 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 571/1130] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 03:18:04 2022] GET /identity/v3/role_assignments?user.id=db759c70543247079e15bb2806ae9599&scope.project.id=ec443268285846be8ec6531cd3cb4aef&role.id=f2332a9a00b74fe0846d7211dd3850cb => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:18:06.662319 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319a678-16c8-4483-8a63-a0b593e03c7d None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:18:06.662780 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319a678-16c8-4483-8a63-a0b593e03c7d None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:18:06.662872 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319a678-16c8-4483-8a63-a0b593e03c7d None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:18:06.664211 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 560/1131] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:18:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 03:18:06.669437 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08143622-42ab-47e5-a1d1-62c020986878 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:18:06.669817 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08143622-42ab-47e5-a1d1-62c020986878 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:18:06.669990 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08143622-42ab-47e5-a1d1-62c020986878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:18:06.687730 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-08143622-42ab-47e5-a1d1-62c020986878 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:18:06.688902 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-08143622-42ab-47e5-a1d1-62c020986878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:18:06.752326 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 572/1132] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:18:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 03:18:07.020503 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2319a678-16c8-4483-8a63-a0b593e03c7d None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:18:07.071267 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:18:07.120380 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2319a678-16c8-4483-8a63-a0b593e03c7d None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:18:07.153395 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b19a0a-5624-436f-90b1-5207034255ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:18:07.154022 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b19a0a-5624-436f-90b1-5207034255ad None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:18:07.154305 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b19a0a-5624-436f-90b1-5207034255ad None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:18:07.154581 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b19a0a-5624-436f-90b1-5207034255ad None admin] PATH_INFO: `/v3/domains/default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:18:07.155724 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b19a0a-5624-436f-90b1-5207034255ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:18:07.157148 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b19a0a-5624-436f-90b1-5207034255ad None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:18:07.158715 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 561/1133] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:18:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:18:07.165134 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08143622-42ab-47e5-a1d1-62c020986878 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:18:07.189146 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:18:07.260118 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08143622-42ab-47e5-a1d1-62c020986878 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:18:07.293257 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9258a7-4324-49d0-92fd-ef34a0130ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:18:07.293793 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9258a7-4324-49d0-92fd-ef34a0130ff4 None admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:18:07.294075 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9258a7-4324-49d0-92fd-ef34a0130ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:18:07.294348 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9258a7-4324-49d0-92fd-ef34a0130ff4 None admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:18:07.295001 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9258a7-4324-49d0-92fd-ef34a0130ff4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:18:07.296455 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9258a7-4324-49d0-92fd-ef34a0130ff4 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:18:07.323068 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 573/1134] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Oct 4 03:18:07 2022] POST /identity/v3/projects => generated 311 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:18:09.458290 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f903e416-ff59-4f6a-bfb7-4e74fc56f658 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:18:09.458860 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f903e416-ff59-4f6a-bfb7-4e74fc56f658 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:18:09.458860 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f903e416-ff59-4f6a-bfb7-4e74fc56f658 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:18:09.460201 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 562/1135] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:18:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:18:09.465264 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718eb5f3-a8cb-4ac1-ac06-c36ad3c2da17 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:18:09.465678 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718eb5f3-a8cb-4ac1-ac06-c36ad3c2da17 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:18:09.465817 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718eb5f3-a8cb-4ac1-ac06-c36ad3c2da17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:18:09.484151 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-718eb5f3-a8cb-4ac1-ac06-c36ad3c2da17 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:18:09.485341 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-718eb5f3-a8cb-4ac1-ac06-c36ad3c2da17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:18:09.549019 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 574/1136] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:18:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 03:18:09.820696 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f903e416-ff59-4f6a-bfb7-4e74fc56f658 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:18:09.920037 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f903e416-ff59-4f6a-bfb7-4e74fc56f658 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:18:09.936653 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:18:09.953867 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f280a8c-57a3-4beb-8246-3d972893c48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:18:09.954473 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f280a8c-57a3-4beb-8246-3d972893c48d None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:18:09.954753 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f280a8c-57a3-4beb-8246-3d972893c48d None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:18:09.955024 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f280a8c-57a3-4beb-8246-3d972893c48d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:18:09.956125 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f280a8c-57a3-4beb-8246-3d972893c48d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:18:09.958074 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f280a8c-57a3-4beb-8246-3d972893c48d None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:18:09.959634 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 563/1137] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:18:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:18:09.965352 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718eb5f3-a8cb-4ac1-ac06-c36ad3c2da17 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:18:09.973935 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:18:10.061151 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718eb5f3-a8cb-4ac1-ac06-c36ad3c2da17 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:18:10.095178 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd02497e-f988-4284-bd93-47671a7e85b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:18:10.095739 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd02497e-f988-4284-bd93-47671a7e85b5 None admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:18:10.096023 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd02497e-f988-4284-bd93-47671a7e85b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:18:10.096297 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd02497e-f988-4284-bd93-47671a7e85b5 None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:18:10.096943 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd02497e-f988-4284-bd93-47671a7e85b5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:18:10.098532 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd02497e-f988-4284-bd93-47671a7e85b5 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:18:10.118938 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 575/1138] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Oct 4 03:18:09 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:18:12.321545 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202ec72-913d-48e6-b2b6-495c18c22d70 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:18:12.322098 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202ec72-913d-48e6-b2b6-495c18c22d70 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:18:12.322098 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202ec72-913d-48e6-b2b6-495c18c22d70 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:18:12.323422 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 564/1139] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:18:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:18:12.328721 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b315f-6680-4153-8bf5-81ffc877bbac None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:18:12.329096 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b315f-6680-4153-8bf5-81ffc877bbac None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:18:12.329274 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b315f-6680-4153-8bf5-81ffc877bbac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:18:12.348207 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-cf5b315f-6680-4153-8bf5-81ffc877bbac None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:18:12.349387 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-cf5b315f-6680-4153-8bf5-81ffc877bbac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:18:12.404830 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:18:12.415587 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 576/1140] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:18:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 03:18:12.692309 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3202ec72-913d-48e6-b2b6-495c18c22d70 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:18:12.790807 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3202ec72-913d-48e6-b2b6-495c18c22d70 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:18:12.823719 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe01adf-b78f-4324-afb4-eaa0530c9253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:18:12.824329 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe01adf-b78f-4324-afb4-eaa0530c9253 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:18:12.824609 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe01adf-b78f-4324-afb4-eaa0530c9253 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:18:12.824882 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe01adf-b78f-4324-afb4-eaa0530c9253 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:18:12.835310 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe01adf-b78f-4324-afb4-eaa0530c9253 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:18:12.840013 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-bbe01adf-b78f-4324-afb4-eaa0530c9253 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 03:18:12.840013 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:18:12.840013 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:18:12.840013 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:18:12.840013 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:18:12.840013 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:18:12.840013 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:18:12.840013 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:18:12.840013 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:18:12.840013 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:18:12.840013 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:18:12.840013 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:18:12.840013 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:18:12.840013 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:18:12.840013 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:18:12.840013 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:18:12.843674 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:18:12.843674 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:18:12.843674 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:18:12.843674 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:18:12.843674 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:18:12.843674 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:18:12.843674 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:18:12.843674 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:18:12.843674 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:18:12.843674 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:18:12.843674 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:18:12.843674 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:18:12.843674 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:18:12.843674 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:18:12.843674 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:18:12.843674 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:18:12.844837 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:18:12.844837 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:18:12.844837 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:18:12.844837 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:18:12.844837 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:18:12.844837 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:18:12.844837 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:18:12.844837 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:18:12.844837 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:18:12.844837 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:18:12.844837 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 03:18:12.844837 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:18:12.844837 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 565/1141] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 4 03:18:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:18:12.847046 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5b315f-6680-4153-8bf5-81ffc877bbac None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:18:12.943869 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5b315f-6680-4153-8bf5-81ffc877bbac None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:18:12.976937 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87187e8c-2295-431e-aab7-dbcce1a884d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:18:12.977527 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87187e8c-2295-431e-aab7-dbcce1a884d2 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:18:12.977811 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87187e8c-2295-431e-aab7-dbcce1a884d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:18:12.978089 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87187e8c-2295-431e-aab7-dbcce1a884d2 None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:18:12.978745 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87187e8c-2295-431e-aab7-dbcce1a884d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:18:12.979052 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87187e8c-2295-431e-aab7-dbcce1a884d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:18:12.980432 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87187e8c-2295-431e-aab7-dbcce1a884d2 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:18:12.988754 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 577/1142] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 03:18:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:18:12.994579 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe01adf-b78f-4324-afb4-eaa0530c9253 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:18:13.040915 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:18:13.093038 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe01adf-b78f-4324-afb4-eaa0530c9253 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:18:13.127676 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332334bc-feee-430c-87a0-738b6d92f9e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:18:13.128292 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332334bc-feee-430c-87a0-738b6d92f9e4 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:18:13.128599 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332334bc-feee-430c-87a0-738b6d92f9e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:18:13.128904 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332334bc-feee-430c-87a0-738b6d92f9e4 None admin] PATH_INFO: `/v3/users/4abdbf629cf64cf6ae91819e5dd792b4` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:18:13.141482 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332334bc-feee-430c-87a0-738b6d92f9e4 None admin] RBAC: Authorizing `identity:get_user(user_id=4abdbf629cf64cf6ae91819e5dd792b4)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:18:13.142896 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332334bc-feee-430c-87a0-738b6d92f9e4 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:18:13.144641 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 566/1143] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 03:18:12 2022] GET /identity/v3/users/4abdbf629cf64cf6ae91819e5dd792b4 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:18:13.150266 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87187e8c-2295-431e-aab7-dbcce1a884d2 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:18:13.205128 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:18:13.248988 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87187e8c-2295-431e-aab7-dbcce1a884d2 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:18:13.283693 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9041f2-8237-4eaf-9103-b99eba4c60a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:18:13.284287 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9041f2-8237-4eaf-9103-b99eba4c60a4 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:18:13.284567 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9041f2-8237-4eaf-9103-b99eba4c60a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:18:13.285358 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9041f2-8237-4eaf-9103-b99eba4c60a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:18:13.349966 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9041f2-8237-4eaf-9103-b99eba4c60a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:18:13.351387 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9041f2-8237-4eaf-9103-b99eba4c60a4 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:18:13.408614 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:18:13.453479 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 578/1144] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 03:18:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 03:18:13.459547 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332334bc-feee-430c-87a0-738b6d92f9e4 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:18:13.553982 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332334bc-feee-430c-87a0-738b6d92f9e4 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:18:13.556199 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:18:13.587233 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a679db-7c51-4fd0-a9ea-d4046ef17b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:18:13.587868 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a679db-7c51-4fd0-a9ea-d4046ef17b6d None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:18:13.588149 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a679db-7c51-4fd0-a9ea-d4046ef17b6d None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:18:13.588419 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a679db-7c51-4fd0-a9ea-d4046ef17b6d None admin] PATH_INFO: `/v3/projects/f173d76cc9ba435bae966c613e6091e3` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:18:13.589510 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a679db-7c51-4fd0-a9ea-d4046ef17b6d None admin] RBAC: Authorizing `identity:get_project(project_id=f173d76cc9ba435bae966c613e6091e3)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:18:13.590993 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a679db-7c51-4fd0-a9ea-d4046ef17b6d None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:18:13.592616 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 567/1145] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 03:18:13 2022] GET /identity/v3/projects/f173d76cc9ba435bae966c613e6091e3 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:18:13.599200 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9041f2-8237-4eaf-9103-b99eba4c60a4 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:18:13.695665 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9041f2-8237-4eaf-9103-b99eba4c60a4 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:18:13.729125 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f64c41-8c90-4310-b83e-9819e48b25d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:18:13.729719 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f64c41-8c90-4310-b83e-9819e48b25d7 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:18:13.729997 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f64c41-8c90-4310-b83e-9819e48b25d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:18:13.730266 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f64c41-8c90-4310-b83e-9819e48b25d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:18:13.730971 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f64c41-8c90-4310-b83e-9819e48b25d7 None admin] RBAC: Adding query filter params (role.id=fe9379cda35c4ff78576fe48b60bea3c, scope.project.id=f173d76cc9ba435bae966c613e6091e3, user.id=4abdbf629cf64cf6ae91819e5dd792b4) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:18:13.731276 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f64c41-8c90-4310-b83e-9819e48b25d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:18:13.732719 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f64c41-8c90-4310-b83e-9819e48b25d7 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:18:13.738621 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 579/1146] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 03:18:13 2022] GET /identity/v3/role_assignments?user.id=4abdbf629cf64cf6ae91819e5dd792b4&scope.project.id=f173d76cc9ba435bae966c613e6091e3&role.id=fe9379cda35c4ff78576fe48b60bea3c => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:18:15.834032 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a74eb-575c-48f5-933e-1cdbdbad2b53 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:18:15.834911 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a74eb-575c-48f5-933e-1cdbdbad2b53 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:18:15.835189 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a74eb-575c-48f5-933e-1cdbdbad2b53 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:18:15.836620 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 568/1147] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:18:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:18:15.841599 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534cf7e1-9caf-41cd-ac07-a5e0a9da31bf None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:18:15.842012 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534cf7e1-9caf-41cd-ac07-a5e0a9da31bf None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:18:15.842141 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534cf7e1-9caf-41cd-ac07-a5e0a9da31bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:18:15.859774 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-534cf7e1-9caf-41cd-ac07-a5e0a9da31bf None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:18:15.860943 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-534cf7e1-9caf-41cd-ac07-a5e0a9da31bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:18:15.874189 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:18:15.927129 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 580/1148] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:18:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 03:18:16.195391 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70a74eb-575c-48f5-933e-1cdbdbad2b53 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:18:16.294485 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70a74eb-575c-48f5-933e-1cdbdbad2b53 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:18:16.327927 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b5e99f-6f8e-4ef0-8875-f1685a873045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:18:16.328536 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b5e99f-6f8e-4ef0-8875-f1685a873045 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:18:16.328820 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b5e99f-6f8e-4ef0-8875-f1685a873045 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:18:16.329096 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b5e99f-6f8e-4ef0-8875-f1685a873045 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:18:16.339524 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b5e99f-6f8e-4ef0-8875-f1685a873045 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:18:16.344268 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-f1b5e99f-6f8e-4ef0-8875-f1685a873045 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 03:18:16.344268 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:18:16.344268 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:18:16.344268 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:18:16.344268 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:18:16.344268 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:18:16.344268 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:18:16.344268 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:18:16.344268 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:18:16.344268 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:18:16.344268 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:18:16.344268 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:18:16.344268 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:18:16.344268 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:18:16.344268 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:18:16.344268 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:18:16.345374 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:18:16.345374 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:18:16.345374 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:18:16.345374 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:18:16.345374 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:18:16.345374 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:18:16.345374 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:18:16.345374 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:18:16.345374 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:18:16.345374 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:18:16.345374 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:18:16.345374 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:18:16.345374 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:18:16.345374 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:18:16.345374 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:18:16.345374 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:18:16.346427 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:18:16.346427 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:18:16.346427 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:18:16.346427 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:18:16.346427 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:18:16.346427 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:18:16.346427 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:18:16.346427 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:18:16.346427 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:18:16.346427 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:18:16.346427 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 03:18:16.346427 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:18:16.346427 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 569/1149] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 4 03:18:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:18:16.351671 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534cf7e1-9caf-41cd-ac07-a5e0a9da31bf None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:18:16.455565 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534cf7e1-9caf-41cd-ac07-a5e0a9da31bf None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:18:16.487643 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a931812d-174f-44ef-80af-950d2dad53fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:18:16.488227 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a931812d-174f-44ef-80af-950d2dad53fb None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:18:16.488502 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a931812d-174f-44ef-80af-950d2dad53fb None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:18:16.488770 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a931812d-174f-44ef-80af-950d2dad53fb None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:18:16.489942 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a931812d-174f-44ef-80af-950d2dad53fb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:18:16.490235 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a931812d-174f-44ef-80af-950d2dad53fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:18:16.491594 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a931812d-174f-44ef-80af-950d2dad53fb None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:18:16.499194 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 581/1150] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 03:18:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:18:16.505703 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b5e99f-6f8e-4ef0-8875-f1685a873045 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:18:16.536528 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:18:16.604220 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b5e99f-6f8e-4ef0-8875-f1685a873045 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:18:16.638121 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbadfd4-ecd6-462c-9149-b421af9034c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:18:16.638751 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbadfd4-ecd6-462c-9149-b421af9034c0 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:18:16.639033 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbadfd4-ecd6-462c-9149-b421af9034c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:18:16.639308 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbadfd4-ecd6-462c-9149-b421af9034c0 None admin] PATH_INFO: `/v3/users/4abdbf629cf64cf6ae91819e5dd792b4` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:18:16.640463 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbadfd4-ecd6-462c-9149-b421af9034c0 None admin] RBAC: Authorizing `identity:get_user(user_id=4abdbf629cf64cf6ae91819e5dd792b4)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:18:16.641884 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbadfd4-ecd6-462c-9149-b421af9034c0 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:18:16.643449 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 570/1151] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 03:18:16 2022] GET /identity/v3/users/4abdbf629cf64cf6ae91819e5dd792b4 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:18:16.649212 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a931812d-174f-44ef-80af-950d2dad53fb None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:18:16.661582 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:18:16.745721 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a931812d-174f-44ef-80af-950d2dad53fb None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:18:16.777172 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f715c1-a272-4ff8-8f15-90e68faa5551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:18:16.777800 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f715c1-a272-4ff8-8f15-90e68faa5551 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:18:16.778079 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f715c1-a272-4ff8-8f15-90e68faa5551 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:18:16.778350 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f715c1-a272-4ff8-8f15-90e68faa5551 None admin] PATH_INFO: `/v3/projects/f173d76cc9ba435bae966c613e6091e3` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:18:16.779441 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f715c1-a272-4ff8-8f15-90e68faa5551 None admin] RBAC: Authorizing `identity:get_project(project_id=f173d76cc9ba435bae966c613e6091e3)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:18:16.780861 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f715c1-a272-4ff8-8f15-90e68faa5551 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:18:16.782459 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 582/1152] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 03:18:16 2022] GET /identity/v3/projects/f173d76cc9ba435bae966c613e6091e3 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:18:16.789086 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbadfd4-ecd6-462c-9149-b421af9034c0 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:18:16.884489 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:18:16.887437 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbadfd4-ecd6-462c-9149-b421af9034c0 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:18:16.920857 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c210411-76f7-4aa0-9db3-162133878542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:18:16.921500 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c210411-76f7-4aa0-9db3-162133878542 None admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:18:16.921783 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c210411-76f7-4aa0-9db3-162133878542 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:18:16.922056 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c210411-76f7-4aa0-9db3-162133878542 None admin] PATH_INFO: `/v3/projects/f173d76cc9ba435bae966c613e6091e3/users/4abdbf629cf64cf6ae91819e5dd792b4/roles/fe9379cda35c4ff78576fe48b60bea3c` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:18:16.923987 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c210411-76f7-4aa0-9db3-162133878542 None admin] RBAC: Authorizing `identity:create_grant(project_id=f173d76cc9ba435bae966c613e6091e3, user_id=4abdbf629cf64cf6ae91819e5dd792b4, role_id=fe9379cda35c4ff78576fe48b60bea3c)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:18:16.925409 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c210411-76f7-4aa0-9db3-162133878542 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:18:16.938925 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 571/1153] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Oct 4 03:18:16 2022] PUT /identity/v3/projects/f173d76cc9ba435bae966c613e6091e3/users/4abdbf629cf64cf6ae91819e5dd792b4/roles/fe9379cda35c4ff78576fe48b60bea3c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:18:19.078231 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d266688c-b11e-4155-8fef-e4ea84383364 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:18:19.078820 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d266688c-b11e-4155-8fef-e4ea84383364 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:18:19.078820 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d266688c-b11e-4155-8fef-e4ea84383364 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:18:19.080154 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 583/1154] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:18:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:18:19.085524 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70672e6-efd3-48fb-b0d0-8b8e9a46de25 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:18:19.085940 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70672e6-efd3-48fb-b0d0-8b8e9a46de25 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:18:19.086076 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70672e6-efd3-48fb-b0d0-8b8e9a46de25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:18:19.104478 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-a70672e6-efd3-48fb-b0d0-8b8e9a46de25 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:18:19.105662 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-a70672e6-efd3-48fb-b0d0-8b8e9a46de25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:18:19.169899 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 572/1155] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:18:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 03:18:19.442109 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d266688c-b11e-4155-8fef-e4ea84383364 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:18:19.519977 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:18:19.547028 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d266688c-b11e-4155-8fef-e4ea84383364 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:18:19.579730 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645bc521-e462-4750-9fa0-99f99247f724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:18:19.580340 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645bc521-e462-4750-9fa0-99f99247f724 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:18:19.580619 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645bc521-e462-4750-9fa0-99f99247f724 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:18:19.580892 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645bc521-e462-4750-9fa0-99f99247f724 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:18:19.591551 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645bc521-e462-4750-9fa0-99f99247f724 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:18:19.596214 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-645bc521-e462-4750-9fa0-99f99247f724 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 03:18:19.596214 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:18:19.596214 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:18:19.596214 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:18:19.596214 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:18:19.596214 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:18:19.596214 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:18:19.596214 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:18:19.596214 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:18:19.596214 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:18:19.596214 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:18:19.596214 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:18:19.596214 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:18:19.596214 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:18:19.596214 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:18:19.596214 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:18:19.597410 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:18:19.597410 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:18:19.597410 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:18:19.597410 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:18:19.597410 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:18:19.597410 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:18:19.597410 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:18:19.597410 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:18:19.597410 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:18:19.597410 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:18:19.597410 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:18:19.597410 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:18:19.597410 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:18:19.597410 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:18:19.597410 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:18:19.597410 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:18:19.599191 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:18:19.599191 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:18:19.599191 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:18:19.599191 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:18:19.599191 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:18:19.599191 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:18:19.599191 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:18:19.599191 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:18:19.599191 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:18:19.599191 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:18:19.599191 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 03:18:19.599191 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:18:19.599191 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 584/1156] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 4 03:18:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:18:19.603959 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70672e6-efd3-48fb-b0d0-8b8e9a46de25 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:18:19.690203 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:18:19.701756 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70672e6-efd3-48fb-b0d0-8b8e9a46de25 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:18:19.734505 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e6948-223a-4196-8af1-8f1717bf327a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:18:19.735098 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e6948-223a-4196-8af1-8f1717bf327a None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:18:19.735379 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e6948-223a-4196-8af1-8f1717bf327a None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:18:19.735679 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e6948-223a-4196-8af1-8f1717bf327a None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:18:19.736336 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47e6948-223a-4196-8af1-8f1717bf327a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:18:19.736638 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47e6948-223a-4196-8af1-8f1717bf327a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:18:19.737993 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47e6948-223a-4196-8af1-8f1717bf327a None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:18:19.746277 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 573/1157] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 03:18:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:18:19.752244 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645bc521-e462-4750-9fa0-99f99247f724 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:18:19.848264 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645bc521-e462-4750-9fa0-99f99247f724 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:18:19.880900 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227eecaa-7b2b-411d-b182-6aca64b97d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:18:19.881501 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227eecaa-7b2b-411d-b182-6aca64b97d2a None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:18:19.881781 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227eecaa-7b2b-411d-b182-6aca64b97d2a None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:18:19.882054 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227eecaa-7b2b-411d-b182-6aca64b97d2a None admin] PATH_INFO: `/v3/users/4abdbf629cf64cf6ae91819e5dd792b4` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:18:19.883158 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227eecaa-7b2b-411d-b182-6aca64b97d2a None admin] RBAC: Authorizing `identity:get_user(user_id=4abdbf629cf64cf6ae91819e5dd792b4)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:18:19.884593 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227eecaa-7b2b-411d-b182-6aca64b97d2a None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:18:19.886132 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 585/1158] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 03:18:19 2022] GET /identity/v3/users/4abdbf629cf64cf6ae91819e5dd792b4 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:18:19.891797 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e6948-223a-4196-8af1-8f1717bf327a None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:18:19.989873 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e6948-223a-4196-8af1-8f1717bf327a None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:18:20.022188 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1de774-711e-42b1-a184-859353f10701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:18:20.022777 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1de774-711e-42b1-a184-859353f10701 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:18:20.023057 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1de774-711e-42b1-a184-859353f10701 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:18:20.023331 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1de774-711e-42b1-a184-859353f10701 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:18:20.043941 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:18:20.088964 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1de774-711e-42b1-a184-859353f10701 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:18:20.090383 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1de774-711e-42b1-a184-859353f10701 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:18:20.184161 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 574/1159] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 03:18:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 03:18:20.190190 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227eecaa-7b2b-411d-b182-6aca64b97d2a None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:18:20.199824 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:18:20.289432 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227eecaa-7b2b-411d-b182-6aca64b97d2a None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:18:20.321615 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711150e-c818-4d37-b60c-fa1fe229077c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:18:20.322225 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711150e-c818-4d37-b60c-fa1fe229077c None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:18:20.322507 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711150e-c818-4d37-b60c-fa1fe229077c None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:18:20.322779 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711150e-c818-4d37-b60c-fa1fe229077c None admin] PATH_INFO: `/v3/projects/f173d76cc9ba435bae966c613e6091e3` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:18:20.323904 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e711150e-c818-4d37-b60c-fa1fe229077c None admin] RBAC: Authorizing `identity:get_project(project_id=f173d76cc9ba435bae966c613e6091e3)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:18:20.325310 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e711150e-c818-4d37-b60c-fa1fe229077c None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:18:20.326902 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 586/1160] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 03:18:20 2022] GET /identity/v3/projects/f173d76cc9ba435bae966c613e6091e3 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:18:20.333657 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1de774-711e-42b1-a184-859353f10701 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:18:20.383551 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:18:20.429074 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1de774-711e-42b1-a184-859353f10701 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:18:20.463137 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e7aa3f-f6ca-4fd5-9d60-851ce101aaa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:18:20.463751 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7aa3f-f6ca-4fd5-9d60-851ce101aaa6 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:18:20.464030 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7aa3f-f6ca-4fd5-9d60-851ce101aaa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:18:20.464299 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7aa3f-f6ca-4fd5-9d60-851ce101aaa6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:18:20.465005 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e7aa3f-f6ca-4fd5-9d60-851ce101aaa6 None admin] RBAC: Adding query filter params (role.id=fe9379cda35c4ff78576fe48b60bea3c, scope.project.id=f173d76cc9ba435bae966c613e6091e3, user.id=4abdbf629cf64cf6ae91819e5dd792b4) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:18:20.465307 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e7aa3f-f6ca-4fd5-9d60-851ce101aaa6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:18:20.466689 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e7aa3f-f6ca-4fd5-9d60-851ce101aaa6 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:18:20.472256 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 575/1161] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 03:18:20 2022] GET /identity/v3/role_assignments?user.id=4abdbf629cf64cf6ae91819e5dd792b4&scope.project.id=f173d76cc9ba435bae966c613e6091e3&role.id=fe9379cda35c4ff78576fe48b60bea3c => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:18:22.625298 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd276ce4-0c68-4a6d-8029-efee9a6e015f None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:18:22.625821 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd276ce4-0c68-4a6d-8029-efee9a6e015f None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:18:22.625930 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd276ce4-0c68-4a6d-8029-efee9a6e015f None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:18:22.627172 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 587/1162] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:18:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:18:22.632807 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82861b99-867b-4cd3-9693-2e21056e5193 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:18:22.633217 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82861b99-867b-4cd3-9693-2e21056e5193 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:18:22.633499 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82861b99-867b-4cd3-9693-2e21056e5193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:18:22.651955 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-82861b99-867b-4cd3-9693-2e21056e5193 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:18:22.653119 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-82861b99-867b-4cd3-9693-2e21056e5193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:18:22.717837 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 576/1163] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:18:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 03:18:22.980777 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd276ce4-0c68-4a6d-8029-efee9a6e015f None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:18:23.055982 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:18:23.080883 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd276ce4-0c68-4a6d-8029-efee9a6e015f None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:18:23.115340 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fcfdbb-89a9-4ee1-96ce-cce2f333bf51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:18:23.115960 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fcfdbb-89a9-4ee1-96ce-cce2f333bf51 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:18:23.116242 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fcfdbb-89a9-4ee1-96ce-cce2f333bf51 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:18:23.116517 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fcfdbb-89a9-4ee1-96ce-cce2f333bf51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:18:23.181627 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fcfdbb-89a9-4ee1-96ce-cce2f333bf51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:18:23.183051 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fcfdbb-89a9-4ee1-96ce-cce2f333bf51 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:18:23.252379 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:18:23.276889 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 588/1164] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 03:18:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 03:18:23.282814 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82861b99-867b-4cd3-9693-2e21056e5193 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:18:23.328703 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:18:23.379148 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82861b99-867b-4cd3-9693-2e21056e5193 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:18:23.411783 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d216a6-55eb-4e57-af5a-1e9b1a7f7165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:18:23.412380 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d216a6-55eb-4e57-af5a-1e9b1a7f7165 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:18:23.412658 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d216a6-55eb-4e57-af5a-1e9b1a7f7165 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:18:23.412926 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d216a6-55eb-4e57-af5a-1e9b1a7f7165 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:18:23.419212 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d216a6-55eb-4e57-af5a-1e9b1a7f7165 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:18:23.420654 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d216a6-55eb-4e57-af5a-1e9b1a7f7165 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:18:23.435577 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-b1d216a6-55eb-4e57-af5a-1e9b1a7f7165 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Oct 04 03:18:23.435577 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:18:23.435577 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 04 03:18:23.435577 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 04 03:18:23.435577 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 03:18:23.435577 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 03:18:23.435577 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 03:18:23.435577 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 03:18:23.435577 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Oct 04 03:18:23.435577 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:18:23.435577 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 03:18:23.435577 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:18:23.435577 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:18:23.435577 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:18:23.435577 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:18:23.435577 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:18:23.435577 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:18:23.436810 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:18:23.436810 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:18:23.436810 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:18:23.436810 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:18:23.436810 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:18:23.436810 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:18:23.436810 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 03:18:23.436810 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 03:18:23.436810 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 03:18:23.436810 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 03:18:23.436810 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:18:23.436810 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:18:23.436810 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:18:23.436810 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:18:23.436810 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:18:23.436810 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:18:23.437855 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:18:23.437855 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:18:23.437855 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:18:23.437855 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:18:23.437855 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:18:23.437855 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:18:23.437855 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:18:23.437855 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:18:23.437855 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:18:23.437855 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:18:23.437855 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 04 03:18:23.437855 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 03:18:23.437855 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Oct 04 03:18:23.437855 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:18:23.437855 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 577/1165] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Oct 4 03:18:23 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:18:23.443354 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fcfdbb-89a9-4ee1-96ce-cce2f333bf51 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:18:23.538365 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fcfdbb-89a9-4ee1-96ce-cce2f333bf51 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:18:23.570488 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22206caf-0351-432c-8c73-a100c05682e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:18:23.571070 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22206caf-0351-432c-8c73-a100c05682e3 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:18:23.571346 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22206caf-0351-432c-8c73-a100c05682e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:18:23.571646 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22206caf-0351-432c-8c73-a100c05682e3 None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:18:23.572269 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22206caf-0351-432c-8c73-a100c05682e3 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:18:23.572570 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22206caf-0351-432c-8c73-a100c05682e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:18:23.573912 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22206caf-0351-432c-8c73-a100c05682e3 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:18:23.580671 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 589/1166] 10.222.0.25 () {56 vars in 1115 bytes} [Tue Oct 4 03:18:23 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:18:25.703349 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f6e7e-7c40-4d92-b59c-79df0e6bb6e7 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:18:25.704001 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f6e7e-7c40-4d92-b59c-79df0e6bb6e7 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:18:25.704001 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f6e7e-7c40-4d92-b59c-79df0e6bb6e7 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:18:25.705305 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 578/1167] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:18:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:18:25.711195 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ec225-6cc3-4576-8c83-e877f36da3df None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:18:25.711610 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ec225-6cc3-4576-8c83-e877f36da3df None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:18:25.711789 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ec225-6cc3-4576-8c83-e877f36da3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:18:25.729850 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-867ec225-6cc3-4576-8c83-e877f36da3df None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:18:25.731029 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-867ec225-6cc3-4576-8c83-e877f36da3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:18:25.760464 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:18:25.797443 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 590/1168] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:18:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 03:18:26.073793 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f6e7e-7c40-4d92-b59c-79df0e6bb6e7 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:18:26.171343 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f6e7e-7c40-4d92-b59c-79df0e6bb6e7 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:18:26.178494 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:18:26.204521 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db66d5a-5f51-4a57-85ac-ff3fd9453ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:18:26.205118 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db66d5a-5f51-4a57-85ac-ff3fd9453ecd None admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:18:26.205403 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db66d5a-5f51-4a57-85ac-ff3fd9453ecd None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:18:26.205682 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db66d5a-5f51-4a57-85ac-ff3fd9453ecd None admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:18:26.206358 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db66d5a-5f51-4a57-85ac-ff3fd9453ecd None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:18:26.208386 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db66d5a-5f51-4a57-85ac-ff3fd9453ecd None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:18:26.224184 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 579/1169] 10.222.0.25 () {60 vars in 1138 bytes} [Tue Oct 4 03:18:26 2022] POST /identity/v3/domains => generated 267 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 03:18:28.423158 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a146d2-778b-4e13-8a0a-b1e1c31774db None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:18:28.423732 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a146d2-778b-4e13-8a0a-b1e1c31774db None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:18:28.423732 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a146d2-778b-4e13-8a0a-b1e1c31774db None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:18:28.425052 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 591/1170] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:18:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:18:28.430487 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76a394-edce-4c0e-b59d-2a684481ef4a None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:18:28.430881 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76a394-edce-4c0e-b59d-2a684481ef4a None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:18:28.431038 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76a394-edce-4c0e-b59d-2a684481ef4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:18:28.449313 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-9f76a394-edce-4c0e-b59d-2a684481ef4a None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:18:28.450483 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-9f76a394-edce-4c0e-b59d-2a684481ef4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:18:28.515116 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 580/1171] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:18:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 03:18:28.789802 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a146d2-778b-4e13-8a0a-b1e1c31774db None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:18:28.887977 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a146d2-778b-4e13-8a0a-b1e1c31774db None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:18:28.922711 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e60fab-ba56-4023-9dfa-7a32b232e97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:18:28.923321 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e60fab-ba56-4023-9dfa-7a32b232e97a None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:18:28.923627 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e60fab-ba56-4023-9dfa-7a32b232e97a None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:18:28.923897 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e60fab-ba56-4023-9dfa-7a32b232e97a None admin] PATH_INFO: `/v3/domains/936ee03887234f298d11179de809b1d4` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:18:28.934779 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e60fab-ba56-4023-9dfa-7a32b232e97a None admin] RBAC: Authorizing `identity:get_domain(domain_id=936ee03887234f298d11179de809b1d4)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:18:28.936217 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e60fab-ba56-4023-9dfa-7a32b232e97a None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:18:28.937775 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 592/1172] 10.222.0.25 () {56 vars in 1183 bytes} [Tue Oct 4 03:18:28 2022] GET /identity/v3/domains/936ee03887234f298d11179de809b1d4 => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:18:28.943753 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f76a394-edce-4c0e-b59d-2a684481ef4a None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:18:29.033286 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:18:29.040079 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f76a394-edce-4c0e-b59d-2a684481ef4a None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:18:29.079142 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cec7d8-3b4d-4db8-a3e8-fdc0d9dc8340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:18:29.079775 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cec7d8-3b4d-4db8-a3e8-fdc0d9dc8340 None admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:18:29.080056 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cec7d8-3b4d-4db8-a3e8-fdc0d9dc8340 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:18:29.080326 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cec7d8-3b4d-4db8-a3e8-fdc0d9dc8340 None admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:18:29.080970 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cec7d8-3b4d-4db8-a3e8-fdc0d9dc8340 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:18:29.083775 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cec7d8-3b4d-4db8-a3e8-fdc0d9dc8340 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:18:29.110424 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 581/1173] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Oct 4 03:18:28 2022] POST /identity/v3/projects => generated 361 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:18:31.274295 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a8734-5456-4a3a-bf9c-dc7e294bbdc2 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:18:31.274814 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a8734-5456-4a3a-bf9c-dc7e294bbdc2 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:18:31.274927 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a8734-5456-4a3a-bf9c-dc7e294bbdc2 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:18:31.276197 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 593/1174] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:18:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:18:31.281545 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45482c-d102-48f6-b2a3-379a08a098ee None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:18:31.281928 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45482c-d102-48f6-b2a3-379a08a098ee None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:18:31.282091 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45482c-d102-48f6-b2a3-379a08a098ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:18:31.300422 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-8c45482c-d102-48f6-b2a3-379a08a098ee None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:18:31.302283 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-8c45482c-d102-48f6-b2a3-379a08a098ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:18:31.365855 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 582/1175] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:18:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 03:18:31.640737 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20a8734-5456-4a3a-bf9c-dc7e294bbdc2 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:18:31.669613 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:18:31.739899 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20a8734-5456-4a3a-bf9c-dc7e294bbdc2 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:18:31.776543 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e88a6e-cbf7-44cd-a409-a60a492f0d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:18:31.777157 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e88a6e-cbf7-44cd-a409-a60a492f0d93 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:18:31.777446 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e88a6e-cbf7-44cd-a409-a60a492f0d93 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:18:31.777721 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e88a6e-cbf7-44cd-a409-a60a492f0d93 None admin] PATH_INFO: `/v3/domains/936ee03887234f298d11179de809b1d4` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:18:31.778828 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e88a6e-cbf7-44cd-a409-a60a492f0d93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=936ee03887234f298d11179de809b1d4)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:18:31.780291 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e88a6e-cbf7-44cd-a409-a60a492f0d93 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:18:31.781848 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 594/1176] 10.222.0.25 () {56 vars in 1183 bytes} [Tue Oct 4 03:18:31 2022] GET /identity/v3/domains/936ee03887234f298d11179de809b1d4 => generated 267 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:18:31.788167 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c45482c-d102-48f6-b2a3-379a08a098ee None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:18:31.865249 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:18:31.886977 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c45482c-d102-48f6-b2a3-379a08a098ee None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:18:31.920502 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c8abdd-4620-4dd5-9f1a-b63040d6a1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:18:31.921090 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8abdd-4620-4dd5-9f1a-b63040d6a1b2 None admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:18:31.921371 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8abdd-4620-4dd5-9f1a-b63040d6a1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:18:31.921644 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8abdd-4620-4dd5-9f1a-b63040d6a1b2 None admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:18:31.922280 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c8abdd-4620-4dd5-9f1a-b63040d6a1b2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:18:31.923715 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c8abdd-4620-4dd5-9f1a-b63040d6a1b2 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:18:31.945414 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 583/1177] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Oct 4 03:18:31 2022] POST /identity/v3/users => generated 311 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:18:34.108959 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407434e-b9a6-448d-98de-f9c900c9bc24 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:18:34.109512 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407434e-b9a6-448d-98de-f9c900c9bc24 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:18:34.109512 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407434e-b9a6-448d-98de-f9c900c9bc24 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:18:34.110821 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 595/1178] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:18:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:18:34.116246 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d499121d-5de2-4060-b004-7ec50bd5ab59 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:18:34.116683 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d499121d-5de2-4060-b004-7ec50bd5ab59 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:18:34.116776 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d499121d-5de2-4060-b004-7ec50bd5ab59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:18:34.135182 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-d499121d-5de2-4060-b004-7ec50bd5ab59 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:18:34.136389 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-d499121d-5de2-4060-b004-7ec50bd5ab59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:18:34.201302 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 584/1179] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:18:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 03:18:34.470260 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6407434e-b9a6-448d-98de-f9c900c9bc24 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:18:34.563055 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:18:34.571117 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6407434e-b9a6-448d-98de-f9c900c9bc24 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:18:34.603673 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e0cba-afca-476f-84ca-551082c6d5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:18:34.604289 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e0cba-afca-476f-84ca-551082c6d5b2 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:18:34.604570 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e0cba-afca-476f-84ca-551082c6d5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:18:34.604843 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e0cba-afca-476f-84ca-551082c6d5b2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:18:34.615124 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8e0cba-afca-476f-84ca-551082c6d5b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:18:34.619841 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-cf8e0cba-afca-476f-84ca-551082c6d5b2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 03:18:34.619841 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:18:34.619841 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:18:34.619841 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:18:34.619841 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:18:34.619841 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:18:34.619841 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:18:34.619841 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:18:34.619841 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:18:34.619841 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:18:34.619841 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:18:34.619841 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:18:34.619841 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:18:34.619841 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:18:34.619841 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:18:34.619841 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:18:34.620932 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:18:34.620932 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:18:34.620932 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:18:34.620932 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:18:34.620932 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:18:34.620932 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:18:34.620932 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:18:34.620932 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:18:34.620932 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:18:34.620932 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:18:34.620932 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:18:34.620932 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:18:34.620932 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:18:34.620932 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:18:34.620932 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:18:34.620932 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:18:34.621992 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:18:34.621992 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:18:34.621992 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:18:34.621992 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:18:34.621992 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:18:34.621992 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:18:34.621992 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:18:34.621992 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:18:34.621992 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:18:34.621992 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:18:34.621992 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 03:18:34.621992 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:18:34.621992 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 596/1180] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 4 03:18:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:18:34.626885 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d499121d-5de2-4060-b004-7ec50bd5ab59 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:18:34.688063 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:18:34.726660 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d499121d-5de2-4060-b004-7ec50bd5ab59 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:18:34.759468 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d684d88-7d1d-4fbb-bc40-1bb78ddeed1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:18:34.760087 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d684d88-7d1d-4fbb-bc40-1bb78ddeed1b None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:18:34.760364 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d684d88-7d1d-4fbb-bc40-1bb78ddeed1b None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:18:34.760634 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d684d88-7d1d-4fbb-bc40-1bb78ddeed1b None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:18:34.761282 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d684d88-7d1d-4fbb-bc40-1bb78ddeed1b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:18:34.761580 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d684d88-7d1d-4fbb-bc40-1bb78ddeed1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:18:34.762926 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d684d88-7d1d-4fbb-bc40-1bb78ddeed1b None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:18:34.770661 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 585/1181] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 03:18:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:18:34.776579 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e0cba-afca-476f-84ca-551082c6d5b2 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:18:34.874194 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e0cba-afca-476f-84ca-551082c6d5b2 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:18:34.906078 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727021f3-b744-44c6-88ea-258d54811d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:18:34.906680 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727021f3-b744-44c6-88ea-258d54811d6a None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:18:34.906957 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727021f3-b744-44c6-88ea-258d54811d6a None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:18:34.907229 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727021f3-b744-44c6-88ea-258d54811d6a None admin] PATH_INFO: `/v3/users/ba112a59473146b090b58db00da384ca` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:18:34.920176 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727021f3-b744-44c6-88ea-258d54811d6a None admin] RBAC: Authorizing `identity:get_user(user_id=ba112a59473146b090b58db00da384ca)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:18:34.921581 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727021f3-b744-44c6-88ea-258d54811d6a None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:18:34.923119 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 597/1182] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 03:18:34 2022] GET /identity/v3/users/ba112a59473146b090b58db00da384ca => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:18:34.929307 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d684d88-7d1d-4fbb-bc40-1bb78ddeed1b None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:18:35.024648 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d684d88-7d1d-4fbb-bc40-1bb78ddeed1b None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:18:35.048789 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:18:35.058347 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9533b074-2f26-4784-9cc9-d476cdf7d1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:18:35.058943 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9533b074-2f26-4784-9cc9-d476cdf7d1f1 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:18:35.059225 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9533b074-2f26-4784-9cc9-d476cdf7d1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:18:35.059521 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9533b074-2f26-4784-9cc9-d476cdf7d1f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:18:35.124633 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9533b074-2f26-4784-9cc9-d476cdf7d1f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:18:35.126053 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9533b074-2f26-4784-9cc9-d476cdf7d1f1 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:18:35.222710 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 586/1183] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 03:18:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 03:18:35.229235 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727021f3-b744-44c6-88ea-258d54811d6a None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:18:35.244628 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:18:35.326740 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727021f3-b744-44c6-88ea-258d54811d6a None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:18:35.360012 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee8889e-3d23-4650-a290-605241337c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:18:35.360623 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee8889e-3d23-4650-a290-605241337c00 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:18:35.360905 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee8889e-3d23-4650-a290-605241337c00 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:18:35.361178 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee8889e-3d23-4650-a290-605241337c00 None admin] PATH_INFO: `/v3/projects/86cc2f576e7f45b2906ac796f2767ae8` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:18:35.362267 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee8889e-3d23-4650-a290-605241337c00 None admin] RBAC: Authorizing `identity:get_project(project_id=86cc2f576e7f45b2906ac796f2767ae8)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:18:35.363774 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee8889e-3d23-4650-a290-605241337c00 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:18:35.365595 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 598/1184] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 03:18:35 2022] GET /identity/v3/projects/86cc2f576e7f45b2906ac796f2767ae8 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:18:35.371720 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9533b074-2f26-4784-9cc9-d476cdf7d1f1 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:18:35.397960 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:18:35.468694 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9533b074-2f26-4784-9cc9-d476cdf7d1f1 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:18:35.503413 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea413707-b4fa-4024-b6d6-1e8ae4934266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:18:35.504093 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea413707-b4fa-4024-b6d6-1e8ae4934266 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:18:35.504953 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea413707-b4fa-4024-b6d6-1e8ae4934266 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:18:35.505246 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea413707-b4fa-4024-b6d6-1e8ae4934266 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:18:35.505946 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea413707-b4fa-4024-b6d6-1e8ae4934266 None admin] RBAC: Adding query filter params (role.id=fe9379cda35c4ff78576fe48b60bea3c, scope.project.id=86cc2f576e7f45b2906ac796f2767ae8, user.id=ba112a59473146b090b58db00da384ca) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:18:35.506255 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea413707-b4fa-4024-b6d6-1e8ae4934266 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:18:35.507689 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea413707-b4fa-4024-b6d6-1e8ae4934266 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:18:35.512900 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 587/1185] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 03:18:35 2022] GET /identity/v3/role_assignments?user.id=ba112a59473146b090b58db00da384ca&scope.project.id=86cc2f576e7f45b2906ac796f2767ae8&role.id=fe9379cda35c4ff78576fe48b60bea3c => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:18:37.652911 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f01fa-dc4a-4ce5-bb82-593f3545f5bd None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:18:37.653373 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f01fa-dc4a-4ce5-bb82-593f3545f5bd None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:18:37.653463 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f01fa-dc4a-4ce5-bb82-593f3545f5bd None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:18:37.654800 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 599/1186] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:18:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:18:37.659980 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd3d0a1-b131-4414-996e-fe93a0064ef0 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:18:37.660445 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd3d0a1-b131-4414-996e-fe93a0064ef0 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:18:37.661378 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd3d0a1-b131-4414-996e-fe93a0064ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:18:37.678864 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-9cd3d0a1-b131-4414-996e-fe93a0064ef0 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:18:37.680049 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-9cd3d0a1-b131-4414-996e-fe93a0064ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:18:37.744300 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 588/1187] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:18:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 03:18:38.027626 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f01fa-dc4a-4ce5-bb82-593f3545f5bd None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:18:38.109209 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:18:38.128314 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f01fa-dc4a-4ce5-bb82-593f3545f5bd None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:18:38.163225 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c13f0e-031c-4da6-9f4d-efa22d2c027c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:18:38.163862 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c13f0e-031c-4da6-9f4d-efa22d2c027c None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:18:38.164150 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c13f0e-031c-4da6-9f4d-efa22d2c027c None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:18:38.164424 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c13f0e-031c-4da6-9f4d-efa22d2c027c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:18:38.174263 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c13f0e-031c-4da6-9f4d-efa22d2c027c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:18:38.179548 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-56c13f0e-031c-4da6-9f4d-efa22d2c027c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 03:18:38.179548 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:18:38.179548 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:18:38.179548 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:18:38.179548 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:18:38.179548 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:18:38.179548 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:18:38.179548 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:18:38.179548 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:18:38.179548 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:18:38.179548 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:18:38.179548 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:18:38.179548 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:18:38.179548 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:18:38.179548 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:18:38.179548 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:18:38.180635 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:18:38.180635 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:18:38.180635 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:18:38.180635 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:18:38.180635 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:18:38.180635 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:18:38.180635 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:18:38.180635 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:18:38.180635 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:18:38.180635 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:18:38.180635 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:18:38.180635 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:18:38.180635 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:18:38.180635 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:18:38.180635 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:18:38.180635 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:18:38.181471 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:18:38.181471 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:18:38.181471 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:18:38.181471 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:18:38.181471 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:18:38.181471 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:18:38.181471 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:18:38.181471 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:18:38.181471 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:18:38.181471 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:18:38.181471 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 03:18:38.181471 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:18:38.181471 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 600/1188] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 4 03:18:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:18:38.186623 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd3d0a1-b131-4414-996e-fe93a0064ef0 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:18:38.207803 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:18:38.282889 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd3d0a1-b131-4414-996e-fe93a0064ef0 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:18:38.315590 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efd14e0-9e7b-475b-8e80-4bc272a99b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:18:38.316180 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd14e0-9e7b-475b-8e80-4bc272a99b61 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:18:38.316460 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd14e0-9e7b-475b-8e80-4bc272a99b61 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:18:38.317326 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd14e0-9e7b-475b-8e80-4bc272a99b61 None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:18:38.317979 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efd14e0-9e7b-475b-8e80-4bc272a99b61 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:18:38.318279 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efd14e0-9e7b-475b-8e80-4bc272a99b61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:18:38.319657 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efd14e0-9e7b-475b-8e80-4bc272a99b61 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:18:38.327590 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 589/1189] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 03:18:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:18:38.333397 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c13f0e-031c-4da6-9f4d-efa22d2c027c None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:18:38.428096 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c13f0e-031c-4da6-9f4d-efa22d2c027c None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:18:38.460482 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8cbd56-3e9d-4b3a-ab1a-ed6fabfcaa91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:18:38.461079 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8cbd56-3e9d-4b3a-ab1a-ed6fabfcaa91 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:18:38.461357 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8cbd56-3e9d-4b3a-ab1a-ed6fabfcaa91 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:18:38.461628 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8cbd56-3e9d-4b3a-ab1a-ed6fabfcaa91 None admin] PATH_INFO: `/v3/users/ba112a59473146b090b58db00da384ca` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:18:38.462719 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8cbd56-3e9d-4b3a-ab1a-ed6fabfcaa91 None admin] RBAC: Authorizing `identity:get_user(user_id=ba112a59473146b090b58db00da384ca)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:18:38.464143 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8cbd56-3e9d-4b3a-ab1a-ed6fabfcaa91 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:18:38.465665 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 601/1190] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 03:18:38 2022] GET /identity/v3/users/ba112a59473146b090b58db00da384ca => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:18:38.471298 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efd14e0-9e7b-475b-8e80-4bc272a99b61 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:18:38.550191 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:18:38.568626 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efd14e0-9e7b-475b-8e80-4bc272a99b61 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:18:38.601085 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396c11d-ee40-40e6-a0ae-dbee2f11fd00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:18:38.601683 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396c11d-ee40-40e6-a0ae-dbee2f11fd00 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:18:38.601966 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396c11d-ee40-40e6-a0ae-dbee2f11fd00 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:18:38.602241 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396c11d-ee40-40e6-a0ae-dbee2f11fd00 None admin] PATH_INFO: `/v3/projects/86cc2f576e7f45b2906ac796f2767ae8` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:18:38.603338 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f396c11d-ee40-40e6-a0ae-dbee2f11fd00 None admin] RBAC: Authorizing `identity:get_project(project_id=86cc2f576e7f45b2906ac796f2767ae8)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:18:38.604777 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f396c11d-ee40-40e6-a0ae-dbee2f11fd00 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:18:38.606359 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 590/1191] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 03:18:38 2022] GET /identity/v3/projects/86cc2f576e7f45b2906ac796f2767ae8 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:18:38.612254 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8cbd56-3e9d-4b3a-ab1a-ed6fabfcaa91 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:18:38.624724 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:18:38.710313 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8cbd56-3e9d-4b3a-ab1a-ed6fabfcaa91 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:18:38.742311 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3766e8-d334-41d1-b53e-aa9baa0a7fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:18:38.742946 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3766e8-d334-41d1-b53e-aa9baa0a7fde None admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:18:38.743223 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3766e8-d334-41d1-b53e-aa9baa0a7fde None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:18:38.743539 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3766e8-d334-41d1-b53e-aa9baa0a7fde None admin] PATH_INFO: `/v3/projects/86cc2f576e7f45b2906ac796f2767ae8/users/ba112a59473146b090b58db00da384ca/roles/fe9379cda35c4ff78576fe48b60bea3c` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:18:38.745377 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3766e8-d334-41d1-b53e-aa9baa0a7fde None admin] RBAC: Authorizing `identity:create_grant(project_id=86cc2f576e7f45b2906ac796f2767ae8, user_id=ba112a59473146b090b58db00da384ca, role_id=fe9379cda35c4ff78576fe48b60bea3c)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:18:38.746775 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3766e8-d334-41d1-b53e-aa9baa0a7fde None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:18:38.759223 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 602/1192] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Oct 4 03:18:38 2022] PUT /identity/v3/projects/86cc2f576e7f45b2906ac796f2767ae8/users/ba112a59473146b090b58db00da384ca/roles/fe9379cda35c4ff78576fe48b60bea3c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:18:40.877336 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55953917-b672-4b06-9a11-1db78af4c3fa None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:18:40.877884 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55953917-b672-4b06-9a11-1db78af4c3fa None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:18:40.877884 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55953917-b672-4b06-9a11-1db78af4c3fa None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:18:40.879910 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 591/1193] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:18:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:18:40.885238 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb455d-8924-4773-8f12-b82f88ae011c None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:18:40.885637 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb455d-8924-4773-8f12-b82f88ae011c None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:18:40.885758 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb455d-8924-4773-8f12-b82f88ae011c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:18:40.904295 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-d9eb455d-8924-4773-8f12-b82f88ae011c None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:18:40.905471 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-d9eb455d-8924-4773-8f12-b82f88ae011c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:18:40.966539 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:18:40.971914 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 603/1194] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:18:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 03:18:41.239409 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55953917-b672-4b06-9a11-1db78af4c3fa None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:18:41.337460 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55953917-b672-4b06-9a11-1db78af4c3fa None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:18:41.370303 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3d5699-819a-4699-ba68-a87280a43d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:18:41.370913 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d5699-819a-4699-ba68-a87280a43d70 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:18:41.371188 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d5699-819a-4699-ba68-a87280a43d70 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:18:41.371457 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d5699-819a-4699-ba68-a87280a43d70 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:18:41.381145 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3d5699-819a-4699-ba68-a87280a43d70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:18:41.385798 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-ed3d5699-819a-4699-ba68-a87280a43d70 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 03:18:41.385798 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:18:41.385798 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:18:41.385798 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:18:41.385798 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:18:41.385798 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:18:41.385798 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:18:41.385798 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:18:41.385798 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:18:41.385798 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:18:41.385798 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:18:41.385798 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:18:41.385798 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:18:41.385798 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:18:41.385798 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:18:41.385798 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:18:41.386919 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:18:41.386919 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:18:41.386919 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:18:41.386919 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:18:41.386919 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:18:41.386919 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:18:41.386919 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:18:41.386919 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:18:41.386919 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:18:41.386919 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:18:41.386919 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:18:41.386919 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:18:41.386919 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:18:41.386919 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:18:41.386919 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:18:41.386919 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:18:41.388026 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:18:41.388026 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:18:41.388026 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:18:41.388026 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:18:41.388026 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:18:41.388026 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:18:41.388026 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:18:41.388026 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:18:41.388026 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:18:41.388026 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:18:41.388026 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 03:18:41.388026 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:18:41.388026 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 592/1195] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 4 03:18:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:18:41.393000 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eb455d-8924-4773-8f12-b82f88ae011c None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:18:41.488031 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eb455d-8924-4773-8f12-b82f88ae011c None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:18:41.520841 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943cd59e-af80-4e05-aa62-72b994b72743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:18:41.521377 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943cd59e-af80-4e05-aa62-72b994b72743 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:18:41.521655 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943cd59e-af80-4e05-aa62-72b994b72743 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:18:41.521924 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943cd59e-af80-4e05-aa62-72b994b72743 None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:18:41.522577 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943cd59e-af80-4e05-aa62-72b994b72743 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:18:41.522877 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943cd59e-af80-4e05-aa62-72b994b72743 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:18:41.524244 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943cd59e-af80-4e05-aa62-72b994b72743 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:18:41.531941 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 604/1196] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 03:18:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:18:41.538355 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3d5699-819a-4699-ba68-a87280a43d70 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:18:41.551616 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:18:41.640448 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3d5699-819a-4699-ba68-a87280a43d70 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:18:41.673863 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dcf1fd-9443-4589-8ace-1b5b3de98ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:18:41.674478 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dcf1fd-9443-4589-8ace-1b5b3de98ec2 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:18:41.674757 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dcf1fd-9443-4589-8ace-1b5b3de98ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:18:41.675029 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dcf1fd-9443-4589-8ace-1b5b3de98ec2 None admin] PATH_INFO: `/v3/users/ba112a59473146b090b58db00da384ca` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:18:41.676884 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dcf1fd-9443-4589-8ace-1b5b3de98ec2 None admin] RBAC: Authorizing `identity:get_user(user_id=ba112a59473146b090b58db00da384ca)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:18:41.678375 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dcf1fd-9443-4589-8ace-1b5b3de98ec2 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:18:41.679969 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 593/1197] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 03:18:41 2022] GET /identity/v3/users/ba112a59473146b090b58db00da384ca => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:18:41.685759 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943cd59e-af80-4e05-aa62-72b994b72743 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:18:41.744751 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:18:41.781496 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943cd59e-af80-4e05-aa62-72b994b72743 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:18:41.813647 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e219aaf-14fa-4b2a-bb41-dee2bf623245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:18:41.814231 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e219aaf-14fa-4b2a-bb41-dee2bf623245 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:18:41.814511 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e219aaf-14fa-4b2a-bb41-dee2bf623245 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:18:41.814784 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e219aaf-14fa-4b2a-bb41-dee2bf623245 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:18:41.880043 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e219aaf-14fa-4b2a-bb41-dee2bf623245 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:18:41.881472 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e219aaf-14fa-4b2a-bb41-dee2bf623245 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:18:41.939544 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:18:41.979678 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 605/1198] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 03:18:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 03:18:41.985516 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dcf1fd-9443-4589-8ace-1b5b3de98ec2 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:18:42.062232 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:18:42.084319 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dcf1fd-9443-4589-8ace-1b5b3de98ec2 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:18:42.117258 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fb4d40-1ea5-4311-96dd-cc4ed98471aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:18:42.117874 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb4d40-1ea5-4311-96dd-cc4ed98471aa None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:18:42.118157 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb4d40-1ea5-4311-96dd-cc4ed98471aa None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:18:42.118431 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb4d40-1ea5-4311-96dd-cc4ed98471aa None admin] PATH_INFO: `/v3/projects/86cc2f576e7f45b2906ac796f2767ae8` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:18:42.119599 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fb4d40-1ea5-4311-96dd-cc4ed98471aa None admin] RBAC: Authorizing `identity:get_project(project_id=86cc2f576e7f45b2906ac796f2767ae8)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:18:42.121014 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fb4d40-1ea5-4311-96dd-cc4ed98471aa None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:18:42.122626 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 594/1199] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 03:18:41 2022] GET /identity/v3/projects/86cc2f576e7f45b2906ac796f2767ae8 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:18:42.128751 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e219aaf-14fa-4b2a-bb41-dee2bf623245 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:18:42.224208 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e219aaf-14fa-4b2a-bb41-dee2bf623245 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:18:42.256664 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e7a74d-8006-4669-b50e-2e2601678eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:18:42.257253 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e7a74d-8006-4669-b50e-2e2601678eaa None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:18:42.257531 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e7a74d-8006-4669-b50e-2e2601678eaa None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:18:42.257801 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e7a74d-8006-4669-b50e-2e2601678eaa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:18:42.258507 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e7a74d-8006-4669-b50e-2e2601678eaa None admin] RBAC: Adding query filter params (role.id=fe9379cda35c4ff78576fe48b60bea3c, scope.project.id=86cc2f576e7f45b2906ac796f2767ae8, user.id=ba112a59473146b090b58db00da384ca) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:18:42.258810 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e7a74d-8006-4669-b50e-2e2601678eaa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:18:42.260222 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e7a74d-8006-4669-b50e-2e2601678eaa None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:18:42.265770 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 606/1200] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 03:18:42 2022] GET /identity/v3/role_assignments?user.id=ba112a59473146b090b58db00da384ca&scope.project.id=86cc2f576e7f45b2906ac796f2767ae8&role.id=fe9379cda35c4ff78576fe48b60bea3c => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:18:52.112338 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=27 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:18:52.263224 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=87 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:19:37.807537 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f5a26-f487-478d-9038-51d0cd2a522e None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:19:37.807537 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f5a26-f487-478d-9038-51d0cd2a522e None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:19:37.807537 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f5a26-f487-478d-9038-51d0cd2a522e None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:19:37.808595 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 595/1201] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:19:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:19:37.813916 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ca8fe-be1a-4698-97d5-7b5360184b3c None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:19:37.814719 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ca8fe-be1a-4698-97d5-7b5360184b3c None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:19:37.814719 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ca8fe-be1a-4698-97d5-7b5360184b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:19:37.835540 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-de9ca8fe-be1a-4698-97d5-7b5360184b3c None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:19:37.836815 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-de9ca8fe-be1a-4698-97d5-7b5360184b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:19:37.931909 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 607/1202] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:19:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 03:19:38.199338 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4f5a26-f487-478d-9038-51d0cd2a522e None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:19:38.339241 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4f5a26-f487-478d-9038-51d0cd2a522e None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:19:38.383450 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ba49f7-aab2-44de-b58c-0d4140893dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:19:38.384474 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba49f7-aab2-44de-b58c-0d4140893dc2 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:19:38.384926 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba49f7-aab2-44de-b58c-0d4140893dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:19:38.385357 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba49f7-aab2-44de-b58c-0d4140893dc2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:19:38.397689 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ba49f7-aab2-44de-b58c-0d4140893dc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:19:38.399222 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ba49f7-aab2-44de-b58c-0d4140893dc2 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:19:38.417494 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-06ba49f7-aab2-44de-b58c-0d4140893dc2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:19:38.417494 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:19:38.417494 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:19:38.417494 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:19:38.417494 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:19:38.417494 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:19:38.417494 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:19:38.417494 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:19:38.417494 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:19:38.417494 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:19:38.417494 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:19:38.417494 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:19:38.417494 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 03:19:38.417494 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 03:19:38.417494 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 03:19:38.417494 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 03:19:38.418913 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:19:38.418913 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:19:38.418913 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:19:38.418913 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:19:38.418913 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:19:38.418913 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:19:38.418913 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:19:38.418913 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:19:38.418913 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:19:38.418913 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:19:38.418913 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:19:38.418913 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:19:38.418913 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:19:38.418913 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:19:38.418913 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:19:38.418913 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:19:38.418913 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 03:19:38.419984 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 03:19:38.419984 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:19:38.419984 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:19:38.419984 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 596/1203] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:19:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:19:38.427022 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9ca8fe-be1a-4698-97d5-7b5360184b3c None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:19:38.561985 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9ca8fe-be1a-4698-97d5-7b5360184b3c None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:19:38.597686 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:19:38.605459 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd7dc87-ea2f-46a3-b47d-e188632a0b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:19:38.606161 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd7dc87-ea2f-46a3-b47d-e188632a0b4d None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:19:38.606447 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd7dc87-ea2f-46a3-b47d-e188632a0b4d None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:19:38.606755 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd7dc87-ea2f-46a3-b47d-e188632a0b4d None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:19:38.607394 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd7dc87-ea2f-46a3-b47d-e188632a0b4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:19:38.607731 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd7dc87-ea2f-46a3-b47d-e188632a0b4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:19:38.609101 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd7dc87-ea2f-46a3-b47d-e188632a0b4d None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:19:38.626268 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 608/1204] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 03:19:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:19:38.632470 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ba49f7-aab2-44de-b58c-0d4140893dc2 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:19:38.702147 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:19:38.765183 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ba49f7-aab2-44de-b58c-0d4140893dc2 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:19:38.807235 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb939579-1656-499b-bf3e-21bdb7fcf4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:19:38.807871 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb939579-1656-499b-bf3e-21bdb7fcf4d8 None admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:19:38.808520 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb939579-1656-499b-bf3e-21bdb7fcf4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:19:38.808520 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb939579-1656-499b-bf3e-21bdb7fcf4d8 None admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:19:38.809077 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb939579-1656-499b-bf3e-21bdb7fcf4d8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:19:38.810495 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb939579-1656-499b-bf3e-21bdb7fcf4d8 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:19:38.843145 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 597/1205] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Oct 4 03:19:38 2022] POST /identity/v3/users => generated 251 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:19:41.501228 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df694f1-8489-4313-b8f6-95365927fcf6 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:19:41.501784 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df694f1-8489-4313-b8f6-95365927fcf6 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:19:41.501784 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df694f1-8489-4313-b8f6-95365927fcf6 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:19:41.503908 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 609/1206] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:19:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:19:41.509577 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a416a1b-5f8e-4d39-b31e-7f7828625208 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:19:41.511287 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a416a1b-5f8e-4d39-b31e-7f7828625208 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:19:41.511287 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a416a1b-5f8e-4d39-b31e-7f7828625208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:19:41.532613 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-2a416a1b-5f8e-4d39-b31e-7f7828625208 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:19:41.533916 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-2a416a1b-5f8e-4d39-b31e-7f7828625208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:19:41.611215 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 598/1207] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:19:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 03:19:41.884412 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df694f1-8489-4313-b8f6-95365927fcf6 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:19:42.005171 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df694f1-8489-4313-b8f6-95365927fcf6 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:19:42.044421 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ebb02c-8875-4771-9d70-b35243208281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:19:42.045060 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ebb02c-8875-4771-9d70-b35243208281 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:19:42.045344 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ebb02c-8875-4771-9d70-b35243208281 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:19:42.045619 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ebb02c-8875-4771-9d70-b35243208281 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:19:42.057850 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ebb02c-8875-4771-9d70-b35243208281 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:19:42.063062 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-b1ebb02c-8875-4771-9d70-b35243208281 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 03:19:42.063062 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:19:42.063062 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:19:42.063062 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:19:42.063062 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:19:42.063062 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:19:42.063062 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:19:42.063062 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:19:42.063062 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:19:42.063062 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:19:42.063062 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:19:42.063062 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:19:42.063062 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:19:42.063062 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:19:42.063062 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:19:42.063062 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:19:42.064298 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:19:42.064298 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:19:42.064298 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:19:42.064298 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:19:42.064298 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:19:42.064298 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:19:42.064298 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:19:42.064298 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:19:42.064298 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:19:42.064298 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:19:42.064298 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:19:42.064298 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:19:42.064298 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:19:42.064298 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:19:42.064298 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:19:42.064298 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:19:42.065724 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:19:42.065724 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:19:42.065724 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:19:42.065724 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:19:42.065724 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:19:42.065724 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:19:42.065724 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:19:42.065724 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:19:42.065724 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:19:42.065724 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:19:42.065724 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 03:19:42.065724 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:19:42.065724 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 610/1208] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Oct 4 03:19:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:19:42.071726 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a416a1b-5f8e-4d39-b31e-7f7828625208 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:19:42.119115 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:19:42.192321 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a416a1b-5f8e-4d39-b31e-7f7828625208 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:19:42.231658 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e27604-e9c2-4305-9f59-a7e029a6d0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:19:42.232267 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e27604-e9c2-4305-9f59-a7e029a6d0d3 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:19:42.232566 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e27604-e9c2-4305-9f59-a7e029a6d0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:19:42.232841 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e27604-e9c2-4305-9f59-a7e029a6d0d3 None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:19:42.233499 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e27604-e9c2-4305-9f59-a7e029a6d0d3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:19:42.233804 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e27604-e9c2-4305-9f59-a7e029a6d0d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:19:42.235169 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e27604-e9c2-4305-9f59-a7e029a6d0d3 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:19:42.248525 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 599/1209] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Oct 4 03:19:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:19:42.249843 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ebb02c-8875-4771-9d70-b35243208281 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:19:42.310566 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:19:42.365574 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ebb02c-8875-4771-9d70-b35243208281 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:19:42.408188 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437a99c3-f905-409a-8ee8-1216e824d4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:19:42.409359 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a99c3-f905-409a-8ee8-1216e824d4ea None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:19:42.409949 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a99c3-f905-409a-8ee8-1216e824d4ea None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:19:42.410169 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a99c3-f905-409a-8ee8-1216e824d4ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:19:42.421294 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437a99c3-f905-409a-8ee8-1216e824d4ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:19:42.422741 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437a99c3-f905-409a-8ee8-1216e824d4ea None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:19:42.439732 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-437a99c3-f905-409a-8ee8-1216e824d4ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:19:42.439732 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:19:42.439732 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:19:42.439732 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:19:42.439732 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:19:42.439732 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:19:42.439732 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:19:42.439732 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:19:42.439732 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:19:42.439732 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:19:42.439732 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:19:42.439732 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:19:42.439732 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 03:19:42.439732 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 03:19:42.439732 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 03:19:42.439732 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 03:19:42.441591 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:19:42.441591 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:19:42.441591 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:19:42.441591 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:19:42.441591 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:19:42.441591 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:19:42.441591 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:19:42.441591 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:19:42.441591 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:19:42.441591 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:19:42.441591 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:19:42.441591 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:19:42.441591 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:19:42.441591 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:19:42.441591 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:19:42.441591 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:19:42.441591 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 03:19:42.442648 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 03:19:42.442648 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:19:42.442648 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:19:42.442648 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 611/1210] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:19:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:19:42.450285 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e27604-e9c2-4305-9f59-a7e029a6d0d3 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:19:42.554549 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:19:42.557841 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e27604-e9c2-4305-9f59-a7e029a6d0d3 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:19:42.593805 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f27c93-2739-458d-aa3f-d675b46823ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:19:42.594418 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f27c93-2739-458d-aa3f-d675b46823ad None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:19:42.594703 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f27c93-2739-458d-aa3f-d675b46823ad None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:19:42.595038 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f27c93-2739-458d-aa3f-d675b46823ad None admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:19:42.595705 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f27c93-2739-458d-aa3f-d675b46823ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:19:42.596033 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f27c93-2739-458d-aa3f-d675b46823ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:19:42.597586 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f27c93-2739-458d-aa3f-d675b46823ad None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:19:42.609853 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 600/1211] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 03:19:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:19:42.616880 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437a99c3-f905-409a-8ee8-1216e824d4ea None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:19:42.731776 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437a99c3-f905-409a-8ee8-1216e824d4ea None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:19:42.733492 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:19:42.772148 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ea7fc-1537-47c9-a367-8d3c702eb54d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:19:42.772780 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ea7fc-1537-47c9-a367-8d3c702eb54d None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:19:42.773063 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ea7fc-1537-47c9-a367-8d3c702eb54d None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:19:42.773338 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ea7fc-1537-47c9-a367-8d3c702eb54d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:19:42.781132 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5ea7fc-1537-47c9-a367-8d3c702eb54d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:19:42.782558 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5ea7fc-1537-47c9-a367-8d3c702eb54d None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:19:42.794123 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-9f5ea7fc-1537-47c9-a367-8d3c702eb54d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 04 03:19:42.794123 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:19:42.794123 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:19:42.794123 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:19:42.794123 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:19:42.794123 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:19:42.794123 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:19:42.794123 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:19:42.794123 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:19:42.794123 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:19:42.794123 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:19:42.794123 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:19:42.794123 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 03:19:42.794123 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 03:19:42.794123 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 03:19:42.794123 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 03:19:42.795360 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:19:42.795360 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:19:42.795360 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 03:19:42.795360 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 03:19:42.795360 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 03:19:42.795360 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 03:19:42.795360 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:19:42.795360 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:19:42.795360 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:19:42.795360 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:19:42.795360 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:19:42.795360 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:19:42.795360 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:19:42.795360 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:19:42.795360 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:19:42.795360 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:19:42.795360 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:19:42.795360 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:19:42.796725 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:19:42.796725 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:19:42.796725 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 03:19:42.796725 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 03:19:42.796725 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 03:19:42.796725 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 03:19:42.796725 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 03:19:42.796725 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 03:19:42.796725 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 04 03:19:42.796725 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:19:42.800743 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 612/1212] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:19:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 03:19:42.801523 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f27c93-2739-458d-aa3f-d675b46823ad None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:19:42.928450 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f27c93-2739-458d-aa3f-d675b46823ad None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:19:42.966320 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd33af56-15ee-47fd-9afc-566f082e78f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:19:42.967023 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd33af56-15ee-47fd-9afc-566f082e78f3 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:19:42.967316 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd33af56-15ee-47fd-9afc-566f082e78f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:19:42.967623 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd33af56-15ee-47fd-9afc-566f082e78f3 None admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:19:42.968444 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd33af56-15ee-47fd-9afc-566f082e78f3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:19:42.968737 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd33af56-15ee-47fd-9afc-566f082e78f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:19:42.970285 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd33af56-15ee-47fd-9afc-566f082e78f3 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:19:42.995647 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 601/1213] 10.222.0.25 () {56 vars in 1143 bytes} [Tue Oct 4 03:19:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:19:42.996823 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ea7fc-1537-47c9-a367-8d3c702eb54d None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:19:43.113402 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ea7fc-1537-47c9-a367-8d3c702eb54d None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:19:43.152170 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ec0c3-d8ee-4881-b9bc-81194454d84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:19:43.153026 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ec0c3-d8ee-4881-b9bc-81194454d84c None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:19:43.153493 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ec0c3-d8ee-4881-b9bc-81194454d84c None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:19:43.153927 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ec0c3-d8ee-4881-b9bc-81194454d84c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:19:43.191063 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:19:43.233913 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469ec0c3-d8ee-4881-b9bc-81194454d84c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:19:43.235450 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469ec0c3-d8ee-4881-b9bc-81194454d84c None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:19:43.356563 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 613/1214] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 03:19:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 03:19:43.362559 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd33af56-15ee-47fd-9afc-566f082e78f3 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:19:43.385460 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:19:43.492711 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd33af56-15ee-47fd-9afc-566f082e78f3 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:19:43.542505 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b079928-97be-4dd1-a7dd-438987e73d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:19:43.543311 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b079928-97be-4dd1-a7dd-438987e73d0d None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:19:43.543734 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b079928-97be-4dd1-a7dd-438987e73d0d None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:19:43.544164 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b079928-97be-4dd1-a7dd-438987e73d0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:19:43.557191 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b079928-97be-4dd1-a7dd-438987e73d0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:19:43.558797 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b079928-97be-4dd1-a7dd-438987e73d0d None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:19:43.581370 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-7b079928-97be-4dd1-a7dd-438987e73d0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:19:43.581370 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:19:43.581370 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:19:43.581370 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:19:43.581370 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:19:43.581370 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:19:43.581370 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:19:43.581370 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:19:43.581370 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:19:43.581370 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:19:43.581370 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:19:43.581370 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:19:43.581370 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 03:19:43.581370 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 03:19:43.581370 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 03:19:43.581370 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 03:19:43.582497 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:19:43.582497 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:19:43.582497 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:19:43.582497 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:19:43.582497 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:19:43.582497 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:19:43.582497 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:19:43.582497 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:19:43.582497 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:19:43.582497 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:19:43.582497 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:19:43.582497 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:19:43.582497 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:19:43.582497 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:19:43.582497 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:19:43.582497 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:19:43.582497 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 03:19:43.583558 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 03:19:43.583558 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:19:43.583558 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:19:43.583558 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 602/1215] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:19:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:19:43.589655 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ec0c3-d8ee-4881-b9bc-81194454d84c None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:19:43.663385 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:19:43.713715 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ec0c3-d8ee-4881-b9bc-81194454d84c None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:19:43.756390 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f0051-13e0-4e05-8b7b-6fc9f130fe3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:19:43.757003 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f0051-13e0-4e05-8b7b-6fc9f130fe3a None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:19:43.757309 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f0051-13e0-4e05-8b7b-6fc9f130fe3a None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:19:43.757589 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f0051-13e0-4e05-8b7b-6fc9f130fe3a None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:19:43.758448 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71f0051-13e0-4e05-8b7b-6fc9f130fe3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:19:43.758704 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71f0051-13e0-4e05-8b7b-6fc9f130fe3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:19:43.760304 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71f0051-13e0-4e05-8b7b-6fc9f130fe3a None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:19:43.775540 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 614/1216] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 03:19:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:19:43.780727 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b079928-97be-4dd1-a7dd-438987e73d0d None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:19:43.867055 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:19:43.903220 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b079928-97be-4dd1-a7dd-438987e73d0d None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:19:43.947238 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015581c4-3fd3-4c57-8e68-c1ba969358ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:19:43.948199 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015581c4-3fd3-4c57-8e68-c1ba969358ab None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:19:43.948584 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015581c4-3fd3-4c57-8e68-c1ba969358ab None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:19:43.948957 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015581c4-3fd3-4c57-8e68-c1ba969358ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:19:43.960842 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015581c4-3fd3-4c57-8e68-c1ba969358ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:19:43.962461 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015581c4-3fd3-4c57-8e68-c1ba969358ab None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:19:43.977955 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-015581c4-3fd3-4c57-8e68-c1ba969358ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 03:19:43.977955 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:19:43.977955 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:19:43.977955 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:19:43.977955 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:19:43.977955 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:19:43.977955 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:19:43.977955 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:19:43.977955 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:19:43.977955 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:19:43.977955 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:19:43.977955 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:19:43.977955 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 03:19:43.977955 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 03:19:43.977955 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 03:19:43.978975 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 03:19:43.978975 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:19:43.978975 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:19:43.978975 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:19:43.978975 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:19:43.978975 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:19:43.978975 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:19:43.978975 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:19:43.978975 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:19:43.978975 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:19:43.978975 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:19:43.978975 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:19:43.978975 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:19:43.978975 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:19:43.978975 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:19:43.978975 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:19:43.978975 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:19:43.979917 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 03:19:43.979917 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 03:19:43.979917 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 03:19:43.979917 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 03:19:43.979917 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 03:19:43.979917 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 03:19:43.979917 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 03:19:43.979917 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:19:43.979917 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 603/1217] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 03:19:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:19:43.986060 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f0051-13e0-4e05-8b7b-6fc9f130fe3a None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:19:44.114314 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f0051-13e0-4e05-8b7b-6fc9f130fe3a None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:19:44.137391 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:19:44.149814 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da27ab3b-18ea-4278-8bb4-a90ab796a51b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:19:44.150417 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da27ab3b-18ea-4278-8bb4-a90ab796a51b None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:19:44.150701 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da27ab3b-18ea-4278-8bb4-a90ab796a51b None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:19:44.150977 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da27ab3b-18ea-4278-8bb4-a90ab796a51b None admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:19:44.151700 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da27ab3b-18ea-4278-8bb4-a90ab796a51b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:19:44.152009 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da27ab3b-18ea-4278-8bb4-a90ab796a51b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:19:44.153907 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da27ab3b-18ea-4278-8bb4-a90ab796a51b None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:19:44.170960 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 615/1218] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 4 03:19:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:19:44.177768 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015581c4-3fd3-4c57-8e68-c1ba969358ab None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:19:44.294916 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015581c4-3fd3-4c57-8e68-c1ba969358ab None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:19:44.324842 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:19:44.331612 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38171969-bc08-4525-8b54-2268373ada31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:19:44.332223 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38171969-bc08-4525-8b54-2268373ada31 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:19:44.332551 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38171969-bc08-4525-8b54-2268373ada31 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:19:44.332773 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38171969-bc08-4525-8b54-2268373ada31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:19:44.333499 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38171969-bc08-4525-8b54-2268373ada31 None admin] RBAC: Adding query filter params (role.id=1f60934edaf04074936ff079756fc4a6, scope.project.id=80ae15e46620470b9c55fb7fe300fcb6, user.id=94513f6cd19f495e842deb3c13c3e4d7) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:19:44.333805 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38171969-bc08-4525-8b54-2268373ada31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:19:44.335227 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38171969-bc08-4525-8b54-2268373ada31 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:19:44.341235 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 604/1219] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 03:19:44 2022] GET /identity/v3/role_assignments?user.id=94513f6cd19f495e842deb3c13c3e4d7&scope.project.id=80ae15e46620470b9c55fb7fe300fcb6&role.id=1f60934edaf04074936ff079756fc4a6 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:19:46.550100 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb90b80-0594-4cea-abc7-bc13b585d4bd None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:19:46.550727 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb90b80-0594-4cea-abc7-bc13b585d4bd None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:19:46.550830 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb90b80-0594-4cea-abc7-bc13b585d4bd None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:19:46.552143 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 616/1220] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:19:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:19:46.557634 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa2184-f1f0-42da-94da-6fbfd2088926 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:19:46.558055 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa2184-f1f0-42da-94da-6fbfd2088926 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:19:46.558191 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa2184-f1f0-42da-94da-6fbfd2088926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:19:46.578077 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-afaa2184-f1f0-42da-94da-6fbfd2088926 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:19:46.579454 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-afaa2184-f1f0-42da-94da-6fbfd2088926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:19:46.659551 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 605/1221] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:19:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 03:19:46.927691 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb90b80-0594-4cea-abc7-bc13b585d4bd None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:19:47.035709 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb90b80-0594-4cea-abc7-bc13b585d4bd None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:19:47.070741 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc25b369-b736-47fc-9fe9-54bdc6d64c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:19:47.071377 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25b369-b736-47fc-9fe9-54bdc6d64c7d None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:19:47.071685 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25b369-b736-47fc-9fe9-54bdc6d64c7d None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:19:47.071959 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25b369-b736-47fc-9fe9-54bdc6d64c7d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:19:47.083537 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc25b369-b736-47fc-9fe9-54bdc6d64c7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:19:47.088960 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-dc25b369-b736-47fc-9fe9-54bdc6d64c7d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 03:19:47.088960 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:19:47.088960 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:19:47.088960 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:19:47.088960 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:19:47.088960 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:19:47.088960 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:19:47.088960 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:19:47.088960 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:19:47.088960 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:19:47.088960 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:19:47.088960 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:19:47.088960 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:19:47.088960 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:19:47.088960 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:19:47.088960 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:19:47.090096 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:19:47.090096 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:19:47.090096 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:19:47.090096 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:19:47.090096 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:19:47.090096 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:19:47.090096 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:19:47.090096 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:19:47.090096 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:19:47.090096 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:19:47.090096 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:19:47.090096 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:19:47.090096 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:19:47.090096 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:19:47.090096 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:19:47.090096 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:19:47.091050 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:19:47.091050 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:19:47.091050 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:19:47.091050 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:19:47.091050 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:19:47.091050 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:19:47.091050 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:19:47.091050 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:19:47.091050 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:19:47.091050 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:19:47.091050 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 03:19:47.091050 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:19:47.091050 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 617/1222] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Oct 4 03:19:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:19:47.097007 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaa2184-f1f0-42da-94da-6fbfd2088926 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:19:47.210663 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaa2184-f1f0-42da-94da-6fbfd2088926 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:19:47.234176 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:19:47.245471 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e3f276-3970-47cf-92da-308144f21ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:19:47.246073 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e3f276-3970-47cf-92da-308144f21ed6 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:19:47.246353 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e3f276-3970-47cf-92da-308144f21ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:19:47.246628 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e3f276-3970-47cf-92da-308144f21ed6 None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:19:47.247290 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e3f276-3970-47cf-92da-308144f21ed6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:19:47.247617 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e3f276-3970-47cf-92da-308144f21ed6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:19:47.248989 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e3f276-3970-47cf-92da-308144f21ed6 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:19:47.257933 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 606/1223] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Oct 4 03:19:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:19:47.263955 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc25b369-b736-47fc-9fe9-54bdc6d64c7d None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:19:47.312883 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:19:47.369305 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc25b369-b736-47fc-9fe9-54bdc6d64c7d None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:19:47.405596 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab9843a-306a-4d70-9551-88496f0ce3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:19:47.406259 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab9843a-306a-4d70-9551-88496f0ce3d1 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:19:47.406588 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab9843a-306a-4d70-9551-88496f0ce3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:19:47.406864 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab9843a-306a-4d70-9551-88496f0ce3d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:19:47.418076 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab9843a-306a-4d70-9551-88496f0ce3d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:19:47.419544 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab9843a-306a-4d70-9551-88496f0ce3d1 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:19:47.434530 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-8ab9843a-306a-4d70-9551-88496f0ce3d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:19:47.434530 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:19:47.434530 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:19:47.434530 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:19:47.434530 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:19:47.434530 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:19:47.434530 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:19:47.434530 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:19:47.434530 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:19:47.434530 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:19:47.434530 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:19:47.434530 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:19:47.434530 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 03:19:47.434530 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 03:19:47.434530 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 03:19:47.434530 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 03:19:47.441109 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:19:47.441109 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:19:47.441109 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:19:47.441109 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:19:47.441109 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:19:47.441109 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:19:47.441109 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:19:47.441109 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:19:47.441109 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:19:47.441109 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:19:47.441109 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:19:47.441109 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:19:47.441109 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:19:47.441109 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:19:47.441109 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:19:47.441109 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:19:47.441109 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 03:19:47.442260 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 03:19:47.442260 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:19:47.442260 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:19:47.442260 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 618/1224] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:19:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:19:47.442556 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e3f276-3970-47cf-92da-308144f21ed6 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:19:47.551630 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e3f276-3970-47cf-92da-308144f21ed6 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:19:47.587431 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae6ba91-d6b4-4323-9be2-20a1bff735b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:19:47.588130 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6ba91-d6b4-4323-9be2-20a1bff735b1 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:19:47.588397 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6ba91-d6b4-4323-9be2-20a1bff735b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:19:47.588677 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6ba91-d6b4-4323-9be2-20a1bff735b1 None admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:19:47.589397 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae6ba91-d6b4-4323-9be2-20a1bff735b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:19:47.589706 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae6ba91-d6b4-4323-9be2-20a1bff735b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:19:47.591197 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae6ba91-d6b4-4323-9be2-20a1bff735b1 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:19:47.604850 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 607/1225] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 03:19:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:19:47.611028 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab9843a-306a-4d70-9551-88496f0ce3d1 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:19:47.715183 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:19:47.723295 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab9843a-306a-4d70-9551-88496f0ce3d1 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:19:47.760710 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a53c073-a460-4cb0-b07c-6073a7487142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:19:47.761725 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a53c073-a460-4cb0-b07c-6073a7487142 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:19:47.762034 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a53c073-a460-4cb0-b07c-6073a7487142 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:19:47.762295 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a53c073-a460-4cb0-b07c-6073a7487142 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:19:47.771208 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a53c073-a460-4cb0-b07c-6073a7487142 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:19:47.772879 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a53c073-a460-4cb0-b07c-6073a7487142 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:19:47.784948 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-1a53c073-a460-4cb0-b07c-6073a7487142 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 04 03:19:47.784948 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:19:47.784948 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:19:47.784948 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:19:47.784948 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:19:47.784948 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:19:47.784948 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:19:47.784948 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:19:47.784948 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:19:47.784948 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:19:47.784948 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:19:47.784948 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:19:47.784948 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 03:19:47.784948 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 03:19:47.784948 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 03:19:47.784948 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 03:19:47.786067 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:19:47.786067 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:19:47.786067 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 03:19:47.786067 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 03:19:47.786067 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 03:19:47.786067 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 03:19:47.786067 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:19:47.786067 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:19:47.786067 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:19:47.786067 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:19:47.786067 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:19:47.786067 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:19:47.786067 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:19:47.786067 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:19:47.786067 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:19:47.786067 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:19:47.786067 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:19:47.786067 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:19:47.787247 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:19:47.787247 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:19:47.787247 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 03:19:47.787247 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 03:19:47.787247 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 03:19:47.787247 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 03:19:47.787247 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 03:19:47.787247 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 03:19:47.787247 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 04 03:19:47.787247 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:19:47.789109 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 619/1226] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:19:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:19:47.795217 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae6ba91-d6b4-4323-9be2-20a1bff735b1 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:19:47.844223 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:19:47.898247 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae6ba91-d6b4-4323-9be2-20a1bff735b1 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:19:47.936843 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7b3863-1d34-4d24-9cad-1e5c9f91e00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:19:47.937510 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b3863-1d34-4d24-9cad-1e5c9f91e00f None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:19:47.937832 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b3863-1d34-4d24-9cad-1e5c9f91e00f None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:19:47.938137 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b3863-1d34-4d24-9cad-1e5c9f91e00f None admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:19:47.938976 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7b3863-1d34-4d24-9cad-1e5c9f91e00f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:19:47.939369 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7b3863-1d34-4d24-9cad-1e5c9f91e00f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:19:47.941824 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7b3863-1d34-4d24-9cad-1e5c9f91e00f None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:19:47.961192 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 608/1227] 10.222.0.25 () {56 vars in 1143 bytes} [Tue Oct 4 03:19:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:19:47.967216 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a53c073-a460-4cb0-b07c-6073a7487142 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:19:48.079929 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a53c073-a460-4cb0-b07c-6073a7487142 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:19:48.115974 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8593b87d-e4b0-487f-8cb5-e2d0dc22f526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:19:48.116528 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8593b87d-e4b0-487f-8cb5-e2d0dc22f526 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:19:48.116807 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8593b87d-e4b0-487f-8cb5-e2d0dc22f526 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:19:48.117081 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8593b87d-e4b0-487f-8cb5-e2d0dc22f526 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:19:48.127632 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8593b87d-e4b0-487f-8cb5-e2d0dc22f526 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:19:48.129060 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8593b87d-e4b0-487f-8cb5-e2d0dc22f526 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:19:48.143822 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-8593b87d-e4b0-487f-8cb5-e2d0dc22f526 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:19:48.143822 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:19:48.143822 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:19:48.143822 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:19:48.143822 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:19:48.143822 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:19:48.143822 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:19:48.143822 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:19:48.143822 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:19:48.143822 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:19:48.143822 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:19:48.143822 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:19:48.143822 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 03:19:48.143822 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 03:19:48.143822 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 03:19:48.143822 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 03:19:48.144855 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:19:48.144855 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:19:48.144855 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:19:48.144855 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:19:48.144855 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:19:48.144855 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:19:48.144855 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:19:48.144855 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:19:48.144855 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:19:48.144855 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:19:48.144855 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:19:48.144855 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:19:48.144855 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:19:48.144855 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:19:48.144855 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:19:48.144855 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:19:48.144855 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 03:19:48.145749 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 03:19:48.145749 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:19:48.145749 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:19:48.145749 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 620/1228] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:19:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:19:48.150847 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7b3863-1d34-4d24-9cad-1e5c9f91e00f None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:19:48.265577 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7b3863-1d34-4d24-9cad-1e5c9f91e00f None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:19:48.267978 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:19:48.303447 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ef135b-9692-4cc9-b79d-a0f051e7ecc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:19:48.304078 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef135b-9692-4cc9-b79d-a0f051e7ecc3 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:19:48.304356 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef135b-9692-4cc9-b79d-a0f051e7ecc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:19:48.304626 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef135b-9692-4cc9-b79d-a0f051e7ecc3 None admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:19:48.305287 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ef135b-9692-4cc9-b79d-a0f051e7ecc3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:19:48.305589 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ef135b-9692-4cc9-b79d-a0f051e7ecc3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:19:48.306934 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ef135b-9692-4cc9-b79d-a0f051e7ecc3 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:19:48.318490 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 609/1229] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 03:19:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:19:48.324481 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8593b87d-e4b0-487f-8cb5-e2d0dc22f526 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:19:48.334551 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:19:48.428353 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8593b87d-e4b0-487f-8cb5-e2d0dc22f526 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:19:48.464359 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bd5bb9-e022-4319-abf4-0b501125d186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:19:48.464988 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd5bb9-e022-4319-abf4-0b501125d186 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:19:48.465269 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd5bb9-e022-4319-abf4-0b501125d186 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:19:48.465543 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd5bb9-e022-4319-abf4-0b501125d186 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:19:48.472964 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bd5bb9-e022-4319-abf4-0b501125d186 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:19:48.474583 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bd5bb9-e022-4319-abf4-0b501125d186 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:19:48.485751 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-28bd5bb9-e022-4319-abf4-0b501125d186 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 03:19:48.485751 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:19:48.485751 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:19:48.485751 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:19:48.485751 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:19:48.485751 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:19:48.485751 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:19:48.485751 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:19:48.485751 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:19:48.485751 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:19:48.485751 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:19:48.485751 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:19:48.485751 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 03:19:48.485751 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 03:19:48.485751 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 03:19:48.486885 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 03:19:48.486885 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:19:48.486885 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:19:48.486885 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:19:48.486885 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:19:48.486885 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:19:48.486885 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:19:48.486885 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:19:48.486885 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:19:48.486885 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:19:48.486885 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:19:48.486885 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:19:48.486885 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:19:48.486885 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:19:48.486885 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:19:48.486885 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:19:48.486885 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:19:48.488047 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 03:19:48.488047 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 03:19:48.488047 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 03:19:48.488047 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 03:19:48.488047 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 03:19:48.488047 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 03:19:48.488047 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 03:19:48.488047 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:19:48.488047 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 621/1230] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 03:19:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:19:48.492888 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ef135b-9692-4cc9-b79d-a0f051e7ecc3 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:19:48.606650 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ef135b-9692-4cc9-b79d-a0f051e7ecc3 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:19:48.647221 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c02ae-a28b-442d-8caf-d39153b83f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:19:48.647934 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c02ae-a28b-442d-8caf-d39153b83f02 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:19:48.648294 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c02ae-a28b-442d-8caf-d39153b83f02 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:19:48.648629 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c02ae-a28b-442d-8caf-d39153b83f02 None admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:19:48.649385 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305c02ae-a28b-442d-8caf-d39153b83f02 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:19:48.649692 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305c02ae-a28b-442d-8caf-d39153b83f02 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:19:48.651109 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305c02ae-a28b-442d-8caf-d39153b83f02 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:19:48.663820 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 610/1231] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 4 03:19:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:19:48.670206 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bd5bb9-e022-4319-abf4-0b501125d186 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:19:48.748514 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:19:48.786520 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bd5bb9-e022-4319-abf4-0b501125d186 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:19:48.825078 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d2d6e-5fb6-4c33-970c-05ae019ff702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:19:48.826103 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d2d6e-5fb6-4c33-970c-05ae019ff702 None admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:19:48.826473 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d2d6e-5fb6-4c33-970c-05ae019ff702 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:19:48.826800 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d2d6e-5fb6-4c33-970c-05ae019ff702 None admin] PATH_INFO: `/v3/projects/80ae15e46620470b9c55fb7fe300fcb6/users/94513f6cd19f495e842deb3c13c3e4d7/roles/1f60934edaf04074936ff079756fc4a6` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:19:48.848321 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8d2d6e-5fb6-4c33-970c-05ae019ff702 None admin] RBAC: Authorizing `identity:create_grant(project_id=80ae15e46620470b9c55fb7fe300fcb6, user_id=94513f6cd19f495e842deb3c13c3e4d7, role_id=1f60934edaf04074936ff079756fc4a6)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:19:48.851030 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8d2d6e-5fb6-4c33-970c-05ae019ff702 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:19:48.863614 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 622/1232] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Oct 4 03:19:48 2022] PUT /identity/v3/projects/80ae15e46620470b9c55fb7fe300fcb6/users/94513f6cd19f495e842deb3c13c3e4d7/roles/1f60934edaf04074936ff079756fc4a6 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:19:51.126039 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d5081-fd3a-4341-aab1-6b42abf709ed None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:19:51.126756 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d5081-fd3a-4341-aab1-6b42abf709ed None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:19:51.126756 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d5081-fd3a-4341-aab1-6b42abf709ed None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:19:51.128517 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 611/1233] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:19:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 03:19:51.134655 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28248dfe-5a01-4019-b265-b6ee83d6e956 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:19:51.135132 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28248dfe-5a01-4019-b265-b6ee83d6e956 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:19:51.135240 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28248dfe-5a01-4019-b265-b6ee83d6e956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:19:51.152698 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-28248dfe-5a01-4019-b265-b6ee83d6e956 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:19:51.153880 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-28248dfe-5a01-4019-b265-b6ee83d6e956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:19:51.227582 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 623/1234] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:19:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 03:19:51.504501 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7d5081-fd3a-4341-aab1-6b42abf709ed None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:19:51.531836 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:19:51.614942 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7d5081-fd3a-4341-aab1-6b42abf709ed None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:19:51.654662 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca1f8d8-fdd0-4027-87e3-3f33b931afb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:19:51.655286 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca1f8d8-fdd0-4027-87e3-3f33b931afb9 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:19:51.655614 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca1f8d8-fdd0-4027-87e3-3f33b931afb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:19:51.655887 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca1f8d8-fdd0-4027-87e3-3f33b931afb9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:19:51.666658 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca1f8d8-fdd0-4027-87e3-3f33b931afb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:19:51.671479 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-cca1f8d8-fdd0-4027-87e3-3f33b931afb9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 03:19:51.671479 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:19:51.671479 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:19:51.671479 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:19:51.671479 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:19:51.671479 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:19:51.671479 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:19:51.671479 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:19:51.671479 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:19:51.671479 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:19:51.671479 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:19:51.671479 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:19:51.671479 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:19:51.671479 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:19:51.671479 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:19:51.671479 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:19:51.672742 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:19:51.672742 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:19:51.672742 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:19:51.672742 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:19:51.672742 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:19:51.672742 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:19:51.672742 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:19:51.672742 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:19:51.672742 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:19:51.672742 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:19:51.672742 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:19:51.672742 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:19:51.672742 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:19:51.672742 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:19:51.672742 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:19:51.672742 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:19:51.673688 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:19:51.673688 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:19:51.673688 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:19:51.673688 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:19:51.673688 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:19:51.673688 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:19:51.673688 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:19:51.673688 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:19:51.673688 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:19:51.673688 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:19:51.673688 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 03:19:51.673688 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:19:51.673688 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 612/1235] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Oct 4 03:19:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:19:51.679479 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28248dfe-5a01-4019-b265-b6ee83d6e956 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:19:51.728982 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:19:51.785119 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28248dfe-5a01-4019-b265-b6ee83d6e956 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:19:51.820947 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab2bf2a-44b7-4b4f-93a5-8c609202e2c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:19:51.821581 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab2bf2a-44b7-4b4f-93a5-8c609202e2c3 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:19:51.821921 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab2bf2a-44b7-4b4f-93a5-8c609202e2c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:19:51.822172 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab2bf2a-44b7-4b4f-93a5-8c609202e2c3 None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:19:51.822824 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab2bf2a-44b7-4b4f-93a5-8c609202e2c3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:19:51.823125 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab2bf2a-44b7-4b4f-93a5-8c609202e2c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:19:51.824550 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab2bf2a-44b7-4b4f-93a5-8c609202e2c3 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:19:51.833359 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 624/1236] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Oct 4 03:19:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:19:51.839377 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca1f8d8-fdd0-4027-87e3-3f33b931afb9 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:19:51.931878 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:19:51.950418 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca1f8d8-fdd0-4027-87e3-3f33b931afb9 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:19:51.986693 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf6466-7238-4e44-9cee-ee1227d44759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:19:51.987646 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf6466-7238-4e44-9cee-ee1227d44759 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:19:51.987932 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf6466-7238-4e44-9cee-ee1227d44759 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:19:51.988202 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf6466-7238-4e44-9cee-ee1227d44759 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:19:52.001949 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdf6466-7238-4e44-9cee-ee1227d44759 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:19:52.004251 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdf6466-7238-4e44-9cee-ee1227d44759 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:19:52.019803 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-9bdf6466-7238-4e44-9cee-ee1227d44759 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:19:52.019803 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:19:52.019803 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:19:52.019803 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:19:52.019803 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:19:52.019803 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:19:52.019803 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:19:52.019803 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:19:52.019803 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:19:52.019803 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:19:52.019803 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:19:52.019803 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:19:52.019803 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 03:19:52.019803 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 03:19:52.019803 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 03:19:52.019803 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 03:19:52.021403 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:19:52.021403 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:19:52.021403 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:19:52.021403 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:19:52.021403 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:19:52.021403 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:19:52.021403 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:19:52.021403 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:19:52.021403 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:19:52.021403 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:19:52.021403 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:19:52.021403 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:19:52.021403 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:19:52.021403 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:19:52.021403 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:19:52.021403 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:19:52.021403 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 03:19:52.023224 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 03:19:52.023224 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:19:52.023224 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:19:52.023224 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 613/1237] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:19:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:19:52.027721 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab2bf2a-44b7-4b4f-93a5-8c609202e2c3 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:19:52.137909 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab2bf2a-44b7-4b4f-93a5-8c609202e2c3 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:19:52.148645 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:19:52.175541 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e3bf71-f09a-45c7-9e26-2aaa72b9d8b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:19:52.176150 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e3bf71-f09a-45c7-9e26-2aaa72b9d8b2 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:19:52.176488 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e3bf71-f09a-45c7-9e26-2aaa72b9d8b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:19:52.176719 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e3bf71-f09a-45c7-9e26-2aaa72b9d8b2 None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:19:52.177326 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e3bf71-f09a-45c7-9e26-2aaa72b9d8b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:19:52.177626 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e3bf71-f09a-45c7-9e26-2aaa72b9d8b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:19:52.178978 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e3bf71-f09a-45c7-9e26-2aaa72b9d8b2 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:19:52.191194 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 625/1238] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 03:19:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:19:52.197318 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf6466-7238-4e44-9cee-ee1227d44759 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:19:52.310340 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf6466-7238-4e44-9cee-ee1227d44759 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:19:52.348229 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bef109-d8e2-405f-914c-0e4c30875bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:19:52.348854 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bef109-d8e2-405f-914c-0e4c30875bfe None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:19:52.349135 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bef109-d8e2-405f-914c-0e4c30875bfe None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:19:52.349409 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bef109-d8e2-405f-914c-0e4c30875bfe None admin] PATH_INFO: `/v3/users/placement` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:19:52.352445 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:19:52.359163 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bef109-d8e2-405f-914c-0e4c30875bfe None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:19:52.360800 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bef109-d8e2-405f-914c-0e4c30875bfe None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:19:52.373188 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-e0bef109-d8e2-405f-914c-0e4c30875bfe None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 04 03:19:52.373188 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:19:52.373188 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:19:52.373188 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:19:52.373188 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:19:52.373188 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:19:52.373188 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:19:52.373188 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:19:52.373188 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:19:52.373188 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:19:52.373188 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:19:52.373188 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:19:52.373188 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 03:19:52.373188 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 03:19:52.373188 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 03:19:52.373188 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 03:19:52.374520 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:19:52.374520 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:19:52.374520 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 03:19:52.374520 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 03:19:52.374520 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 03:19:52.374520 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 03:19:52.374520 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:19:52.374520 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:19:52.374520 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:19:52.374520 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:19:52.374520 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:19:52.374520 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:19:52.374520 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:19:52.374520 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:19:52.374520 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:19:52.374520 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:19:52.374520 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:19:52.374520 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:19:52.375702 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:19:52.375702 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:19:52.375702 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 03:19:52.375702 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 03:19:52.375702 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 03:19:52.375702 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 03:19:52.375702 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 03:19:52.375702 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 03:19:52.375702 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 04 03:19:52.375702 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:19:52.375702 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 614/1239] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:19:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:19:52.380623 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e3bf71-f09a-45c7-9e26-2aaa72b9d8b2 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:19:52.490408 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e3bf71-f09a-45c7-9e26-2aaa72b9d8b2 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:19:52.526832 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc33f52-88e7-47b5-8c36-586226a44141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:19:52.527458 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc33f52-88e7-47b5-8c36-586226a44141 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:19:52.527769 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc33f52-88e7-47b5-8c36-586226a44141 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:19:52.528052 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc33f52-88e7-47b5-8c36-586226a44141 None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:19:52.528809 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc33f52-88e7-47b5-8c36-586226a44141 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:19:52.529155 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc33f52-88e7-47b5-8c36-586226a44141 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:19:52.530534 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc33f52-88e7-47b5-8c36-586226a44141 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:19:52.548808 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 626/1240] 10.222.0.25 () {56 vars in 1143 bytes} [Tue Oct 4 03:19:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:19:52.554624 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bef109-d8e2-405f-914c-0e4c30875bfe None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:19:52.670774 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bef109-d8e2-405f-914c-0e4c30875bfe None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:19:52.709706 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b222fc-a5bb-4752-b930-b166f22cc15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:19:52.710368 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b222fc-a5bb-4752-b930-b166f22cc15f None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:19:52.710656 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b222fc-a5bb-4752-b930-b166f22cc15f None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:19:52.710978 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b222fc-a5bb-4752-b930-b166f22cc15f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:19:52.779107 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:19:52.787051 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b222fc-a5bb-4752-b930-b166f22cc15f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:19:52.788875 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b222fc-a5bb-4752-b930-b166f22cc15f None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:19:52.918179 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 615/1241] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 03:19:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 03:19:52.923967 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc33f52-88e7-47b5-8c36-586226a44141 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:19:52.958309 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:19:53.041400 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc33f52-88e7-47b5-8c36-586226a44141 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:19:53.081198 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19feb4e6-3334-4ed5-ab8c-5c7bc54a9d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:19:53.081825 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19feb4e6-3334-4ed5-ab8c-5c7bc54a9d01 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:19:53.082096 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19feb4e6-3334-4ed5-ab8c-5c7bc54a9d01 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:19:53.082362 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19feb4e6-3334-4ed5-ab8c-5c7bc54a9d01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:19:53.093860 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19feb4e6-3334-4ed5-ab8c-5c7bc54a9d01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:19:53.095454 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19feb4e6-3334-4ed5-ab8c-5c7bc54a9d01 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:19:53.112277 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-19feb4e6-3334-4ed5-ab8c-5c7bc54a9d01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:19:53.112277 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:19:53.112277 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:19:53.112277 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:19:53.112277 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:19:53.112277 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:19:53.112277 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:19:53.112277 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:19:53.112277 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:19:53.112277 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:19:53.112277 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:19:53.112277 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:19:53.112277 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 03:19:53.112277 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 03:19:53.112277 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 03:19:53.112277 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 03:19:53.113379 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:19:53.113379 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:19:53.113379 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:19:53.113379 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:19:53.113379 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:19:53.113379 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:19:53.113379 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:19:53.113379 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:19:53.113379 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:19:53.113379 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:19:53.113379 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:19:53.113379 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:19:53.113379 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:19:53.113379 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:19:53.113379 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:19:53.113379 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:19:53.113379 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 03:19:53.114477 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 03:19:53.114477 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:19:53.114477 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:19:53.114477 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 627/1242] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:19:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:19:53.119223 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b222fc-a5bb-4752-b930-b166f22cc15f None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:19:53.230728 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:19:53.238411 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b222fc-a5bb-4752-b930-b166f22cc15f None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:19:53.285875 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a043764-bbac-4254-b9ed-703995e034a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:19:53.286831 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a043764-bbac-4254-b9ed-703995e034a0 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:19:53.287310 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a043764-bbac-4254-b9ed-703995e034a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:19:53.287815 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a043764-bbac-4254-b9ed-703995e034a0 None admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:19:53.288749 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a043764-bbac-4254-b9ed-703995e034a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:19:53.289183 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a043764-bbac-4254-b9ed-703995e034a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:19:53.291242 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a043764-bbac-4254-b9ed-703995e034a0 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:19:53.307057 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 616/1243] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 03:19:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:19:53.313251 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19feb4e6-3334-4ed5-ab8c-5c7bc54a9d01 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:19:53.398445 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:19:53.422879 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19feb4e6-3334-4ed5-ab8c-5c7bc54a9d01 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:19:53.461197 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da0f5e-9742-4969-a3fe-bdde6c94d0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:19:53.461831 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da0f5e-9742-4969-a3fe-bdde6c94d0f3 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:19:53.462114 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da0f5e-9742-4969-a3fe-bdde6c94d0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:19:53.462386 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da0f5e-9742-4969-a3fe-bdde6c94d0f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:19:53.469556 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3da0f5e-9742-4969-a3fe-bdde6c94d0f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:19:53.471791 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3da0f5e-9742-4969-a3fe-bdde6c94d0f3 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:19:53.484680 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-a3da0f5e-9742-4969-a3fe-bdde6c94d0f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 03:19:53.484680 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:19:53.484680 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:19:53.484680 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:19:53.484680 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:19:53.484680 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:19:53.484680 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:19:53.484680 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:19:53.484680 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:19:53.484680 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:19:53.484680 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:19:53.484680 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:19:53.484680 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 03:19:53.484680 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 03:19:53.484680 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 03:19:53.485830 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 03:19:53.485830 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:19:53.485830 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:19:53.485830 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:19:53.485830 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:19:53.485830 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:19:53.485830 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:19:53.485830 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:19:53.485830 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:19:53.485830 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:19:53.485830 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:19:53.485830 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:19:53.485830 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:19:53.485830 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:19:53.485830 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:19:53.485830 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:19:53.485830 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:19:53.486960 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 03:19:53.486960 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 03:19:53.486960 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 03:19:53.486960 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 03:19:53.486960 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 03:19:53.486960 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 03:19:53.486960 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 03:19:53.486960 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:19:53.486960 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 628/1244] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 03:19:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:19:53.492101 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a043764-bbac-4254-b9ed-703995e034a0 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:19:53.621248 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a043764-bbac-4254-b9ed-703995e034a0 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:19:53.665670 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ef255b-86b4-4fff-97d0-95f69b74d9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:19:53.666383 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ef255b-86b4-4fff-97d0-95f69b74d9bc None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:19:53.666737 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ef255b-86b4-4fff-97d0-95f69b74d9bc None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:19:53.667012 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ef255b-86b4-4fff-97d0-95f69b74d9bc None admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:19:53.667730 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ef255b-86b4-4fff-97d0-95f69b74d9bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:19:53.668039 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ef255b-86b4-4fff-97d0-95f69b74d9bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:19:53.669474 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ef255b-86b4-4fff-97d0-95f69b74d9bc None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:19:53.682375 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 617/1245] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 4 03:19:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:19:53.688979 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da0f5e-9742-4969-a3fe-bdde6c94d0f3 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:19:53.805075 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da0f5e-9742-4969-a3fe-bdde6c94d0f3 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:19:53.845307 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686bbe47-e273-4c06-8406-27cb505eb8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:19:53.845942 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686bbe47-e273-4c06-8406-27cb505eb8c7 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:19:53.846249 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686bbe47-e273-4c06-8406-27cb505eb8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:19:53.846518 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686bbe47-e273-4c06-8406-27cb505eb8c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:19:53.847346 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686bbe47-e273-4c06-8406-27cb505eb8c7 None admin] RBAC: Adding query filter params (role.id=1f60934edaf04074936ff079756fc4a6, scope.project.id=80ae15e46620470b9c55fb7fe300fcb6, user.id=94513f6cd19f495e842deb3c13c3e4d7) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:19:53.847902 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686bbe47-e273-4c06-8406-27cb505eb8c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:19:53.849399 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686bbe47-e273-4c06-8406-27cb505eb8c7 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:19:53.856108 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 629/1246] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 03:19:53 2022] GET /identity/v3/role_assignments?user.id=94513f6cd19f495e842deb3c13c3e4d7&scope.project.id=80ae15e46620470b9c55fb7fe300fcb6&role.id=1f60934edaf04074936ff079756fc4a6 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:19:56.228585 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb8e4d-fa9a-469a-86fb-6d4f9d5f1df0 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:19:56.229114 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb8e4d-fa9a-469a-86fb-6d4f9d5f1df0 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:19:56.229114 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb8e4d-fa9a-469a-86fb-6d4f9d5f1df0 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:19:56.230455 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 618/1247] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:19:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:19:56.236046 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e60849-becc-4874-9b83-0e8c87bf8244 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:19:56.236517 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e60849-becc-4874-9b83-0e8c87bf8244 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:19:56.236885 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e60849-becc-4874-9b83-0e8c87bf8244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:19:56.243981 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:19:56.259040 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-20e60849-becc-4874-9b83-0e8c87bf8244 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:19:56.260358 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-20e60849-becc-4874-9b83-0e8c87bf8244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:19:56.335691 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 630/1248] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:19:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 03:19:56.600660 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cb8e4d-fa9a-469a-86fb-6d4f9d5f1df0 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:19:56.620189 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:19:56.714216 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cb8e4d-fa9a-469a-86fb-6d4f9d5f1df0 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:19:56.751271 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc9539-e17f-41d8-9797-325d9ddbcb4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:19:56.751918 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc9539-e17f-41d8-9797-325d9ddbcb4b None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:19:56.752236 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc9539-e17f-41d8-9797-325d9ddbcb4b None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:19:56.752510 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc9539-e17f-41d8-9797-325d9ddbcb4b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:19:56.762861 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc9539-e17f-41d8-9797-325d9ddbcb4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:19:56.767546 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-cedc9539-e17f-41d8-9797-325d9ddbcb4b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 03:19:56.767546 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:19:56.767546 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:19:56.767546 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:19:56.767546 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:19:56.767546 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:19:56.767546 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:19:56.767546 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:19:56.767546 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:19:56.767546 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:19:56.767546 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:19:56.767546 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:19:56.767546 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:19:56.767546 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:19:56.767546 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:19:56.767546 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:19:56.768903 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:19:56.768903 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:19:56.768903 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:19:56.768903 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:19:56.768903 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:19:56.768903 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:19:56.768903 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:19:56.768903 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:19:56.768903 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:19:56.768903 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:19:56.768903 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:19:56.768903 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:19:56.768903 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:19:56.768903 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:19:56.768903 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:19:56.768903 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:19:56.769887 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:19:56.769887 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:19:56.769887 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:19:56.769887 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:19:56.769887 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:19:56.769887 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:19:56.769887 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:19:56.769887 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:19:56.769887 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:19:56.769887 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:19:56.769887 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 03:19:56.769887 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:19:56.769887 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 619/1249] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 4 03:19:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:19:56.774655 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e60849-becc-4874-9b83-0e8c87bf8244 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:19:56.882001 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e60849-becc-4874-9b83-0e8c87bf8244 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:19:56.911996 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:19:56.917810 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95235d36-61e3-45d0-9ac7-590063965bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:19:56.918615 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95235d36-61e3-45d0-9ac7-590063965bc7 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:19:56.918911 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95235d36-61e3-45d0-9ac7-590063965bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:19:56.919181 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95235d36-61e3-45d0-9ac7-590063965bc7 None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:19:56.919942 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95235d36-61e3-45d0-9ac7-590063965bc7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:19:56.920249 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95235d36-61e3-45d0-9ac7-590063965bc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:19:56.921580 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95235d36-61e3-45d0-9ac7-590063965bc7 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:19:56.930547 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 631/1250] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 03:19:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:19:56.936409 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc9539-e17f-41d8-9797-325d9ddbcb4b None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:19:57.019667 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:19:57.046223 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc9539-e17f-41d8-9797-325d9ddbcb4b None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:19:57.084740 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c64880c-6ea9-4a3c-90fa-1b527a30c9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:19:57.085363 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64880c-6ea9-4a3c-90fa-1b527a30c9ad None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:19:57.085645 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64880c-6ea9-4a3c-90fa-1b527a30c9ad None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:19:57.085917 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64880c-6ea9-4a3c-90fa-1b527a30c9ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:19:57.098163 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c64880c-6ea9-4a3c-90fa-1b527a30c9ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:19:57.099667 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c64880c-6ea9-4a3c-90fa-1b527a30c9ad None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:19:57.120308 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-6c64880c-6ea9-4a3c-90fa-1b527a30c9ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:19:57.120308 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:19:57.120308 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:19:57.120308 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:19:57.120308 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:19:57.120308 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:19:57.120308 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:19:57.120308 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:19:57.120308 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:19:57.120308 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:19:57.120308 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:19:57.120308 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:19:57.120308 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 03:19:57.120308 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 03:19:57.120308 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 03:19:57.120308 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 03:19:57.121547 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:19:57.121547 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:19:57.121547 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:19:57.121547 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:19:57.121547 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:19:57.121547 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:19:57.121547 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:19:57.121547 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:19:57.121547 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:19:57.121547 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:19:57.121547 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:19:57.121547 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:19:57.121547 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:19:57.121547 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:19:57.121547 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:19:57.121547 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:19:57.121547 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 03:19:57.122726 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 03:19:57.122726 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:19:57.122726 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:19:57.123666 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 620/1251] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:19:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:19:57.128890 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95235d36-61e3-45d0-9ac7-590063965bc7 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:19:57.239464 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95235d36-61e3-45d0-9ac7-590063965bc7 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:19:57.278875 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ea1879-d5fd-4948-b45d-78a877685470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:19:57.279534 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ea1879-d5fd-4948-b45d-78a877685470 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:19:57.279843 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ea1879-d5fd-4948-b45d-78a877685470 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:19:57.280075 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ea1879-d5fd-4948-b45d-78a877685470 None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:19:57.280732 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ea1879-d5fd-4948-b45d-78a877685470 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:19:57.281215 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ea1879-d5fd-4948-b45d-78a877685470 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:19:57.282432 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ea1879-d5fd-4948-b45d-78a877685470 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:19:57.303639 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 632/1252] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 03:19:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:19:57.304780 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c64880c-6ea9-4a3c-90fa-1b527a30c9ad None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:19:57.413975 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c64880c-6ea9-4a3c-90fa-1b527a30c9ad None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:19:57.443284 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:19:57.451972 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a153449-afeb-4867-91f9-090c3fe80b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:19:57.452615 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a153449-afeb-4867-91f9-090c3fe80b5f None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:19:57.452896 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a153449-afeb-4867-91f9-090c3fe80b5f None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:19:57.453170 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a153449-afeb-4867-91f9-090c3fe80b5f None admin] PATH_INFO: `/v3/users/placement` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:19:57.463146 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a153449-afeb-4867-91f9-090c3fe80b5f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:19:57.464655 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a153449-afeb-4867-91f9-090c3fe80b5f None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:19:57.477300 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-0a153449-afeb-4867-91f9-090c3fe80b5f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 04 03:19:57.477300 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:19:57.477300 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:19:57.477300 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:19:57.477300 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:19:57.477300 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:19:57.477300 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:19:57.477300 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:19:57.477300 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:19:57.477300 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:19:57.477300 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:19:57.477300 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:19:57.477300 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 03:19:57.477300 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 03:19:57.477300 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 03:19:57.477300 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 03:19:57.478555 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:19:57.478555 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:19:57.478555 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 03:19:57.478555 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 03:19:57.478555 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 03:19:57.478555 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 03:19:57.478555 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:19:57.478555 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:19:57.478555 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:19:57.478555 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:19:57.478555 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:19:57.478555 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:19:57.478555 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:19:57.478555 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:19:57.478555 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:19:57.478555 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:19:57.478555 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:19:57.478555 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:19:57.479784 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:19:57.479784 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:19:57.479784 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 03:19:57.479784 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 03:19:57.479784 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 03:19:57.479784 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 03:19:57.479784 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 03:19:57.479784 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 03:19:57.479784 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 04 03:19:57.479784 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:19:57.479784 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 621/1253] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:19:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:19:57.487415 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ea1879-d5fd-4948-b45d-78a877685470 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:19:57.543933 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:19:57.589610 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ea1879-d5fd-4948-b45d-78a877685470 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:19:57.625974 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00689b5f-e377-4396-82ee-8b4d5920faaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:19:57.626579 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00689b5f-e377-4396-82ee-8b4d5920faaf None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:19:57.626860 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00689b5f-e377-4396-82ee-8b4d5920faaf None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:19:57.627195 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00689b5f-e377-4396-82ee-8b4d5920faaf None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:19:57.629093 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00689b5f-e377-4396-82ee-8b4d5920faaf None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:19:57.629411 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00689b5f-e377-4396-82ee-8b4d5920faaf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:19:57.630822 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00689b5f-e377-4396-82ee-8b4d5920faaf None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:19:57.653504 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 633/1254] 10.222.0.25 () {56 vars in 1143 bytes} [Tue Oct 4 03:19:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:19:57.659464 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a153449-afeb-4867-91f9-090c3fe80b5f None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:19:57.767849 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a153449-afeb-4867-91f9-090c3fe80b5f None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:19:57.800988 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27eaa5a-2bbf-4bd2-b45a-2fd5736a4a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:19:57.801515 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27eaa5a-2bbf-4bd2-b45a-2fd5736a4a7d None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:19:57.801795 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27eaa5a-2bbf-4bd2-b45a-2fd5736a4a7d None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:19:57.802068 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27eaa5a-2bbf-4bd2-b45a-2fd5736a4a7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:19:57.854950 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:19:57.867556 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27eaa5a-2bbf-4bd2-b45a-2fd5736a4a7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:19:57.868985 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27eaa5a-2bbf-4bd2-b45a-2fd5736a4a7d None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:19:57.964545 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 622/1255] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 03:19:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 03:19:57.970288 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00689b5f-e377-4396-82ee-8b4d5920faaf None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:19:58.069545 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00689b5f-e377-4396-82ee-8b4d5920faaf None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:19:58.082764 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:19:58.104010 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cba2cd-6c9e-420f-8c3f-833b65116a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:19:58.104626 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cba2cd-6c9e-420f-8c3f-833b65116a14 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:19:58.104903 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cba2cd-6c9e-420f-8c3f-833b65116a14 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:19:58.105172 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cba2cd-6c9e-420f-8c3f-833b65116a14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:19:58.116394 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cba2cd-6c9e-420f-8c3f-833b65116a14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:19:58.118600 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cba2cd-6c9e-420f-8c3f-833b65116a14 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:19:58.133316 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-b8cba2cd-6c9e-420f-8c3f-833b65116a14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:19:58.133316 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:19:58.133316 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:19:58.133316 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:19:58.133316 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:19:58.133316 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:19:58.133316 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:19:58.133316 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:19:58.133316 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:19:58.133316 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:19:58.133316 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:19:58.133316 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:19:58.133316 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 03:19:58.133316 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 03:19:58.133316 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 03:19:58.133316 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 03:19:58.134502 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:19:58.134502 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:19:58.134502 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:19:58.134502 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:19:58.134502 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:19:58.134502 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:19:58.134502 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:19:58.134502 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:19:58.134502 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:19:58.134502 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:19:58.134502 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:19:58.134502 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:19:58.134502 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:19:58.134502 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:19:58.134502 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:19:58.134502 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:19:58.134502 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 03:19:58.135622 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 03:19:58.135622 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:19:58.135622 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:19:58.135622 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 634/1256] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:19:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:19:58.140154 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27eaa5a-2bbf-4bd2-b45a-2fd5736a4a7d None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:19:58.226304 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:19:58.238811 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27eaa5a-2bbf-4bd2-b45a-2fd5736a4a7d None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:19:58.274505 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07a3b06-a87f-4dbe-bed3-157954ccb2d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:19:58.275124 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a3b06-a87f-4dbe-bed3-157954ccb2d4 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:19:58.275386 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a3b06-a87f-4dbe-bed3-157954ccb2d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:19:58.275698 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a3b06-a87f-4dbe-bed3-157954ccb2d4 None admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:19:58.276335 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07a3b06-a87f-4dbe-bed3-157954ccb2d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:19:58.276641 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07a3b06-a87f-4dbe-bed3-157954ccb2d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:19:58.277998 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07a3b06-a87f-4dbe-bed3-157954ccb2d4 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:19:58.290434 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 623/1257] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 03:19:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:19:58.296103 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cba2cd-6c9e-420f-8c3f-833b65116a14 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:19:58.394170 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cba2cd-6c9e-420f-8c3f-833b65116a14 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:19:58.426072 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8c2509-1e87-4dd8-93bb-912e06d59518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:19:58.426681 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8c2509-1e87-4dd8-93bb-912e06d59518 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:19:58.426961 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8c2509-1e87-4dd8-93bb-912e06d59518 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:19:58.427231 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8c2509-1e87-4dd8-93bb-912e06d59518 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:19:58.433597 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8c2509-1e87-4dd8-93bb-912e06d59518 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:19:58.435012 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8c2509-1e87-4dd8-93bb-912e06d59518 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:19:58.446660 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-5d8c2509-1e87-4dd8-93bb-912e06d59518 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 03:19:58.446660 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:19:58.446660 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:19:58.446660 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:19:58.446660 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:19:58.446660 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:19:58.446660 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:19:58.446660 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:19:58.446660 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:19:58.446660 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:19:58.446660 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:19:58.446660 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:19:58.446660 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 03:19:58.446660 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 03:19:58.446660 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 03:19:58.447790 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 03:19:58.447790 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:19:58.447790 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:19:58.447790 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:19:58.447790 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:19:58.447790 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:19:58.447790 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:19:58.447790 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:19:58.447790 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:19:58.447790 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:19:58.447790 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:19:58.447790 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:19:58.447790 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:19:58.447790 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:19:58.447790 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:19:58.447790 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:19:58.447790 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:19:58.449041 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 03:19:58.449041 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 03:19:58.449041 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 03:19:58.449041 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 03:19:58.449041 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 03:19:58.449041 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 03:19:58.449041 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 03:19:58.449041 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:19:58.449041 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 635/1258] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 03:19:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:19:58.453456 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07a3b06-a87f-4dbe-bed3-157954ccb2d4 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:19:58.551575 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07a3b06-a87f-4dbe-bed3-157954ccb2d4 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:19:58.584750 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c79214b-1a72-4d45-b93a-06fa24ed80ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:19:58.585338 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79214b-1a72-4d45-b93a-06fa24ed80ad None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:19:58.585619 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79214b-1a72-4d45-b93a-06fa24ed80ad None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:19:58.585893 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79214b-1a72-4d45-b93a-06fa24ed80ad None admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:19:58.586570 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c79214b-1a72-4d45-b93a-06fa24ed80ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:19:58.586873 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c79214b-1a72-4d45-b93a-06fa24ed80ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:19:58.588308 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c79214b-1a72-4d45-b93a-06fa24ed80ad None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:19:58.600098 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 624/1259] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 4 03:19:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:19:58.606079 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8c2509-1e87-4dd8-93bb-912e06d59518 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:19:58.632329 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:19:58.705989 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8c2509-1e87-4dd8-93bb-912e06d59518 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:19:58.738860 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6805112a-bb0b-49c4-a82d-7d805377202b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:19:58.739455 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805112a-bb0b-49c4-a82d-7d805377202b None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:19:58.739785 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805112a-bb0b-49c4-a82d-7d805377202b None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:19:58.740063 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805112a-bb0b-49c4-a82d-7d805377202b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:19:58.740788 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6805112a-bb0b-49c4-a82d-7d805377202b None admin] RBAC: Adding query filter params (role.id=fe9379cda35c4ff78576fe48b60bea3c, scope.project.id=80ae15e46620470b9c55fb7fe300fcb6, user.id=94513f6cd19f495e842deb3c13c3e4d7) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:19:58.741096 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6805112a-bb0b-49c4-a82d-7d805377202b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:19:58.742762 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6805112a-bb0b-49c4-a82d-7d805377202b None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:19:58.748053 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 636/1260] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 03:19:58 2022] GET /identity/v3/role_assignments?user.id=94513f6cd19f495e842deb3c13c3e4d7&scope.project.id=80ae15e46620470b9c55fb7fe300fcb6&role.id=fe9379cda35c4ff78576fe48b60bea3c => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:20:00.874270 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b363f-8cd3-4ba9-bd64-f1200ac743d5 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:20:00.874828 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b363f-8cd3-4ba9-bd64-f1200ac743d5 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:20:00.874828 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b363f-8cd3-4ba9-bd64-f1200ac743d5 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:20:00.876187 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 625/1261] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:20:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:20:00.881399 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9337e0c9-5acd-4483-9318-816b11a1198f None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:20:00.881830 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9337e0c9-5acd-4483-9318-816b11a1198f None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:20:00.881924 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9337e0c9-5acd-4483-9318-816b11a1198f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:20:00.900885 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-9337e0c9-5acd-4483-9318-816b11a1198f None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:20:00.901990 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-9337e0c9-5acd-4483-9318-816b11a1198f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:20:00.970151 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 637/1262] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:20:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 03:20:01.234915 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591b363f-8cd3-4ba9-bd64-f1200ac743d5 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:20:01.245685 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:20:01.350959 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591b363f-8cd3-4ba9-bd64-f1200ac743d5 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:20:01.384906 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c15e11-1599-4c3b-8068-805110b39060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:20:01.385514 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c15e11-1599-4c3b-8068-805110b39060 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:20:01.385790 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c15e11-1599-4c3b-8068-805110b39060 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:20:01.386060 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c15e11-1599-4c3b-8068-805110b39060 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:20:01.395710 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c15e11-1599-4c3b-8068-805110b39060 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:20:01.400328 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-a4c15e11-1599-4c3b-8068-805110b39060 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 03:20:01.400328 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:20:01.400328 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:20:01.400328 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:20:01.400328 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:20:01.400328 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:20:01.400328 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:20:01.400328 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:20:01.400328 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:20:01.400328 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:20:01.400328 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:20:01.400328 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:20:01.400328 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:20:01.400328 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:20:01.400328 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:20:01.400328 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:20:01.401437 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:20:01.401437 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:20:01.401437 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:20:01.401437 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:20:01.401437 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:20:01.401437 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:20:01.401437 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:20:01.401437 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:20:01.401437 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:20:01.401437 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:20:01.401437 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:20:01.401437 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:20:01.401437 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:20:01.401437 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:20:01.401437 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:20:01.401437 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:20:01.402305 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:20:01.402305 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:20:01.402305 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:20:01.402305 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:20:01.402305 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:20:01.402305 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:20:01.402305 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:20:01.402305 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:20:01.402305 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:20:01.402305 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:20:01.402305 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 03:20:01.402305 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:20:01.402305 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 626/1263] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 4 03:20:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:20:01.407369 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9337e0c9-5acd-4483-9318-816b11a1198f None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:20:01.425669 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:20:01.504492 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9337e0c9-5acd-4483-9318-816b11a1198f None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:20:01.537697 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e423944d-5cf6-4e70-ade8-d43564ae09aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:20:01.538287 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e423944d-5cf6-4e70-ade8-d43564ae09aa None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:20:01.538562 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e423944d-5cf6-4e70-ade8-d43564ae09aa None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:20:01.538831 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e423944d-5cf6-4e70-ade8-d43564ae09aa None admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:20:01.539479 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e423944d-5cf6-4e70-ade8-d43564ae09aa None admin] RBAC: Adding query filter params (name=admin) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:20:01.539805 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e423944d-5cf6-4e70-ade8-d43564ae09aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:20:01.541139 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e423944d-5cf6-4e70-ade8-d43564ae09aa None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:20:01.549621 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 638/1264] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 03:20:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:20:01.555327 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c15e11-1599-4c3b-8068-805110b39060 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:20:01.620899 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:20:01.654482 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c15e11-1599-4c3b-8068-805110b39060 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:20:01.687675 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04638f9-51ad-4047-845b-8992841518f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:20:01.688290 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04638f9-51ad-4047-845b-8992841518f6 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:20:01.688574 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04638f9-51ad-4047-845b-8992841518f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:20:01.688847 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04638f9-51ad-4047-845b-8992841518f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:20:01.699214 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04638f9-51ad-4047-845b-8992841518f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:20:01.700688 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04638f9-51ad-4047-845b-8992841518f6 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:20:01.714997 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-b04638f9-51ad-4047-845b-8992841518f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:20:01.714997 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:20:01.714997 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:20:01.714997 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:20:01.714997 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:20:01.714997 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:20:01.714997 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:20:01.714997 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:20:01.714997 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:20:01.714997 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:20:01.714997 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:20:01.714997 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:20:01.714997 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 03:20:01.714997 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 03:20:01.714997 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 03:20:01.714997 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 03:20:01.716181 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:20:01.716181 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:20:01.716181 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:20:01.716181 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:20:01.716181 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:20:01.716181 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:20:01.716181 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:20:01.716181 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:20:01.716181 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:20:01.716181 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:20:01.716181 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:20:01.716181 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:20:01.716181 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:20:01.716181 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:20:01.716181 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:20:01.716181 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:20:01.716181 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 03:20:01.717438 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 03:20:01.717438 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:20:01.717438 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:20:01.717438 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 627/1265] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:20:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:20:01.722479 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e423944d-5cf6-4e70-ade8-d43564ae09aa None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:20:01.799754 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:20:01.819275 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e423944d-5cf6-4e70-ade8-d43564ae09aa None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:20:01.851455 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d345ca3-b9cd-47a4-aced-397b2446a95a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:20:01.852070 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d345ca3-b9cd-47a4-aced-397b2446a95a None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:20:01.852347 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d345ca3-b9cd-47a4-aced-397b2446a95a None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:20:01.852617 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d345ca3-b9cd-47a4-aced-397b2446a95a None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:20:01.853242 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d345ca3-b9cd-47a4-aced-397b2446a95a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:20:01.853541 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d345ca3-b9cd-47a4-aced-397b2446a95a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:20:01.854873 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d345ca3-b9cd-47a4-aced-397b2446a95a None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:20:01.866662 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 639/1266] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 03:20:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:20:01.872196 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04638f9-51ad-4047-845b-8992841518f6 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:20:01.968415 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04638f9-51ad-4047-845b-8992841518f6 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:20:01.988037 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:20:02.001878 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d117c06-5056-452f-9c2c-5e89157a4615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:20:02.002577 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d117c06-5056-452f-9c2c-5e89157a4615 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:20:02.002798 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d117c06-5056-452f-9c2c-5e89157a4615 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:20:02.003074 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d117c06-5056-452f-9c2c-5e89157a4615 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:20:02.010179 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d117c06-5056-452f-9c2c-5e89157a4615 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:20:02.011622 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d117c06-5056-452f-9c2c-5e89157a4615 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:20:02.022380 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-3d117c06-5056-452f-9c2c-5e89157a4615 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 04 03:20:02.022380 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:20:02.022380 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:20:02.022380 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:20:02.022380 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:20:02.022380 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:20:02.022380 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:20:02.022380 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:20:02.022380 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:20:02.022380 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:20:02.022380 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:20:02.022380 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:20:02.022380 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 03:20:02.022380 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 03:20:02.022380 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 03:20:02.022380 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 03:20:02.023505 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:20:02.023505 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:20:02.023505 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 03:20:02.023505 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 03:20:02.023505 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 03:20:02.023505 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 03:20:02.023505 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:20:02.023505 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:20:02.023505 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:20:02.023505 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:20:02.023505 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:20:02.023505 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:20:02.023505 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:20:02.023505 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:20:02.023505 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:20:02.023505 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:20:02.023505 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:20:02.023505 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:20:02.024457 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:20:02.024457 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:20:02.024457 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 03:20:02.024457 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 03:20:02.024457 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 03:20:02.024457 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 03:20:02.024457 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 03:20:02.024457 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 03:20:02.024457 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 04 03:20:02.024457 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:20:02.024457 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 628/1267] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:20:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:20:02.029207 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d345ca3-b9cd-47a4-aced-397b2446a95a None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:20:02.129074 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d345ca3-b9cd-47a4-aced-397b2446a95a None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:20:02.164398 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443d99fa-eca4-4c4a-8abc-5fc2bc72b88a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:20:02.164997 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443d99fa-eca4-4c4a-8abc-5fc2bc72b88a None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:20:02.165281 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443d99fa-eca4-4c4a-8abc-5fc2bc72b88a None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:20:02.165555 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443d99fa-eca4-4c4a-8abc-5fc2bc72b88a None admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:20:02.166274 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443d99fa-eca4-4c4a-8abc-5fc2bc72b88a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:20:02.166580 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443d99fa-eca4-4c4a-8abc-5fc2bc72b88a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:20:02.168029 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443d99fa-eca4-4c4a-8abc-5fc2bc72b88a None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:20:02.176537 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:20:02.185018 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 640/1268] 10.222.0.25 () {56 vars in 1143 bytes} [Tue Oct 4 03:20:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:20:02.191202 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d117c06-5056-452f-9c2c-5e89157a4615 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:20:02.291149 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d117c06-5056-452f-9c2c-5e89157a4615 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:20:02.324589 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c671d67-67f9-49e1-b0d4-20884effda3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:20:02.325194 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c671d67-67f9-49e1-b0d4-20884effda3f None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:20:02.325472 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c671d67-67f9-49e1-b0d4-20884effda3f None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:20:02.325742 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c671d67-67f9-49e1-b0d4-20884effda3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:20:02.335882 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c671d67-67f9-49e1-b0d4-20884effda3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:20:02.337289 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c671d67-67f9-49e1-b0d4-20884effda3f None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:20:02.350789 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-8c671d67-67f9-49e1-b0d4-20884effda3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:20:02.350789 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:20:02.350789 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:20:02.350789 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:20:02.350789 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:20:02.350789 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:20:02.350789 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:20:02.350789 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:20:02.350789 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:20:02.350789 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:20:02.350789 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:20:02.350789 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:20:02.350789 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 03:20:02.350789 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 03:20:02.350789 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 03:20:02.350789 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 03:20:02.351979 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:20:02.351979 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:20:02.351979 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:20:02.351979 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:20:02.351979 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:20:02.351979 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:20:02.351979 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:20:02.351979 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:20:02.351979 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:20:02.351979 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:20:02.351979 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:20:02.351979 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:20:02.351979 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:20:02.351979 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:20:02.351979 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:20:02.351979 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:20:02.351979 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 03:20:02.353067 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 03:20:02.353067 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:20:02.353067 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:20:02.353067 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 629/1269] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:20:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:20:02.357637 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443d99fa-eca4-4c4a-8abc-5fc2bc72b88a None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:20:02.452919 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443d99fa-eca4-4c4a-8abc-5fc2bc72b88a None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:20:02.485123 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5960361-ae80-4193-b940-e36398032755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:20:02.485707 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5960361-ae80-4193-b940-e36398032755 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:20:02.485984 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5960361-ae80-4193-b940-e36398032755 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:20:02.486252 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5960361-ae80-4193-b940-e36398032755 None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:20:02.487450 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5960361-ae80-4193-b940-e36398032755 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:20:02.487778 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5960361-ae80-4193-b940-e36398032755 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:20:02.489105 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5960361-ae80-4193-b940-e36398032755 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:20:02.499736 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 641/1270] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 03:20:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:20:02.505612 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c671d67-67f9-49e1-b0d4-20884effda3f None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:20:02.537035 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:20:02.615355 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c671d67-67f9-49e1-b0d4-20884effda3f None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:20:02.648327 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83167419-cec5-41b1-b53f-6b0106991192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:20:02.648950 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83167419-cec5-41b1-b53f-6b0106991192 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:20:02.649232 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83167419-cec5-41b1-b53f-6b0106991192 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:20:02.649508 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83167419-cec5-41b1-b53f-6b0106991192 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:20:02.655970 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83167419-cec5-41b1-b53f-6b0106991192 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:20:02.657396 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83167419-cec5-41b1-b53f-6b0106991192 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:20:02.668923 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-83167419-cec5-41b1-b53f-6b0106991192 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 03:20:02.668923 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:20:02.668923 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:20:02.668923 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:20:02.668923 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:20:02.668923 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:20:02.668923 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:20:02.668923 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:20:02.668923 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:20:02.668923 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:20:02.668923 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:20:02.668923 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:20:02.668923 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 03:20:02.668923 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 03:20:02.668923 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 03:20:02.669940 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 03:20:02.669940 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:20:02.669940 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:20:02.669940 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:20:02.669940 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:20:02.669940 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:20:02.669940 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:20:02.669940 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:20:02.669940 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:20:02.669940 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:20:02.669940 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:20:02.669940 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:20:02.669940 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:20:02.669940 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:20:02.669940 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:20:02.669940 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:20:02.669940 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:20:02.670939 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 03:20:02.670939 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 03:20:02.670939 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 03:20:02.670939 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 03:20:02.670939 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 03:20:02.670939 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 03:20:02.670939 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 03:20:02.670939 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:20:02.670939 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 630/1271] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 03:20:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:20:02.676649 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5960361-ae80-4193-b940-e36398032755 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:20:02.732748 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:20:02.773361 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5960361-ae80-4193-b940-e36398032755 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:20:02.805661 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fade75-dc6c-47a7-9efe-309cd9cba2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:20:02.806251 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fade75-dc6c-47a7-9efe-309cd9cba2fd None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:20:02.806533 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fade75-dc6c-47a7-9efe-309cd9cba2fd None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:20:02.806805 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fade75-dc6c-47a7-9efe-309cd9cba2fd None admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:20:02.807479 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fade75-dc6c-47a7-9efe-309cd9cba2fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:20:02.807813 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fade75-dc6c-47a7-9efe-309cd9cba2fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:20:02.809209 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fade75-dc6c-47a7-9efe-309cd9cba2fd None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:20:02.820924 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 642/1272] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 4 03:20:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:20:02.826767 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83167419-cec5-41b1-b53f-6b0106991192 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:20:02.917408 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:20:02.926318 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83167419-cec5-41b1-b53f-6b0106991192 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:20:02.959668 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a14486-fa0f-4fb5-8310-cf9d6ea24e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:20:02.960305 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a14486-fa0f-4fb5-8310-cf9d6ea24e1e None admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:20:02.960585 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a14486-fa0f-4fb5-8310-cf9d6ea24e1e None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:20:02.960857 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a14486-fa0f-4fb5-8310-cf9d6ea24e1e None admin] PATH_INFO: `/v3/projects/80ae15e46620470b9c55fb7fe300fcb6/users/94513f6cd19f495e842deb3c13c3e4d7/roles/fe9379cda35c4ff78576fe48b60bea3c` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:20:02.962710 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a14486-fa0f-4fb5-8310-cf9d6ea24e1e None admin] RBAC: Authorizing `identity:create_grant(project_id=80ae15e46620470b9c55fb7fe300fcb6, user_id=94513f6cd19f495e842deb3c13c3e4d7, role_id=fe9379cda35c4ff78576fe48b60bea3c)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:20:02.964172 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a14486-fa0f-4fb5-8310-cf9d6ea24e1e None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:20:02.976652 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 631/1273] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Oct 4 03:20:02 2022] PUT /identity/v3/projects/80ae15e46620470b9c55fb7fe300fcb6/users/94513f6cd19f495e842deb3c13c3e4d7/roles/fe9379cda35c4ff78576fe48b60bea3c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:20:05.081597 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a5f1e3-c37f-495a-8ad2-4cd5e8ed5838 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:20:05.082146 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a5f1e3-c37f-495a-8ad2-4cd5e8ed5838 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:20:05.082146 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a5f1e3-c37f-495a-8ad2-4cd5e8ed5838 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:20:05.083507 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 643/1274] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:20:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:20:05.088745 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524eed87-8b64-4c67-9a1c-26d3cf266900 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:20:05.089180 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524eed87-8b64-4c67-9a1c-26d3cf266900 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:20:05.089287 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524eed87-8b64-4c67-9a1c-26d3cf266900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:20:05.106990 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-524eed87-8b64-4c67-9a1c-26d3cf266900 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:20:05.108187 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-524eed87-8b64-4c67-9a1c-26d3cf266900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:20:05.171685 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 632/1275] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:20:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 03:20:05.456233 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a5f1e3-c37f-495a-8ad2-4cd5e8ed5838 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:20:05.554252 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a5f1e3-c37f-495a-8ad2-4cd5e8ed5838 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:20:05.571379 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:20:05.588636 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6136e19-ea65-4215-9989-9e12b7ec58f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:20:05.589250 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6136e19-ea65-4215-9989-9e12b7ec58f9 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:20:05.589531 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6136e19-ea65-4215-9989-9e12b7ec58f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:20:05.589803 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6136e19-ea65-4215-9989-9e12b7ec58f9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:20:05.600905 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6136e19-ea65-4215-9989-9e12b7ec58f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 03:20:05.605598 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-b6136e19-ea65-4215-9989-9e12b7ec58f9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 03:20:05.605598 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:20:05.605598 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:20:05.605598 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:20:05.605598 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:20:05.605598 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:20:05.605598 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:20:05.605598 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:20:05.605598 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:20:05.605598 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:20:05.605598 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:20:05.605598 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:20:05.605598 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 03:20:05.605598 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 03:20:05.605598 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 03:20:05.605598 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 03:20:05.606690 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 03:20:05.606690 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 03:20:05.606690 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 03:20:05.606690 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 03:20:05.606690 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:20:05.606690 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:20:05.606690 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:20:05.606690 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:20:05.606690 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:20:05.606690 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:20:05.606690 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:20:05.606690 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:20:05.606690 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:20:05.606690 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:20:05.606690 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:20:05.606690 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:20:05.607743 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:20:05.607743 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:20:05.607743 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:20:05.607743 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:20:05.607743 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 03:20:05.607743 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 03:20:05.607743 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 03:20:05.607743 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 03:20:05.607743 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 03:20:05.607743 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 03:20:05.607743 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 03:20:05.607743 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:20:05.607743 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 644/1276] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 4 03:20:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:20:05.612827 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524eed87-8b64-4c67-9a1c-26d3cf266900 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:20:05.691011 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:20:05.709189 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524eed87-8b64-4c67-9a1c-26d3cf266900 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:20:05.741711 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881957ba-8f08-4f04-abe0-62dfd65c41ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:20:05.742300 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881957ba-8f08-4f04-abe0-62dfd65c41ad None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:20:05.742579 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881957ba-8f08-4f04-abe0-62dfd65c41ad None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:20:05.742852 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881957ba-8f08-4f04-abe0-62dfd65c41ad None admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:20:05.743521 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881957ba-8f08-4f04-abe0-62dfd65c41ad None admin] RBAC: Adding query filter params (name=admin) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:20:05.743833 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881957ba-8f08-4f04-abe0-62dfd65c41ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:20:05.745185 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881957ba-8f08-4f04-abe0-62dfd65c41ad None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:20:05.753341 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 633/1277] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 03:20:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:20:05.759211 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6136e19-ea65-4215-9989-9e12b7ec58f9 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:20:05.854869 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6136e19-ea65-4215-9989-9e12b7ec58f9 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:20:05.887134 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742a314a-fae5-4bf1-84d8-15e2b9da1343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:20:05.887761 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a314a-fae5-4bf1-84d8-15e2b9da1343 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:20:05.888043 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a314a-fae5-4bf1-84d8-15e2b9da1343 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:20:05.888316 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a314a-fae5-4bf1-84d8-15e2b9da1343 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:20:05.898461 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742a314a-fae5-4bf1-84d8-15e2b9da1343 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:20:05.899906 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742a314a-fae5-4bf1-84d8-15e2b9da1343 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:20:05.913884 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-742a314a-fae5-4bf1-84d8-15e2b9da1343 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:20:05.913884 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:20:05.913884 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:20:05.913884 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:20:05.913884 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:20:05.913884 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:20:05.913884 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:20:05.913884 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:20:05.913884 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:20:05.913884 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:20:05.913884 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:20:05.913884 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:20:05.913884 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 03:20:05.913884 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 03:20:05.913884 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 03:20:05.913884 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 03:20:05.915047 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:20:05.915047 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:20:05.915047 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:20:05.915047 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:20:05.915047 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:20:05.915047 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:20:05.915047 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:20:05.915047 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:20:05.915047 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:20:05.915047 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:20:05.915047 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:20:05.915047 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:20:05.915047 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:20:05.915047 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:20:05.915047 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:20:05.915047 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:20:05.915047 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 03:20:05.916380 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 03:20:05.916380 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:20:05.916380 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:20:05.916380 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 645/1278] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:20:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:20:05.920501 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881957ba-8f08-4f04-abe0-62dfd65c41ad None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:20:06.017390 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881957ba-8f08-4f04-abe0-62dfd65c41ad None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:20:06.048696 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802e17b7-0075-4da6-a5b6-c68e27cf40b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:20:06.049844 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e17b7-0075-4da6-a5b6-c68e27cf40b2 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:20:06.050118 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e17b7-0075-4da6-a5b6-c68e27cf40b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:20:06.050384 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e17b7-0075-4da6-a5b6-c68e27cf40b2 None admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:20:06.051004 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802e17b7-0075-4da6-a5b6-c68e27cf40b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:20:06.051299 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802e17b7-0075-4da6-a5b6-c68e27cf40b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:20:06.052659 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802e17b7-0075-4da6-a5b6-c68e27cf40b2 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:20:06.063693 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 634/1279] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 03:20:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:20:06.070084 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742a314a-fae5-4bf1-84d8-15e2b9da1343 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:20:06.100026 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:20:06.172655 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742a314a-fae5-4bf1-84d8-15e2b9da1343 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:20:06.208632 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaebf11-df27-4844-bdfe-53868733290f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:20:06.209239 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaebf11-df27-4844-bdfe-53868733290f None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:20:06.209521 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaebf11-df27-4844-bdfe-53868733290f None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:20:06.209792 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaebf11-df27-4844-bdfe-53868733290f None admin] PATH_INFO: `/v3/users/placement` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:20:06.216896 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaebf11-df27-4844-bdfe-53868733290f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:20:06.218321 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaebf11-df27-4844-bdfe-53868733290f None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:20:06.229544 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-fdaebf11-df27-4844-bdfe-53868733290f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 04 03:20:06.229544 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:20:06.229544 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:20:06.229544 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:20:06.229544 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:20:06.229544 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:20:06.229544 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:20:06.229544 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:20:06.229544 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:20:06.229544 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:20:06.229544 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:20:06.229544 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:20:06.229544 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 03:20:06.229544 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 03:20:06.229544 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 03:20:06.229544 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 03:20:06.230681 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:20:06.230681 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:20:06.230681 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 03:20:06.230681 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 03:20:06.230681 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 03:20:06.230681 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 03:20:06.230681 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:20:06.230681 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:20:06.230681 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:20:06.230681 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:20:06.230681 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:20:06.230681 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:20:06.230681 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:20:06.230681 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:20:06.230681 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:20:06.230681 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:20:06.230681 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:20:06.230681 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:20:06.231839 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:20:06.231839 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:20:06.231839 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 03:20:06.231839 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 03:20:06.231839 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 03:20:06.231839 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 03:20:06.231839 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 03:20:06.231839 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 03:20:06.231839 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 04 03:20:06.231839 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:20:06.231839 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 646/1280] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:20:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:20:06.237106 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802e17b7-0075-4da6-a5b6-c68e27cf40b2 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:20:06.240863 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:20:06.336262 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802e17b7-0075-4da6-a5b6-c68e27cf40b2 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:20:06.370201 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b86be9-81a7-4a84-b09d-65c3b509d18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:20:06.370783 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b86be9-81a7-4a84-b09d-65c3b509d18e None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:20:06.371063 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b86be9-81a7-4a84-b09d-65c3b509d18e None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:20:06.371335 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b86be9-81a7-4a84-b09d-65c3b509d18e None admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:20:06.372069 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b86be9-81a7-4a84-b09d-65c3b509d18e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:20:06.372373 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b86be9-81a7-4a84-b09d-65c3b509d18e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:20:06.373776 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b86be9-81a7-4a84-b09d-65c3b509d18e None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:20:06.389915 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 635/1281] 10.222.0.25 () {56 vars in 1143 bytes} [Tue Oct 4 03:20:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:20:06.396437 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaebf11-df27-4844-bdfe-53868733290f None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:20:06.484337 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:20:06.494283 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaebf11-df27-4844-bdfe-53868733290f None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:20:06.525918 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042c8b6f-a0cd-425a-8a01-f194959e8376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:20:06.526513 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c8b6f-a0cd-425a-8a01-f194959e8376 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:20:06.526794 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c8b6f-a0cd-425a-8a01-f194959e8376 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:20:06.527070 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c8b6f-a0cd-425a-8a01-f194959e8376 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:20:06.593278 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042c8b6f-a0cd-425a-8a01-f194959e8376 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:20:06.594653 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042c8b6f-a0cd-425a-8a01-f194959e8376 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:20:06.693368 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:20:06.703580 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 647/1282] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 03:20:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 03:20:06.710097 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b86be9-81a7-4a84-b09d-65c3b509d18e None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:20:06.769128 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:20:06.806495 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b86be9-81a7-4a84-b09d-65c3b509d18e None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:20:06.839335 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9472d8-339c-45d9-9b25-a74d6d28bba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:20:06.839971 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9472d8-339c-45d9-9b25-a74d6d28bba5 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:20:06.840249 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9472d8-339c-45d9-9b25-a74d6d28bba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:20:06.840519 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9472d8-339c-45d9-9b25-a74d6d28bba5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:20:06.850669 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9472d8-339c-45d9-9b25-a74d6d28bba5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:20:06.852063 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9472d8-339c-45d9-9b25-a74d6d28bba5 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:20:06.867739 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-ed9472d8-339c-45d9-9b25-a74d6d28bba5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:20:06.867739 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:20:06.867739 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:20:06.867739 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:20:06.867739 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:20:06.867739 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:20:06.867739 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:20:06.867739 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:20:06.867739 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:20:06.867739 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:20:06.867739 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:20:06.867739 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:20:06.867739 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 03:20:06.867739 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 03:20:06.867739 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 03:20:06.867739 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 03:20:06.868903 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:20:06.868903 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:20:06.868903 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:20:06.868903 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:20:06.868903 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:20:06.868903 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:20:06.868903 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:20:06.868903 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:20:06.868903 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:20:06.868903 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:20:06.868903 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:20:06.868903 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:20:06.868903 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:20:06.868903 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:20:06.868903 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:20:06.868903 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:20:06.868903 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 03:20:06.870167 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 03:20:06.870167 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 03:20:06.870167 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:20:06.870167 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 636/1283] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:20:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:20:06.874620 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042c8b6f-a0cd-425a-8a01-f194959e8376 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:20:06.971656 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042c8b6f-a0cd-425a-8a01-f194959e8376 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:20:07.007690 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8737703-f4ba-4b0a-8cb5-a607f3a70d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:20:07.008381 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8737703-f4ba-4b0a-8cb5-a607f3a70d50 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:20:07.008660 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8737703-f4ba-4b0a-8cb5-a607f3a70d50 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:20:07.008929 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8737703-f4ba-4b0a-8cb5-a607f3a70d50 None admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:20:07.009561 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8737703-f4ba-4b0a-8cb5-a607f3a70d50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:20:07.009859 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8737703-f4ba-4b0a-8cb5-a607f3a70d50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:20:07.011309 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8737703-f4ba-4b0a-8cb5-a607f3a70d50 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:20:07.027540 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 648/1284] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 03:20:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:20:07.033177 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9472d8-339c-45d9-9b25-a74d6d28bba5 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:20:07.162531 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9472d8-339c-45d9-9b25-a74d6d28bba5 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:20:07.179336 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:20:07.205966 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1edd781-458f-498c-afaa-eec079731107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:20:07.206590 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1edd781-458f-498c-afaa-eec079731107 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:20:07.206869 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1edd781-458f-498c-afaa-eec079731107 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:20:07.207145 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1edd781-458f-498c-afaa-eec079731107 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:20:07.214596 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1edd781-458f-498c-afaa-eec079731107 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:20:07.216351 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1edd781-458f-498c-afaa-eec079731107 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:20:07.231709 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application [None req-e1edd781-458f-498c-afaa-eec079731107 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 03:20:07.231709 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:20:07.231709 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:20:07.231709 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:20:07.231709 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:20:07.231709 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:20:07.231709 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:20:07.231709 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:20:07.231709 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:20:07.231709 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:20:07.231709 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:20:07.231709 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:20:07.231709 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 03:20:07.231709 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 03:20:07.231709 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 03:20:07.232806 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 03:20:07.232806 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:20:07.232806 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:20:07.232806 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:20:07.232806 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:20:07.232806 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:20:07.232806 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:20:07.232806 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:20:07.232806 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application with Lock( Oct 04 03:20:07.232806 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:20:07.232806 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:20:07.232806 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:20:07.232806 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:20:07.232806 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:20:07.232806 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:20:07.232806 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:20:07.232806 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:20:07.240248 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 03:20:07.240248 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 03:20:07.240248 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 03:20:07.240248 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 03:20:07.240248 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 03:20:07.240248 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 03:20:07.240248 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 03:20:07.240248 dv-cinder-849143-9-smb devstack@keystone.service[81380]: ERROR keystone.server.flask.application Oct 04 03:20:07.240248 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 637/1285] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 03:20:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:20:07.241490 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8737703-f4ba-4b0a-8cb5-a607f3a70d50 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:20:07.295784 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:20:07.363720 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8737703-f4ba-4b0a-8cb5-a607f3a70d50 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:20:07.413231 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3685c38-4df9-46d1-893f-f36cc11bf6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:20:07.413231 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3685c38-4df9-46d1-893f-f36cc11bf6fd None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:20:07.413231 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3685c38-4df9-46d1-893f-f36cc11bf6fd None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:20:07.413231 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3685c38-4df9-46d1-893f-f36cc11bf6fd None admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:20:07.413778 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3685c38-4df9-46d1-893f-f36cc11bf6fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:20:07.414047 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3685c38-4df9-46d1-893f-f36cc11bf6fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:20:07.415473 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3685c38-4df9-46d1-893f-f36cc11bf6fd None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:20:07.428254 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 649/1286] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 4 03:20:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:20:07.435111 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1edd781-458f-498c-afaa-eec079731107 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:20:07.545472 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1edd781-458f-498c-afaa-eec079731107 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:20:07.583213 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094727c1-3440-43ad-9fc6-155a16014b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:20:07.583841 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094727c1-3440-43ad-9fc6-155a16014b00 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:20:07.584125 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094727c1-3440-43ad-9fc6-155a16014b00 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:20:07.584399 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094727c1-3440-43ad-9fc6-155a16014b00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:20:07.585207 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094727c1-3440-43ad-9fc6-155a16014b00 None admin] RBAC: Adding query filter params (role.id=fe9379cda35c4ff78576fe48b60bea3c, scope.project.id=80ae15e46620470b9c55fb7fe300fcb6, user.id=94513f6cd19f495e842deb3c13c3e4d7) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:20:07.585431 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094727c1-3440-43ad-9fc6-155a16014b00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:20:07.586854 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094727c1-3440-43ad-9fc6-155a16014b00 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:20:07.592871 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 638/1287] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 03:20:07 2022] GET /identity/v3/role_assignments?user.id=94513f6cd19f495e842deb3c13c3e4d7&scope.project.id=80ae15e46620470b9c55fb7fe300fcb6&role.id=fe9379cda35c4ff78576fe48b60bea3c => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:20:09.787734 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d0c5b8-616d-462c-8e9f-3ba3f785d68b None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:20:09.788278 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d0c5b8-616d-462c-8e9f-3ba3f785d68b None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:20:09.788278 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d0c5b8-616d-462c-8e9f-3ba3f785d68b None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:20:09.789613 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 650/1288] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:20:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:20:09.794772 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df091e29-5ed7-4e02-aea1-ed4b3409d0f5 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:20:09.795170 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df091e29-5ed7-4e02-aea1-ed4b3409d0f5 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:20:09.795328 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df091e29-5ed7-4e02-aea1-ed4b3409d0f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:20:09.813648 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-df091e29-5ed7-4e02-aea1-ed4b3409d0f5 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:20:09.815556 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-df091e29-5ed7-4e02-aea1-ed4b3409d0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:20:09.844041 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:20:09.880777 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 639/1289] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:20:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 03:20:10.147751 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d0c5b8-616d-462c-8e9f-3ba3f785d68b None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:20:10.246253 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d0c5b8-616d-462c-8e9f-3ba3f785d68b None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:20:10.258190 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:20:10.285212 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed25940-19dc-411f-a009-edc72da2cfa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:20:10.285862 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed25940-19dc-411f-a009-edc72da2cfa5 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:20:10.286123 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed25940-19dc-411f-a009-edc72da2cfa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:20:10.286422 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed25940-19dc-411f-a009-edc72da2cfa5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:20:10.286971 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed25940-19dc-411f-a009-edc72da2cfa5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:20:10.288400 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed25940-19dc-411f-a009-edc72da2cfa5 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:20:10.297859 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-2ed25940-19dc-411f-a009-edc72da2cfa5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 03:20:10.297859 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:20:10.297859 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 03:20:10.297859 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 03:20:10.297859 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 03:20:10.297859 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 03:20:10.297859 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 03:20:10.297859 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 03:20:10.297859 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 03:20:10.297859 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:20:10.297859 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 03:20:10.297859 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:20:10.297859 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:20:10.297859 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:20:10.297859 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:20:10.297859 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:20:10.297859 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:20:10.299639 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:20:10.299639 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:20:10.299639 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:20:10.299639 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:20:10.299639 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:20:10.299639 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:20:10.299639 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 03:20:10.299639 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 03:20:10.299639 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 03:20:10.299639 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 03:20:10.299639 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:20:10.299639 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:20:10.299639 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:20:10.299639 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:20:10.299639 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:20:10.299639 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:20:10.300518 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:20:10.300518 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:20:10.300518 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:20:10.300518 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:20:10.300518 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:20:10.300518 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:20:10.300518 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:20:10.300518 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:20:10.300518 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:20:10.300518 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:20:10.300518 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 03:20:10.300518 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 03:20:10.300518 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 03:20:10.300518 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:20:10.300518 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 651/1290] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Oct 4 03:20:10 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:20:10.305702 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df091e29-5ed7-4e02-aea1-ed4b3409d0f5 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:20:10.410558 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df091e29-5ed7-4e02-aea1-ed4b3409d0f5 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:20:10.443755 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7bafdc-1399-45d8-9ee6-8f683ea6e4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:20:10.444335 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7bafdc-1399-45d8-9ee6-8f683ea6e4fc None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:20:10.444615 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7bafdc-1399-45d8-9ee6-8f683ea6e4fc None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:20:10.444886 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7bafdc-1399-45d8-9ee6-8f683ea6e4fc None admin] PATH_INFO: `/v3/services` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:20:10.445526 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7bafdc-1399-45d8-9ee6-8f683ea6e4fc None admin] RBAC: Adding query filter params (name=placement) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:20:10.446078 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7bafdc-1399-45d8-9ee6-8f683ea6e4fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:20:10.447437 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7bafdc-1399-45d8-9ee6-8f683ea6e4fc None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:20:10.452090 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 640/1291] 10.222.0.25 () {56 vars in 1116 bytes} [Tue Oct 4 03:20:10 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:20:10.457962 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed25940-19dc-411f-a009-edc72da2cfa5 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:20:10.554249 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed25940-19dc-411f-a009-edc72da2cfa5 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:20:10.586909 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61036ce7-741e-435b-b425-7cb63051acdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:20:10.587517 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61036ce7-741e-435b-b425-7cb63051acdf None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:20:10.587806 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61036ce7-741e-435b-b425-7cb63051acdf None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:20:10.588082 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61036ce7-741e-435b-b425-7cb63051acdf None admin] PATH_INFO: `/v3/services` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:20:10.588701 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61036ce7-741e-435b-b425-7cb63051acdf None admin] RBAC: Adding query filter params (type=placement) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:20:10.589006 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61036ce7-741e-435b-b425-7cb63051acdf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:20:10.590366 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61036ce7-741e-435b-b425-7cb63051acdf None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:20:10.594582 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 652/1292] 10.222.0.25 () {56 vars in 1116 bytes} [Tue Oct 4 03:20:10 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:20:12.721748 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c630a69-0bbd-4e67-a772-c98e171ea978 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:20:12.722270 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c630a69-0bbd-4e67-a772-c98e171ea978 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:20:12.722270 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c630a69-0bbd-4e67-a772-c98e171ea978 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:20:12.723653 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 641/1293] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:20:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:20:12.728918 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd99bd4-5d2c-4fe8-b6e4-8a2bdd10ae25 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:20:12.729319 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd99bd4-5d2c-4fe8-b6e4-8a2bdd10ae25 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:20:12.729474 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd99bd4-5d2c-4fe8-b6e4-8a2bdd10ae25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:20:12.747536 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-dcd99bd4-5d2c-4fe8-b6e4-8a2bdd10ae25 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:20:12.748722 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-dcd99bd4-5d2c-4fe8-b6e4-8a2bdd10ae25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:20:12.778120 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:20:12.815758 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 653/1294] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:20:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 03:20:13.087559 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c630a69-0bbd-4e67-a772-c98e171ea978 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:20:13.117981 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:20:13.186369 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c630a69-0bbd-4e67-a772-c98e171ea978 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:20:13.219699 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5176b87e-81f6-4755-bb8d-eb8cb50527f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:20:13.220289 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5176b87e-81f6-4755-bb8d-eb8cb50527f6 None admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:20:13.220673 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5176b87e-81f6-4755-bb8d-eb8cb50527f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:20:13.221056 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5176b87e-81f6-4755-bb8d-eb8cb50527f6 None admin] PATH_INFO: `/v3/services` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:20:13.221697 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5176b87e-81f6-4755-bb8d-eb8cb50527f6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:20:13.223048 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5176b87e-81f6-4755-bb8d-eb8cb50527f6 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:20:13.237105 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 642/1295] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Oct 4 03:20:13 2022] POST /identity/v3/services => generated 246 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:20:15.404900 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ab0b7-bc0b-44e4-8182-4e9410c7b378 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:20:15.405430 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ab0b7-bc0b-44e4-8182-4e9410c7b378 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:20:15.405430 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ab0b7-bc0b-44e4-8182-4e9410c7b378 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:20:15.406795 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 654/1296] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:20:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:20:15.412602 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aed2d4-8c2b-4896-a603-37f44c80561c None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:20:15.413003 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aed2d4-8c2b-4896-a603-37f44c80561c None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:20:15.413146 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aed2d4-8c2b-4896-a603-37f44c80561c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:20:15.431379 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-d5aed2d4-8c2b-4896-a603-37f44c80561c None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:20:15.432585 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-d5aed2d4-8c2b-4896-a603-37f44c80561c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:20:15.502745 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 643/1297] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:20:15 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 03:20:15.766959 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ab0b7-bc0b-44e4-8182-4e9410c7b378 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:20:15.865417 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ab0b7-bc0b-44e4-8182-4e9410c7b378 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:20:15.898381 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b833c086-a71e-4f11-8c18-dccf8f765c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:20:15.898998 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b833c086-a71e-4f11-8c18-dccf8f765c61 None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:20:15.899281 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b833c086-a71e-4f11-8c18-dccf8f765c61 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:20:15.899580 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b833c086-a71e-4f11-8c18-dccf8f765c61 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:20:15.900156 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b833c086-a71e-4f11-8c18-dccf8f765c61 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:20:15.901520 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b833c086-a71e-4f11-8c18-dccf8f765c61 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:20:15.910800 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-b833c086-a71e-4f11-8c18-dccf8f765c61 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 03:20:15.910800 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:20:15.910800 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 03:20:15.910800 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 03:20:15.910800 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 03:20:15.910800 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 03:20:15.910800 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 03:20:15.910800 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 03:20:15.910800 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 03:20:15.910800 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:20:15.910800 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 03:20:15.910800 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:20:15.910800 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:20:15.910800 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:20:15.910800 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:20:15.910800 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:20:15.910800 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:20:15.911994 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:20:15.911994 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:20:15.911994 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:20:15.911994 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:20:15.911994 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:20:15.911994 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:20:15.911994 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 03:20:15.911994 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 03:20:15.911994 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 03:20:15.911994 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 03:20:15.911994 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:20:15.911994 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:20:15.911994 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:20:15.911994 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:20:15.911994 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:20:15.911994 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:20:15.913021 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:20:15.913021 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:20:15.913021 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:20:15.913021 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:20:15.913021 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:20:15.913021 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:20:15.913021 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:20:15.913021 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:20:15.913021 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:20:15.913021 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:20:15.913021 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 03:20:15.913021 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 03:20:15.913021 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 03:20:15.913021 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:20:15.913021 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 655/1298] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Oct 4 03:20:15 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:20:15.917783 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aed2d4-8c2b-4896-a603-37f44c80561c None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:20:15.935388 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:20:16.019874 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aed2d4-8c2b-4896-a603-37f44c80561c None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:20:16.052445 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3cc8fc-8d26-40ee-977a-256bbd2b6378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:20:16.053032 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3cc8fc-8d26-40ee-977a-256bbd2b6378 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:20:16.053310 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3cc8fc-8d26-40ee-977a-256bbd2b6378 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:20:16.053579 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3cc8fc-8d26-40ee-977a-256bbd2b6378 None admin] PATH_INFO: `/v3/services` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:20:16.054189 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3cc8fc-8d26-40ee-977a-256bbd2b6378 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:20:16.054488 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3cc8fc-8d26-40ee-977a-256bbd2b6378 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:20:16.055856 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3cc8fc-8d26-40ee-977a-256bbd2b6378 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:20:16.060766 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 644/1299] 10.222.0.25 () {56 vars in 1116 bytes} [Tue Oct 4 03:20:15 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:20:16.067313 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b833c086-a71e-4f11-8c18-dccf8f765c61 None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:20:16.098387 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:20:16.163215 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b833c086-a71e-4f11-8c18-dccf8f765c61 None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:20:16.194916 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841f2ff9-792c-4e32-9c6a-48f9a0decf7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:20:16.195520 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f2ff9-792c-4e32-9c6a-48f9a0decf7e None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:20:16.196059 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f2ff9-792c-4e32-9c6a-48f9a0decf7e None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:20:16.196334 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f2ff9-792c-4e32-9c6a-48f9a0decf7e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:20:16.197016 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841f2ff9-792c-4e32-9c6a-48f9a0decf7e None admin] RBAC: Adding query filter params (interface=public, service_id=8f755f805c8d4ecfab2da8f0d5a2c950, region_id=RegionOne) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:20:16.197320 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841f2ff9-792c-4e32-9c6a-48f9a0decf7e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:20:16.198644 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841f2ff9-792c-4e32-9c6a-48f9a0decf7e None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:20:16.203372 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 656/1300] 10.222.0.25 () {56 vars in 1251 bytes} [Tue Oct 4 03:20:16 2022] GET /identity/v3/endpoints?service_id=8f755f805c8d4ecfab2da8f0d5a2c950&interface=public®ion_id=RegionOne => generated 194 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:20:16.209602 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3cc8fc-8d26-40ee-977a-256bbd2b6378 None admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:20:16.301989 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:20:16.323447 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3cc8fc-8d26-40ee-977a-256bbd2b6378 None admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:20:16.357192 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782cb9ad-2756-4b84-a86f-ca6b5fc24b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:20:16.357793 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782cb9ad-2756-4b84-a86f-ca6b5fc24b19 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:20:16.358075 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782cb9ad-2756-4b84-a86f-ca6b5fc24b19 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:20:16.358351 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782cb9ad-2756-4b84-a86f-ca6b5fc24b19 None admin] PATH_INFO: `/v3/services` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:20:16.358951 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782cb9ad-2756-4b84-a86f-ca6b5fc24b19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:20:16.360331 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782cb9ad-2756-4b84-a86f-ca6b5fc24b19 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:20:16.367467 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 645/1301] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Oct 4 03:20:16 2022] GET /identity/v3/services => generated 2191 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:20:18.475364 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702be01d-6471-433a-897a-3dbdf7b237f8 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:20:18.475963 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702be01d-6471-433a-897a-3dbdf7b237f8 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:20:18.476059 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702be01d-6471-433a-897a-3dbdf7b237f8 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:20:18.477377 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 657/1302] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:20:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:20:18.482569 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c864fb50-7a62-4bd1-993f-8cef8d48fd05 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:20:18.482983 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c864fb50-7a62-4bd1-993f-8cef8d48fd05 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:20:18.483125 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c864fb50-7a62-4bd1-993f-8cef8d48fd05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:20:18.501745 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-c864fb50-7a62-4bd1-993f-8cef8d48fd05 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:20:18.503198 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-c864fb50-7a62-4bd1-993f-8cef8d48fd05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:20:18.568316 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 646/1303] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:20:18 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 03:20:18.833986 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702be01d-6471-433a-897a-3dbdf7b237f8 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:20:18.928278 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:20:18.935199 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702be01d-6471-433a-897a-3dbdf7b237f8 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:20:18.968466 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e27998-0a45-48cf-b1f3-8f6e09cd540a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:20:18.969084 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e27998-0a45-48cf-b1f3-8f6e09cd540a None admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:20:18.969362 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e27998-0a45-48cf-b1f3-8f6e09cd540a None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:20:18.969639 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e27998-0a45-48cf-b1f3-8f6e09cd540a None admin] PATH_INFO: `/v3/services/placement` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:20:18.970213 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e27998-0a45-48cf-b1f3-8f6e09cd540a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:20:18.972094 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e27998-0a45-48cf-b1f3-8f6e09cd540a None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:20:18.980603 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application [None req-85e27998-0a45-48cf-b1f3-8f6e09cd540a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 03:20:18.980603 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:20:18.980603 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 03:20:18.980603 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 03:20:18.980603 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 03:20:18.980603 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 03:20:18.980603 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 03:20:18.980603 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 03:20:18.980603 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 03:20:18.980603 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:20:18.980603 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 03:20:18.980603 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:20:18.980603 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 03:20:18.980603 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 03:20:18.980603 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 03:20:18.980603 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 03:20:18.980603 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 03:20:18.981780 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 03:20:18.981780 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 03:20:18.981780 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 03:20:18.981780 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 03:20:18.981780 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 03:20:18.981780 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 03:20:18.981780 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 03:20:18.981780 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 03:20:18.981780 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 03:20:18.981780 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 03:20:18.981780 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 03:20:18.981780 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 03:20:18.981780 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 03:20:18.981780 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 03:20:18.981780 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 03:20:18.981780 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 03:20:18.982825 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 03:20:18.982825 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application with Lock( Oct 04 03:20:18.982825 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 03:20:18.982825 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self._enter() Oct 04 03:20:18.982825 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 03:20:18.982825 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 03:20:18.982825 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 03:20:18.982825 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application return self.creator() Oct 04 03:20:18.982825 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 03:20:18.982825 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application created_value = creator( Oct 04 03:20:18.982825 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 03:20:18.982825 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 03:20:18.982825 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 03:20:18.982825 dv-cinder-849143-9-smb devstack@keystone.service[81379]: ERROR keystone.server.flask.application Oct 04 03:20:18.982825 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 658/1304] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Oct 4 03:20:18 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 03:20:18.988349 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c864fb50-7a62-4bd1-993f-8cef8d48fd05 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:20:19.061993 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:20:19.084397 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c864fb50-7a62-4bd1-993f-8cef8d48fd05 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:20:19.117624 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c087c60-b707-42b2-8cc9-ff058dcced92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:20:19.118211 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c087c60-b707-42b2-8cc9-ff058dcced92 None admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:20:19.118497 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c087c60-b707-42b2-8cc9-ff058dcced92 None admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:20:19.118767 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c087c60-b707-42b2-8cc9-ff058dcced92 None admin] PATH_INFO: `/v3/services` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:20:19.119381 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c087c60-b707-42b2-8cc9-ff058dcced92 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:20:19.119715 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c087c60-b707-42b2-8cc9-ff058dcced92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:20:19.121058 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c087c60-b707-42b2-8cc9-ff058dcced92 None admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:20:19.126004 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 647/1305] 10.222.0.25 () {56 vars in 1116 bytes} [Tue Oct 4 03:20:18 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:20:19.131945 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e27998-0a45-48cf-b1f3-8f6e09cd540a None admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:20:19.227689 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e27998-0a45-48cf-b1f3-8f6e09cd540a None admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:20:19.259867 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102e6fe4-b82e-48ae-b354-d773cbc6d785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:20:19.260445 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e6fe4-b82e-48ae-b354-d773cbc6d785 None admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:20:19.260725 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e6fe4-b82e-48ae-b354-d773cbc6d785 None admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:20:19.260996 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e6fe4-b82e-48ae-b354-d773cbc6d785 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:20:19.261642 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102e6fe4-b82e-48ae-b354-d773cbc6d785 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:20:19.262980 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102e6fe4-b82e-48ae-b354-d773cbc6d785 None admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:20:19.281269 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 659/1306] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:20:19 2022] POST /identity/v3/endpoints => generated 331 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:20:29.123020 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=30 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:20:29.277585 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:21:23.415547 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80b482-69ae-4055-95d6-8c829f08495d None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:21:23.416000 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80b482-69ae-4055-95d6-8c829f08495d None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:21:23.416000 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80b482-69ae-4055-95d6-8c829f08495d None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:21:23.417317 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 648/1307] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:21:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:21:23.423622 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d64fc8-eace-410a-a36f-eccc2b0008de None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:21:23.424652 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d64fc8-eace-410a-a36f-eccc2b0008de None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:21:23.425141 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d64fc8-eace-410a-a36f-eccc2b0008de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:21:23.545150 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-45d64fc8-eace-410a-a36f-eccc2b0008de None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:21:23.547876 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-45d64fc8-eace-410a-a36f-eccc2b0008de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:21:23.667089 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 660/1308] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:21:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:21:23.967849 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a8f7cd-e36f-483f-b79a-436351a8f676 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:21:23.968137 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a8f7cd-e36f-483f-b79a-436351a8f676 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:21:23.968809 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a8f7cd-e36f-483f-b79a-436351a8f676 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:21:23.970765 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 649/1309] 10.222.0.25 () {54 vars in 964 bytes} [Tue Oct 4 03:21:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:21:23.976706 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b91494-075c-4ab4-9db3-ddb2e1782620 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:21:23.977004 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b91494-075c-4ab4-9db3-ddb2e1782620 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:21:23.977293 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b91494-075c-4ab4-9db3-ddb2e1782620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:21:24.066347 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-14b91494-075c-4ab4-9db3-ddb2e1782620 None None] MFA Rules not processed for user `5e43cc9523d949a1bfa3dec882f2824f`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:21:24.067593 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-14b91494-075c-4ab4-9db3-ddb2e1782620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:21:24.090233 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:21:24.151214 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 661/1310] 10.222.0.25 () {58 vars in 1061 bytes} [Tue Oct 4 03:21:23 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 03:21:24.160807 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a8f7cd-e36f-483f-b79a-436351a8f676 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:21:24.162524 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-f7a8f7cd-e36f-483f-b79a-436351a8f676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:21:24.274922 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a8f7cd-e36f-483f-b79a-436351a8f676 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:21:24.359321 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c58502-da57-4f5d-8272-8825286d7ed9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:21:24.361513 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c58502-da57-4f5d-8272-8825286d7ed9 service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:21:24.361513 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c58502-da57-4f5d-8272-8825286d7ed9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:21:24.361853 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c58502-da57-4f5d-8272-8825286d7ed9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:21:24.363805 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-e5c58502-da57-4f5d-8272-8825286d7ed9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:21:24.427332 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:21:24.492156 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c58502-da57-4f5d-8272-8825286d7ed9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:21:24.494153 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c58502-da57-4f5d-8272-8825286d7ed9 service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:21:24.515545 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 650/1311] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:21:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 03:21:27.054653 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e842ec-9b18-4b6e-862f-dee743a617c2 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:21:27.055206 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e842ec-9b18-4b6e-862f-dee743a617c2 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:21:27.055206 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e842ec-9b18-4b6e-862f-dee743a617c2 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:21:27.056565 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 662/1312] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:21:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:21:27.061747 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce448d1f-0aa9-44ac-b3e6-f51bcab01b85 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:21:27.062115 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce448d1f-0aa9-44ac-b3e6-f51bcab01b85 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:21:27.062294 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce448d1f-0aa9-44ac-b3e6-f51bcab01b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:21:27.133152 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-ce448d1f-0aa9-44ac-b3e6-f51bcab01b85 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:21:27.134343 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-ce448d1f-0aa9-44ac-b3e6-f51bcab01b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:21:27.228258 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 651/1313] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:21:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:21:27.510654 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e842ec-9b18-4b6e-862f-dee743a617c2 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:21:27.512256 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-a3e842ec-9b18-4b6e-862f-dee743a617c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:21:27.616420 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e842ec-9b18-4b6e-862f-dee743a617c2 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:21:27.688373 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:21:27.690723 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5c553f-36e6-4d05-be2a-0d019f490259 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:21:27.691579 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c553f-36e6-4d05-be2a-0d019f490259 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:21:27.691938 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c553f-36e6-4d05-be2a-0d019f490259 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:21:27.692371 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c553f-36e6-4d05-be2a-0d019f490259 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:21:27.694270 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-0d5c553f-36e6-4d05-be2a-0d019f490259 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:21:27.802007 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5c553f-36e6-4d05-be2a-0d019f490259 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:21:27.803356 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5c553f-36e6-4d05-be2a-0d019f490259 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:21:27.820952 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 663/1314] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:21:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:21:30.274303 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6126630a-d32a-4911-bb55-fbddaab47a74 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:21:30.274839 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6126630a-d32a-4911-bb55-fbddaab47a74 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:21:30.274839 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6126630a-d32a-4911-bb55-fbddaab47a74 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:21:30.276268 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 652/1315] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:21:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:21:30.281484 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec63cd6-3b3a-49c7-bfd4-7797bc30455a None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:21:30.282056 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec63cd6-3b3a-49c7-bfd4-7797bc30455a None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:21:30.282158 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec63cd6-3b3a-49c7-bfd4-7797bc30455a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:21:30.348238 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-4ec63cd6-3b3a-49c7-bfd4-7797bc30455a None None] MFA Rules not processed for user `b72c77a1143648e58bef98b7bb2677d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:21:30.349444 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-4ec63cd6-3b3a-49c7-bfd4-7797bc30455a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:21:30.400962 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:21:30.444785 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 664/1316] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:21:30 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:21:30.755779 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda1c4c-52e6-41c8-95fd-590933913112 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:21:30.756064 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda1c4c-52e6-41c8-95fd-590933913112 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:21:30.757394 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda1c4c-52e6-41c8-95fd-590933913112 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:21:30.757739 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 653/1317] 10.222.0.25 () {54 vars in 964 bytes} [Tue Oct 4 03:21:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:21:30.763613 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fbc7ed-ee69-435a-9d27-a3afd7e1c5f3 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:21:30.763963 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fbc7ed-ee69-435a-9d27-a3afd7e1c5f3 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:21:30.764183 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fbc7ed-ee69-435a-9d27-a3afd7e1c5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:21:30.842453 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-45fbc7ed-ee69-435a-9d27-a3afd7e1c5f3 None None] MFA Rules not processed for user `5e43cc9523d949a1bfa3dec882f2824f`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:21:30.843715 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-45fbc7ed-ee69-435a-9d27-a3afd7e1c5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:21:30.926028 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 665/1318] 10.222.0.25 () {58 vars in 1061 bytes} [Tue Oct 4 03:21:30 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:21:30.934884 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cda1c4c-52e6-41c8-95fd-590933913112 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:21:30.936436 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-8cda1c4c-52e6-41c8-95fd-590933913112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:21:30.946932 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:21:31.039051 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cda1c4c-52e6-41c8-95fd-590933913112 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:21:31.112394 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb6ccf0-a06a-4405-b974-0cd87e56c63d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:21:31.113004 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6ccf0-a06a-4405-b974-0cd87e56c63d service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:21:31.113279 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6ccf0-a06a-4405-b974-0cd87e56c63d service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:21:31.113548 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6ccf0-a06a-4405-b974-0cd87e56c63d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:21:31.115170 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-dbb6ccf0-a06a-4405-b974-0cd87e56c63d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:21:31.176627 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:21:31.228918 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb6ccf0-a06a-4405-b974-0cd87e56c63d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:21:31.230346 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb6ccf0-a06a-4405-b974-0cd87e56c63d service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:21:31.249482 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 654/1319] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:21:30 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:21:34.304134 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07bf63-a91e-416d-972b-31c0b536a5fd None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:21:34.304707 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07bf63-a91e-416d-972b-31c0b536a5fd None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:21:34.304707 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07bf63-a91e-416d-972b-31c0b536a5fd None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:21:34.306001 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 666/1320] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:21:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:21:34.311195 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d6eee-d37b-42e6-bbc1-cce37d264c2c None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:21:34.311655 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d6eee-d37b-42e6-bbc1-cce37d264c2c None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:21:34.311793 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d6eee-d37b-42e6-bbc1-cce37d264c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:21:34.378189 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-907d6eee-d37b-42e6-bbc1-cce37d264c2c None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:21:34.379386 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-907d6eee-d37b-42e6-bbc1-cce37d264c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:21:34.474490 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 655/1321] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:21:34 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:21:34.765358 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec07bf63-a91e-416d-972b-31c0b536a5fd None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:21:34.768406 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-ec07bf63-a91e-416d-972b-31c0b536a5fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:21:34.822373 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:21:34.877072 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec07bf63-a91e-416d-972b-31c0b536a5fd None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:21:34.949375 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111d5a3-6669-400b-8c7c-848fd3ee3c60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:21:34.949915 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111d5a3-6669-400b-8c7c-848fd3ee3c60 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:21:34.950199 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111d5a3-6669-400b-8c7c-848fd3ee3c60 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:21:34.950473 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111d5a3-6669-400b-8c7c-848fd3ee3c60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:21:34.952101 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-8111d5a3-6669-400b-8c7c-848fd3ee3c60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:21:35.047172 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:21:35.060757 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8111d5a3-6669-400b-8c7c-848fd3ee3c60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:21:35.062177 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8111d5a3-6669-400b-8c7c-848fd3ee3c60 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:21:35.080946 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 667/1322] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:21:34 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:21:37.992880 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd21fca-be79-4799-b630-353fbd05b128 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:21:37.993434 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd21fca-be79-4799-b630-353fbd05b128 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:21:37.993434 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd21fca-be79-4799-b630-353fbd05b128 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:21:37.994804 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 656/1323] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:21:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:21:38.001430 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f98036-2ad1-438f-83db-0c1bc4c0bcbd None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:21:38.001974 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f98036-2ad1-438f-83db-0c1bc4c0bcbd None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:21:38.001974 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f98036-2ad1-438f-83db-0c1bc4c0bcbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:21:38.074147 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-04f98036-2ad1-438f-83db-0c1bc4c0bcbd None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:21:38.075400 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-04f98036-2ad1-438f-83db-0c1bc4c0bcbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:21:38.184675 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 668/1324] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:21:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:21:38.482016 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd21fca-be79-4799-b630-353fbd05b128 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:21:38.483615 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-3fd21fca-be79-4799-b630-353fbd05b128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:21:38.503685 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:21:38.591276 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd21fca-be79-4799-b630-353fbd05b128 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:21:38.668758 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accd0f46-7307-49c8-9859-7e2939ee1b26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:21:38.669351 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd0f46-7307-49c8-9859-7e2939ee1b26 service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:21:38.669628 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd0f46-7307-49c8-9859-7e2939ee1b26 service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:21:38.669893 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd0f46-7307-49c8-9859-7e2939ee1b26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:21:38.671454 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-accd0f46-7307-49c8-9859-7e2939ee1b26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:21:38.742871 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:21:38.780125 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accd0f46-7307-49c8-9859-7e2939ee1b26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:21:38.782085 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accd0f46-7307-49c8-9859-7e2939ee1b26 service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:21:38.800146 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 657/1325] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:21:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:21:41.056432 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb9f00-69c9-4098-ba06-ab030b669391 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:21:41.056432 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb9f00-69c9-4098-ba06-ab030b669391 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:21:41.056432 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb9f00-69c9-4098-ba06-ab030b669391 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:21:41.056432 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 669/1326] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:21:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:21:41.058796 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1c9a2-b826-4bc2-9ba2-f7ec9f6db16e None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:21:41.059214 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1c9a2-b826-4bc2-9ba2-f7ec9f6db16e None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:21:41.059348 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1c9a2-b826-4bc2-9ba2-f7ec9f6db16e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:21:41.128423 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-53c1c9a2-b826-4bc2-9ba2-f7ec9f6db16e None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:21:41.129642 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-53c1c9a2-b826-4bc2-9ba2-f7ec9f6db16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:21:41.227388 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 658/1327] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:21:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:21:41.510035 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bb9f00-69c9-4098-ba06-ab030b669391 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:21:41.511606 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-02bb9f00-69c9-4098-ba06-ab030b669391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:21:41.573855 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:21:41.617904 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bb9f00-69c9-4098-ba06-ab030b669391 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:21:41.698322 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f3db06-91df-4ddc-993c-c97a81c7ff7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:21:41.698922 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f3db06-91df-4ddc-993c-c97a81c7ff7b service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:21:41.699199 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f3db06-91df-4ddc-993c-c97a81c7ff7b service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:21:41.699465 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f3db06-91df-4ddc-993c-c97a81c7ff7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:21:41.701091 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-14f3db06-91df-4ddc-993c-c97a81c7ff7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:21:41.808737 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:21:41.811150 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f3db06-91df-4ddc-993c-c97a81c7ff7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:21:41.813355 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f3db06-91df-4ddc-993c-c97a81c7ff7b service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:21:41.832780 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 670/1328] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:21:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:21:44.039775 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135796ce-8a94-4446-9946-9e9ba5fde2e6 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:21:44.040286 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135796ce-8a94-4446-9946-9e9ba5fde2e6 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:21:44.040286 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135796ce-8a94-4446-9946-9e9ba5fde2e6 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:21:44.041579 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 659/1329] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:21:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:21:44.047344 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f72630-5073-41ae-ae74-9516da70822f None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:21:44.047741 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f72630-5073-41ae-ae74-9516da70822f None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:21:44.047948 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f72630-5073-41ae-ae74-9516da70822f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:21:44.113814 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-61f72630-5073-41ae-ae74-9516da70822f None None] MFA Rules not processed for user `b72c77a1143648e58bef98b7bb2677d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:21:44.115034 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-61f72630-5073-41ae-ae74-9516da70822f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:21:44.211016 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 671/1330] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:21:44 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:21:44.496024 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135796ce-8a94-4446-9946-9e9ba5fde2e6 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:21:44.497580 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-135796ce-8a94-4446-9946-9e9ba5fde2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:21:44.529030 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:21:44.604586 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135796ce-8a94-4446-9946-9e9ba5fde2e6 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:21:44.683006 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab433239-25a1-4aa9-956d-187a8e3957ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:21:44.683643 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab433239-25a1-4aa9-956d-187a8e3957ba service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:21:44.683927 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab433239-25a1-4aa9-956d-187a8e3957ba service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:21:44.684202 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab433239-25a1-4aa9-956d-187a8e3957ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:21:44.685806 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-ab433239-25a1-4aa9-956d-187a8e3957ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:21:44.762657 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:21:44.794404 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab433239-25a1-4aa9-956d-187a8e3957ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:21:44.795873 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab433239-25a1-4aa9-956d-187a8e3957ba service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:21:44.814996 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 660/1331] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:21:44 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:21:47.263279 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a3028c-cd31-4491-a80b-e5757738ca0c None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:21:47.263905 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a3028c-cd31-4491-a80b-e5757738ca0c None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:21:47.264002 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a3028c-cd31-4491-a80b-e5757738ca0c None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:21:47.266125 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 672/1332] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:21:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:21:47.271558 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dacbfe2-2870-465c-8c6c-598baa65b37b None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:21:47.271944 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dacbfe2-2870-465c-8c6c-598baa65b37b None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:21:47.272112 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dacbfe2-2870-465c-8c6c-598baa65b37b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:21:47.343343 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-9dacbfe2-2870-465c-8c6c-598baa65b37b None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:21:47.345180 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-9dacbfe2-2870-465c-8c6c-598baa65b37b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:21:47.447363 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 661/1333] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:21:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:21:47.742452 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a3028c-cd31-4491-a80b-e5757738ca0c None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:21:47.744043 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-e1a3028c-cd31-4491-a80b-e5757738ca0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:21:47.813388 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:21:47.848141 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a3028c-cd31-4491-a80b-e5757738ca0c None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:21:47.920582 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9638733-60f9-4812-99e1-585891df13a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:21:47.921200 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9638733-60f9-4812-99e1-585891df13a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:21:47.922020 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9638733-60f9-4812-99e1-585891df13a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:21:47.922715 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9638733-60f9-4812-99e1-585891df13a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:21:47.924333 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-e9638733-60f9-4812-99e1-585891df13a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:21:48.033521 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9638733-60f9-4812-99e1-585891df13a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:21:48.034973 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9638733-60f9-4812-99e1-585891df13a5 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:21:48.044908 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:21:48.053712 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 673/1334] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:21:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:21:50.243576 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3922cf7-d688-48b2-bd5b-eb211d088099 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:21:50.244092 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3922cf7-d688-48b2-bd5b-eb211d088099 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:21:50.244218 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3922cf7-d688-48b2-bd5b-eb211d088099 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:21:50.245462 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 662/1335] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:21:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:21:50.251473 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa68b156-f1c5-4812-9745-47a287f7f461 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:21:50.251894 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa68b156-f1c5-4812-9745-47a287f7f461 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:21:50.252051 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa68b156-f1c5-4812-9745-47a287f7f461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:21:50.317957 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-fa68b156-f1c5-4812-9745-47a287f7f461 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:21:50.319172 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-fa68b156-f1c5-4812-9745-47a287f7f461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:21:50.413272 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 674/1336] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:21:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:21:50.698721 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3922cf7-d688-48b2-bd5b-eb211d088099 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:21:50.700335 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-d3922cf7-d688-48b2-bd5b-eb211d088099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:21:50.741417 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:21:50.803565 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3922cf7-d688-48b2-bd5b-eb211d088099 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:21:50.877022 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d94b0a0-b49e-44e6-8904-97d397716c59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:21:50.877620 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94b0a0-b49e-44e6-8904-97d397716c59 service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:21:50.877898 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94b0a0-b49e-44e6-8904-97d397716c59 service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:21:50.878168 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94b0a0-b49e-44e6-8904-97d397716c59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:21:50.879788 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-1d94b0a0-b49e-44e6-8904-97d397716c59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:21:50.964738 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:21:50.991737 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d94b0a0-b49e-44e6-8904-97d397716c59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:21:50.993159 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d94b0a0-b49e-44e6-8904-97d397716c59 service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:21:51.010940 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 663/1337] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:21:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:21:53.483953 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f5fd4-fa37-4dc3-ba50-aac4710243f3 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:21:53.484493 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f5fd4-fa37-4dc3-ba50-aac4710243f3 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:21:53.484713 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f5fd4-fa37-4dc3-ba50-aac4710243f3 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:21:53.486069 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 675/1338] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:21:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:21:53.491301 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4d12f-6801-4c5b-8fa2-bcb73544351b None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:21:53.491768 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4d12f-6801-4c5b-8fa2-bcb73544351b None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:21:53.491963 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4d12f-6801-4c5b-8fa2-bcb73544351b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:21:53.557118 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-57e4d12f-6801-4c5b-8fa2-bcb73544351b None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:21:53.558333 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-57e4d12f-6801-4c5b-8fa2-bcb73544351b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:21:53.660230 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 664/1339] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:21:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:21:53.946405 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1f5fd4-fa37-4dc3-ba50-aac4710243f3 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:21:53.948246 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-bd1f5fd4-fa37-4dc3-ba50-aac4710243f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:21:54.023468 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:21:54.053048 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1f5fd4-fa37-4dc3-ba50-aac4710243f3 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:21:54.136985 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e983f48-3f41-4afc-88e6-2602b6b857b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:21:54.137614 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e983f48-3f41-4afc-88e6-2602b6b857b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:21:54.137895 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e983f48-3f41-4afc-88e6-2602b6b857b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:21:54.138167 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e983f48-3f41-4afc-88e6-2602b6b857b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:21:54.139777 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-4e983f48-3f41-4afc-88e6-2602b6b857b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:21:54.255075 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e983f48-3f41-4afc-88e6-2602b6b857b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:21:54.256538 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e983f48-3f41-4afc-88e6-2602b6b857b4 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:21:54.279340 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 676/1340] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:21:53 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:21:58.360388 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d05116-174b-445a-afdb-61f03614a43e None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:21:58.360910 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d05116-174b-445a-afdb-61f03614a43e None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:21:58.360910 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d05116-174b-445a-afdb-61f03614a43e None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:21:58.362245 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 665/1341] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:21:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:21:58.367738 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789a241d-4509-46fc-ae08-24502efae3d0 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:21:58.368500 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789a241d-4509-46fc-ae08-24502efae3d0 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:21:58.368786 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789a241d-4509-46fc-ae08-24502efae3d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:21:58.374246 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:21:58.442128 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-789a241d-4509-46fc-ae08-24502efae3d0 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:21:58.443359 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-789a241d-4509-46fc-ae08-24502efae3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:21:58.540736 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 677/1342] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:21:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:21:58.828995 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d05116-174b-445a-afdb-61f03614a43e None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:21:58.830535 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-c8d05116-174b-445a-afdb-61f03614a43e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:21:58.880292 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:21:58.935516 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d05116-174b-445a-afdb-61f03614a43e None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:21:59.009826 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e144b118-018b-4a33-8ebb-0922ce901293 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:21:59.010541 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e144b118-018b-4a33-8ebb-0922ce901293 service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:21:59.010826 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e144b118-018b-4a33-8ebb-0922ce901293 service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:21:59.011098 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e144b118-018b-4a33-8ebb-0922ce901293 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:21:59.012728 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-e144b118-018b-4a33-8ebb-0922ce901293 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:21:59.108133 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:21:59.125877 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e144b118-018b-4a33-8ebb-0922ce901293 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:21:59.127306 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e144b118-018b-4a33-8ebb-0922ce901293 service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:21:59.145023 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 666/1343] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:21:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:22:01.970741 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a76198-eec9-475c-b776-b52b5f80e097 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:22:01.971302 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a76198-eec9-475c-b776-b52b5f80e097 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:22:01.971302 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a76198-eec9-475c-b776-b52b5f80e097 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:22:01.972714 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 678/1344] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:22:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:22:01.977876 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46779df-440d-4f9a-9f95-4948a1f32795 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:22:01.978300 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46779df-440d-4f9a-9f95-4948a1f32795 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:22:01.978430 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46779df-440d-4f9a-9f95-4948a1f32795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:22:02.044675 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-c46779df-440d-4f9a-9f95-4948a1f32795 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:22:02.045890 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-c46779df-440d-4f9a-9f95-4948a1f32795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:22:02.148207 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 667/1345] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:22:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:22:02.447699 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a76198-eec9-475c-b776-b52b5f80e097 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:22:02.449248 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-f2a76198-eec9-475c-b776-b52b5f80e097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:22:02.538876 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:22:02.556694 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a76198-eec9-475c-b776-b52b5f80e097 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:22:02.634044 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77e7dd5-e9f0-4128-a11c-44ae71daae2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:22:02.635006 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e7dd5-e9f0-4128-a11c-44ae71daae2b service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:22:02.635291 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e7dd5-e9f0-4128-a11c-44ae71daae2b service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:22:02.635593 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e7dd5-e9f0-4128-a11c-44ae71daae2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:22:02.638707 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-a77e7dd5-e9f0-4128-a11c-44ae71daae2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:22:02.756255 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77e7dd5-e9f0-4128-a11c-44ae71daae2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:22:02.758448 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77e7dd5-e9f0-4128-a11c-44ae71daae2b service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:22:02.778690 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 679/1346] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:22:02 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:22:07.350110 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5423b5-f25f-48e7-9d17-8138481d24bc None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:22:07.350617 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5423b5-f25f-48e7-9d17-8138481d24bc None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:22:07.350729 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5423b5-f25f-48e7-9d17-8138481d24bc None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:22:07.352112 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 668/1347] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:22:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:22:07.357441 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60358e-dbc6-4667-8a0f-602f7e505669 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:22:07.357869 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60358e-dbc6-4667-8a0f-602f7e505669 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:22:07.357965 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60358e-dbc6-4667-8a0f-602f7e505669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:22:07.373708 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:22:07.428185 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-0b60358e-dbc6-4667-8a0f-602f7e505669 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:22:07.429409 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-0b60358e-dbc6-4667-8a0f-602f7e505669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:22:07.536325 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 680/1348] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:22:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 03:22:07.820244 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5423b5-f25f-48e7-9d17-8138481d24bc None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:22:07.822031 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-4c5423b5-f25f-48e7-9d17-8138481d24bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:22:07.881298 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:22:07.927875 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5423b5-f25f-48e7-9d17-8138481d24bc None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:22:08.013206 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6637ed-89e9-43f5-b721-f2ca6655ad40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:22:08.013802 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6637ed-89e9-43f5-b721-f2ca6655ad40 service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:22:08.014084 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6637ed-89e9-43f5-b721-f2ca6655ad40 service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:22:08.014358 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6637ed-89e9-43f5-b721-f2ca6655ad40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:22:08.016175 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-3f6637ed-89e9-43f5-b721-f2ca6655ad40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:22:08.169917 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:22:08.174070 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6637ed-89e9-43f5-b721-f2ca6655ad40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:22:08.175687 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6637ed-89e9-43f5-b721-f2ca6655ad40 service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:22:08.199155 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 669/1349] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:22:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:22:13.236126 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c687b2a-bf56-4ada-8f80-d174225e53bd None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:22:13.236925 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c687b2a-bf56-4ada-8f80-d174225e53bd None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:22:13.237370 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c687b2a-bf56-4ada-8f80-d174225e53bd None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:22:13.239776 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 681/1350] 10.222.0.25 () {54 vars in 921 bytes} [Tue Oct 4 03:22:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:22:13.246264 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0cb490-bccd-4afd-b807-c745fea015f0 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:22:13.246264 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0cb490-bccd-4afd-b807-c745fea015f0 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:22:13.246264 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0cb490-bccd-4afd-b807-c745fea015f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:22:13.396779 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-0f0cb490-bccd-4afd-b807-c745fea015f0 None None] MFA Rules not processed for user `94513f6cd19f495e842deb3c13c3e4d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:22:13.397979 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-0f0cb490-bccd-4afd-b807-c745fea015f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:22:13.524037 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 670/1351] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Oct 4 03:22:13 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:22:17.534733 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=59 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:22:17.569157 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0703a89-db91-4c0e-a78e-9e9e18e8d0e3 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:22:17.569535 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0703a89-db91-4c0e-a78e-9e9e18e8d0e3 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:22:17.569769 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0703a89-db91-4c0e-a78e-9e9e18e8d0e3 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:22:17.571219 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 682/1352] 10.222.0.25 () {54 vars in 921 bytes} [Tue Oct 4 03:22:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:22:17.576346 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a562f194-d3cf-4405-b1be-0a8f2a13cd30 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:22:17.576800 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a562f194-d3cf-4405-b1be-0a8f2a13cd30 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:22:17.576883 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a562f194-d3cf-4405-b1be-0a8f2a13cd30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:22:17.636125 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:22:17.661577 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-a562f194-d3cf-4405-b1be-0a8f2a13cd30 None None] MFA Rules not processed for user `94513f6cd19f495e842deb3c13c3e4d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:22:17.662771 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-a562f194-d3cf-4405-b1be-0a8f2a13cd30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:22:17.775292 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 671/1353] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Oct 4 03:22:17 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:22:19.235228 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac7e86-34f5-450a-aa59-dfe738a7d1de None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:22:19.235799 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac7e86-34f5-450a-aa59-dfe738a7d1de None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:22:19.235799 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac7e86-34f5-450a-aa59-dfe738a7d1de None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:22:19.237138 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 683/1354] 10.222.0.25 () {54 vars in 921 bytes} [Tue Oct 4 03:22:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:22:19.242309 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fe1b4f-277d-4365-abd5-f97d591a689c None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:22:19.243123 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fe1b4f-277d-4365-abd5-f97d591a689c None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:22:19.243460 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fe1b4f-277d-4365-abd5-f97d591a689c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:22:19.322097 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-36fe1b4f-277d-4365-abd5-f97d591a689c None None] MFA Rules not processed for user `94513f6cd19f495e842deb3c13c3e4d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:22:19.323198 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-36fe1b4f-277d-4365-abd5-f97d591a689c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:22:19.365970 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:22:19.433818 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 672/1355] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Oct 4 03:22:19 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:22:23.034021 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651cb89-5fa6-4ec0-b81e-d9b4e5c55bc7 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:22:23.034920 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651cb89-5fa6-4ec0-b81e-d9b4e5c55bc7 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:22:23.035196 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651cb89-5fa6-4ec0-b81e-d9b4e5c55bc7 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:22:23.036589 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 684/1356] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:22:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 03:22:23.042382 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5c105-2717-436f-81da-bbe1a4977789 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:22:23.042876 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5c105-2717-436f-81da-bbe1a4977789 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:22:23.042959 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5c105-2717-436f-81da-bbe1a4977789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:22:23.119569 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-51c5c105-2717-436f-81da-bbe1a4977789 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:22:23.120746 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-51c5c105-2717-436f-81da-bbe1a4977789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:22:23.221270 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 673/1357] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:22:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:22:23.525195 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e253f76b-8470-43ad-89bb-ebc52efd4c6a None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:22:23.526370 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e253f76b-8470-43ad-89bb-ebc52efd4c6a None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:22:23.527152 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e253f76b-8470-43ad-89bb-ebc52efd4c6a None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:22:23.531465 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 685/1358] 10.222.0.25 () {54 vars in 961 bytes} [Tue Oct 4 03:22:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:22:23.537928 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026267e3-9c36-427c-b637-662385c531f0 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:22:23.538154 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026267e3-9c36-427c-b637-662385c531f0 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:22:23.538424 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026267e3-9c36-427c-b637-662385c531f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:22:23.556058 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:22:23.620221 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-026267e3-9c36-427c-b637-662385c531f0 None None] MFA Rules not processed for user `2c1f412befb9418fa66a2aabf475aa90`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:22:23.621390 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-026267e3-9c36-427c-b637-662385c531f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:22:23.767416 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 674/1359] 10.222.0.25 () {58 vars in 1058 bytes} [Tue Oct 4 03:22:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:22:23.775449 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e253f76b-8470-43ad-89bb-ebc52efd4c6a None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:22:23.777054 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-e253f76b-8470-43ad-89bb-ebc52efd4c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:22:23.931498 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e253f76b-8470-43ad-89bb-ebc52efd4c6a None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:22:24.009491 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:22:24.053815 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d1ded8-2569-424e-87e3-f329b247aa29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1f412befb9418fa66a2aabf475aa90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:22:24.054415 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1ded8-2569-424e-87e3-f329b247aa29 service nova] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:22:24.054658 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1ded8-2569-424e-87e3-f329b247aa29 service nova] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:22:24.054872 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1ded8-2569-424e-87e3-f329b247aa29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:22:24.056462 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-99d1ded8-2569-424e-87e3-f329b247aa29 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:22:24.157416 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d1ded8-2569-424e-87e3-f329b247aa29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:22:24.159159 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d1ded8-2569-424e-87e3-f329b247aa29 service nova] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:22:24.178799 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 686/1360] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:22:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:22:26.583924 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db0861-67ca-42e8-86e3-34c97256e2ff None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:22:26.584477 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db0861-67ca-42e8-86e3-34c97256e2ff None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:22:26.584477 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db0861-67ca-42e8-86e3-34c97256e2ff None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:22:26.585813 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 675/1361] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:22:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:22:26.591140 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6d787-1fba-4f6c-9aac-b641417fca9c None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:22:26.591640 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6d787-1fba-4f6c-9aac-b641417fca9c None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:22:26.592017 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6d787-1fba-4f6c-9aac-b641417fca9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:22:26.703467 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-e4c6d787-1fba-4f6c-9aac-b641417fca9c None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:22:26.704712 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-e4c6d787-1fba-4f6c-9aac-b641417fca9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:22:26.746179 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:22:26.814425 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 687/1362] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:22:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:22:27.105381 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58db0861-67ca-42e8-86e3-34c97256e2ff None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:22:27.106980 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-58db0861-67ca-42e8-86e3-34c97256e2ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:22:27.181791 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:22:27.293990 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58db0861-67ca-42e8-86e3-34c97256e2ff None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:22:27.433138 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b79411d-2e8f-425e-942e-97fcd4a9ea4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1f412befb9418fa66a2aabf475aa90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:22:27.433742 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b79411d-2e8f-425e-942e-97fcd4a9ea4d service nova] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:22:27.434016 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b79411d-2e8f-425e-942e-97fcd4a9ea4d service nova] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:22:27.434288 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b79411d-2e8f-425e-942e-97fcd4a9ea4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:22:27.435914 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-6b79411d-2e8f-425e-942e-97fcd4a9ea4d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:22:27.458944 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:22:27.529771 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b79411d-2e8f-425e-942e-97fcd4a9ea4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:22:27.531633 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b79411d-2e8f-425e-942e-97fcd4a9ea4d service nova] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:22:27.550035 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 676/1363] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:22:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:22:30.061872 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df834cc-230d-4fb1-be85-ed0d2a5b25da None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:22:30.062467 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df834cc-230d-4fb1-be85-ed0d2a5b25da None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:22:30.062467 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df834cc-230d-4fb1-be85-ed0d2a5b25da None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:22:30.063934 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 688/1364] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:22:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:22:30.069085 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d4fc87-4044-4efd-8e3a-41fe05d7c58e None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:22:30.069495 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d4fc87-4044-4efd-8e3a-41fe05d7c58e None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:22:30.069679 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d4fc87-4044-4efd-8e3a-41fe05d7c58e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:22:30.139154 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-71d4fc87-4044-4efd-8e3a-41fe05d7c58e None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:22:30.140918 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-71d4fc87-4044-4efd-8e3a-41fe05d7c58e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:22:30.243612 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:22:30.251808 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 677/1365] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:22:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:22:30.541181 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b37d33-c302-4290-99b5-99c05582f0a0 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:22:30.541673 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b37d33-c302-4290-99b5-99c05582f0a0 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:22:30.542054 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b37d33-c302-4290-99b5-99c05582f0a0 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:22:30.543758 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 689/1366] 10.222.0.25 () {54 vars in 961 bytes} [Tue Oct 4 03:22:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:22:30.549553 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1752461-aa64-4511-9c01-e995aec58e9b None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:22:30.549947 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1752461-aa64-4511-9c01-e995aec58e9b None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:22:30.550326 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1752461-aa64-4511-9c01-e995aec58e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:22:30.633134 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-e1752461-aa64-4511-9c01-e995aec58e9b None None] MFA Rules not processed for user `2c1f412befb9418fa66a2aabf475aa90`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:22:30.634751 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-e1752461-aa64-4511-9c01-e995aec58e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:22:30.766153 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 678/1367] 10.222.0.25 () {58 vars in 1058 bytes} [Tue Oct 4 03:22:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:22:30.774591 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b37d33-c302-4290-99b5-99c05582f0a0 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:22:30.776131 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-95b37d33-c302-4290-99b5-99c05582f0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:22:30.936704 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b37d33-c302-4290-99b5-99c05582f0a0 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:22:30.958795 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:22:31.058298 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8365cc3c-6374-4a58-9d0a-ad3fa36cc9bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1f412befb9418fa66a2aabf475aa90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:22:31.058901 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8365cc3c-6374-4a58-9d0a-ad3fa36cc9bb service nova] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:22:31.059175 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8365cc3c-6374-4a58-9d0a-ad3fa36cc9bb service nova] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:22:31.059442 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8365cc3c-6374-4a58-9d0a-ad3fa36cc9bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:22:31.061053 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-8365cc3c-6374-4a58-9d0a-ad3fa36cc9bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:22:31.158013 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8365cc3c-6374-4a58-9d0a-ad3fa36cc9bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:22:31.159598 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8365cc3c-6374-4a58-9d0a-ad3fa36cc9bb service nova] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:22:31.181318 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 690/1368] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:22:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:22:31.272986 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a2cb2-a34f-42f7-b666-ffd993f5df2d None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:22:31.273545 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a2cb2-a34f-42f7-b666-ffd993f5df2d None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:22:31.273545 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a2cb2-a34f-42f7-b666-ffd993f5df2d None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:22:31.275047 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 679/1369] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:22:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:22:31.281344 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c6714e-18eb-49e7-9807-b0e4bf5196bf None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:22:31.282021 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c6714e-18eb-49e7-9807-b0e4bf5196bf None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:22:31.282446 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c6714e-18eb-49e7-9807-b0e4bf5196bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:22:31.326452 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:22:31.372037 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-c9c6714e-18eb-49e7-9807-b0e4bf5196bf None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:22:31.373390 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-c9c6714e-18eb-49e7-9807-b0e4bf5196bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:22:31.491535 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 691/1370] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:22:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:22:31.832149 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b01cd-3c43-491b-886f-410e2337dfb3 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:22:31.832149 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b01cd-3c43-491b-886f-410e2337dfb3 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:22:31.832149 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b01cd-3c43-491b-886f-410e2337dfb3 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:22:31.833503 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 680/1371] 10.222.0.25 () {54 vars in 963 bytes} [Tue Oct 4 03:22:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:22:31.837756 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb165975-305b-4ff7-b4f1-b218fd2211e8 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:22:31.838050 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb165975-305b-4ff7-b4f1-b218fd2211e8 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:22:31.838330 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb165975-305b-4ff7-b4f1-b218fd2211e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:22:31.920062 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-fb165975-305b-4ff7-b4f1-b218fd2211e8 None None] MFA Rules not processed for user `f537aabf3d1040ff840b02616f839975`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:22:31.921891 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-fb165975-305b-4ff7-b4f1-b218fd2211e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:22:31.972370 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:22:32.004288 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 692/1372] 10.222.0.25 () {58 vars in 1060 bytes} [Tue Oct 4 03:22:31 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:22:32.011691 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661b01cd-3c43-491b-886f-410e2337dfb3 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:22:32.013494 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-661b01cd-3c43-491b-886f-410e2337dfb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:22:32.075351 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:22:32.143066 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661b01cd-3c43-491b-886f-410e2337dfb3 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:22:32.241249 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734f869a-e765-49c5-bc07-418cc9ecc58a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f537aabf3d1040ff840b02616f839975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:22:32.242469 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734f869a-e765-49c5-bc07-418cc9ecc58a service cinder] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:22:32.243137 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734f869a-e765-49c5-bc07-418cc9ecc58a service cinder] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:22:32.243468 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734f869a-e765-49c5-bc07-418cc9ecc58a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:22:32.245133 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-734f869a-e765-49c5-bc07-418cc9ecc58a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:22:32.362133 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:22:32.376403 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734f869a-e765-49c5-bc07-418cc9ecc58a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:22:32.377753 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734f869a-e765-49c5-bc07-418cc9ecc58a service cinder] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:22:32.398987 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 681/1373] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:22:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 03:22:33.422822 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac5868f-a63b-45e1-ab52-28065b51630d None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:22:33.423351 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac5868f-a63b-45e1-ab52-28065b51630d None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:22:33.423351 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac5868f-a63b-45e1-ab52-28065b51630d None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:22:33.424641 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 693/1374] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:22:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 03:22:33.430015 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fee0bf-1969-4254-b2d5-fe3d38c12221 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:22:33.430421 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fee0bf-1969-4254-b2d5-fe3d38c12221 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:22:33.430592 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fee0bf-1969-4254-b2d5-fe3d38c12221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:22:33.496822 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-20fee0bf-1969-4254-b2d5-fe3d38c12221 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:22:33.498021 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-20fee0bf-1969-4254-b2d5-fe3d38c12221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:22:33.597504 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 682/1375] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:22:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:22:33.890639 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac5868f-a63b-45e1-ab52-28065b51630d None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:22:33.892239 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-7ac5868f-a63b-45e1-ab52-28065b51630d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:22:34.058314 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac5868f-a63b-45e1-ab52-28065b51630d None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:22:34.113178 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:22:34.179234 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707b550c-1485-49cd-8763-07598245f4d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1f412befb9418fa66a2aabf475aa90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:22:34.179869 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b550c-1485-49cd-8763-07598245f4d6 service nova] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:22:34.180144 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b550c-1485-49cd-8763-07598245f4d6 service nova] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:22:34.180417 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b550c-1485-49cd-8763-07598245f4d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:22:34.182013 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-707b550c-1485-49cd-8763-07598245f4d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:22:34.279340 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707b550c-1485-49cd-8763-07598245f4d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:22:34.279340 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707b550c-1485-49cd-8763-07598245f4d6 service nova] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:22:34.298678 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 694/1376] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:22:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:22:36.564628 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aa7c2c-56ff-48db-b0a9-2646cd75c6a0 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:22:36.565197 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aa7c2c-56ff-48db-b0a9-2646cd75c6a0 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:22:36.565197 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aa7c2c-56ff-48db-b0a9-2646cd75c6a0 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:22:36.566668 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 683/1377] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:22:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:22:36.572128 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0f9c2-352f-423c-b569-6d897266e390 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:22:36.572576 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0f9c2-352f-423c-b569-6d897266e390 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:22:36.572750 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0f9c2-352f-423c-b569-6d897266e390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:22:36.648973 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-94c0f9c2-352f-423c-b569-6d897266e390 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:22:36.650185 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-94c0f9c2-352f-423c-b569-6d897266e390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:22:36.658271 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:22:36.767648 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 695/1378] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:22:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:22:37.072519 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aa7c2c-56ff-48db-b0a9-2646cd75c6a0 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:22:37.074031 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-a6aa7c2c-56ff-48db-b0a9-2646cd75c6a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:22:37.142300 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:22:37.236568 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aa7c2c-56ff-48db-b0a9-2646cd75c6a0 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:22:37.368449 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fe8f81-c59e-4dfa-9bf7-5ebf4e59e616 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1f412befb9418fa66a2aabf475aa90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:22:37.369051 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe8f81-c59e-4dfa-9bf7-5ebf4e59e616 service nova] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:22:37.369333 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe8f81-c59e-4dfa-9bf7-5ebf4e59e616 service nova] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:22:37.369610 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe8f81-c59e-4dfa-9bf7-5ebf4e59e616 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:22:37.371179 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-b9fe8f81-c59e-4dfa-9bf7-5ebf4e59e616 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:22:37.392698 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:22:37.471140 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fe8f81-c59e-4dfa-9bf7-5ebf4e59e616 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:22:37.472767 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fe8f81-c59e-4dfa-9bf7-5ebf4e59e616 service nova] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:22:37.492377 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 684/1379] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:22:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:22:39.785870 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90995cff-e810-4065-9e1b-4d7da3b14cf9 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:22:39.786315 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90995cff-e810-4065-9e1b-4d7da3b14cf9 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:22:39.786435 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90995cff-e810-4065-9e1b-4d7da3b14cf9 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:22:39.787903 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 696/1380] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:22:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 03:22:39.797571 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2060d0-f401-476a-9a87-980e62c85c56 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:22:39.797993 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2060d0-f401-476a-9a87-980e62c85c56 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:22:39.798148 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2060d0-f401-476a-9a87-980e62c85c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:22:39.877501 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-fb2060d0-f401-476a-9a87-980e62c85c56 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:22:39.878561 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-fb2060d0-f401-476a-9a87-980e62c85c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:22:39.981324 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:22:39.988551 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 685/1381] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:22:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:22:40.358928 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90995cff-e810-4065-9e1b-4d7da3b14cf9 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:22:40.360579 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-90995cff-e810-4065-9e1b-4d7da3b14cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:22:40.517766 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:22:40.528796 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90995cff-e810-4065-9e1b-4d7da3b14cf9 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:22:40.683672 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a004c84-2660-4bb3-9257-0b47773e665b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1f412befb9418fa66a2aabf475aa90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:22:40.684413 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a004c84-2660-4bb3-9257-0b47773e665b service nova] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:22:40.684803 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a004c84-2660-4bb3-9257-0b47773e665b service nova] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:22:40.685140 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a004c84-2660-4bb3-9257-0b47773e665b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:22:40.688111 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-5a004c84-2660-4bb3-9257-0b47773e665b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:22:40.796015 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a004c84-2660-4bb3-9257-0b47773e665b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:22:40.797666 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a004c84-2660-4bb3-9257-0b47773e665b service nova] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:22:40.809099 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:22:40.820601 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 697/1382] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:22:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:22:43.090248 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f75a51-38a7-4e1e-95a9-98f02f4758de None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:22:43.090769 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f75a51-38a7-4e1e-95a9-98f02f4758de None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:22:43.090944 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f75a51-38a7-4e1e-95a9-98f02f4758de None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:22:43.093264 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 686/1383] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:22:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:22:43.099543 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f66a494-b057-4ed7-b8d6-1f7f294806db None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:22:43.100064 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f66a494-b057-4ed7-b8d6-1f7f294806db None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:22:43.100236 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f66a494-b057-4ed7-b8d6-1f7f294806db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:22:43.172210 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-4f66a494-b057-4ed7-b8d6-1f7f294806db None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:22:43.173477 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-4f66a494-b057-4ed7-b8d6-1f7f294806db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:22:43.283149 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 698/1384] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:22:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:22:43.576915 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f75a51-38a7-4e1e-95a9-98f02f4758de None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:22:43.578687 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-c2f75a51-38a7-4e1e-95a9-98f02f4758de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:22:43.743221 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f75a51-38a7-4e1e-95a9-98f02f4758de None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:22:43.818860 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:22:43.880858 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b049130-ce69-4185-94f1-71da766423bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1f412befb9418fa66a2aabf475aa90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:22:43.881946 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b049130-ce69-4185-94f1-71da766423bd service nova] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:22:43.882524 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b049130-ce69-4185-94f1-71da766423bd service nova] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:22:43.883145 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b049130-ce69-4185-94f1-71da766423bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:22:43.885425 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-6b049130-ce69-4185-94f1-71da766423bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:22:43.997961 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b049130-ce69-4185-94f1-71da766423bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:22:43.999824 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b049130-ce69-4185-94f1-71da766423bd service nova] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:22:44.019193 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 687/1385] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:22:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:22:46.356838 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331729cd-6fe2-42d7-b159-e4cf66bf012d None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:22:46.357380 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331729cd-6fe2-42d7-b159-e4cf66bf012d None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:22:46.357380 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331729cd-6fe2-42d7-b159-e4cf66bf012d None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:22:46.359340 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 699/1386] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:22:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:22:46.364832 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d433ac-f2ce-441d-b6af-58a98546c379 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:22:46.365239 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d433ac-f2ce-441d-b6af-58a98546c379 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:22:46.365390 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d433ac-f2ce-441d-b6af-58a98546c379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:22:46.433030 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-12d433ac-f2ce-441d-b6af-58a98546c379 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:22:46.434230 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-12d433ac-f2ce-441d-b6af-58a98546c379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:22:46.471179 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:22:46.535819 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 688/1387] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:22:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:22:46.825413 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331729cd-6fe2-42d7-b159-e4cf66bf012d None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:22:46.826992 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-331729cd-6fe2-42d7-b159-e4cf66bf012d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:22:46.906379 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:22:46.977161 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331729cd-6fe2-42d7-b159-e4cf66bf012d None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:22:47.090830 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc3dc96-2fef-4d51-afbf-ccbac83875d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1f412befb9418fa66a2aabf475aa90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:22:47.091563 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc3dc96-2fef-4d51-afbf-ccbac83875d5 service nova] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:22:47.091848 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc3dc96-2fef-4d51-afbf-ccbac83875d5 service nova] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:22:47.092798 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc3dc96-2fef-4d51-afbf-ccbac83875d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:22:47.094548 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-dbc3dc96-2fef-4d51-afbf-ccbac83875d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:22:47.134030 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:22:47.186699 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc3dc96-2fef-4d51-afbf-ccbac83875d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:22:47.188353 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc3dc96-2fef-4d51-afbf-ccbac83875d5 service nova] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:22:47.207079 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 700/1388] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:22:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:22:47.724423 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ea2401-6845-43e8-bb52-f40349d6eff5 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:22:47.724987 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ea2401-6845-43e8-bb52-f40349d6eff5 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:22:47.724987 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ea2401-6845-43e8-bb52-f40349d6eff5 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:22:47.726312 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 689/1389] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:22:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:22:47.731746 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf57d214-044a-448e-9234-e471ab15b77d None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:22:47.732148 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf57d214-044a-448e-9234-e471ab15b77d None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:22:47.732306 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf57d214-044a-448e-9234-e471ab15b77d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:22:47.799370 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-bf57d214-044a-448e-9234-e471ab15b77d None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:22:47.800838 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-bf57d214-044a-448e-9234-e471ab15b77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:22:47.897383 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 701/1390] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:22:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:22:48.203021 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b8efe-d6bf-4b4e-a9eb-5cd9e436d3a6 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:22:48.203308 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b8efe-d6bf-4b4e-a9eb-5cd9e436d3a6 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:22:48.203622 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b8efe-d6bf-4b4e-a9eb-5cd9e436d3a6 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:22:48.205095 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 690/1391] 10.222.0.25 () {54 vars in 962 bytes} [Tue Oct 4 03:22:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 03:22:48.210809 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad1922-c595-44de-95c8-ff8b9eded6d8 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:22:48.211167 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad1922-c595-44de-95c8-ff8b9eded6d8 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:22:48.211574 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad1922-c595-44de-95c8-ff8b9eded6d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:22:48.229589 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:22:48.296726 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-5cad1922-c595-44de-95c8-ff8b9eded6d8 None None] MFA Rules not processed for user `95be0e4e1c8641709e07b115047fb4e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:22:48.297548 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-5cad1922-c595-44de-95c8-ff8b9eded6d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:22:48.377205 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 702/1392] 10.222.0.25 () {58 vars in 1059 bytes} [Tue Oct 4 03:22:48 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:22:48.386220 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18b8efe-d6bf-4b4e-a9eb-5cd9e436d3a6 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:22:48.387830 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-d18b8efe-d6bf-4b4e-a9eb-5cd9e436d3a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:22:48.495578 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18b8efe-d6bf-4b4e-a9eb-5cd9e436d3a6 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:22:48.553030 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:22:48.569430 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57c37ae-6f3f-4a42-9e78-b2e91ef53152 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95be0e4e1c8641709e07b115047fb4e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:22:48.570020 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57c37ae-6f3f-4a42-9e78-b2e91ef53152 service glance] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:22:48.570298 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57c37ae-6f3f-4a42-9e78-b2e91ef53152 service glance] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:22:48.570567 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57c37ae-6f3f-4a42-9e78-b2e91ef53152 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:22:48.572432 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-a57c37ae-6f3f-4a42-9e78-b2e91ef53152 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:22:48.684942 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57c37ae-6f3f-4a42-9e78-b2e91ef53152 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:22:48.686688 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57c37ae-6f3f-4a42-9e78-b2e91ef53152 service glance] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:22:48.705697 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 691/1393] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:22:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:22:49.432987 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4994afa-1155-46d7-9791-f87760b14c51 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:22:49.433996 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4994afa-1155-46d7-9791-f87760b14c51 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:22:49.435457 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4994afa-1155-46d7-9791-f87760b14c51 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:22:49.437633 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 703/1394] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:22:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:22:49.443717 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c4a18-65e1-4d07-b718-0ef746fadda7 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:22:49.444228 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c4a18-65e1-4d07-b718-0ef746fadda7 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:22:49.444457 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c4a18-65e1-4d07-b718-0ef746fadda7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:22:49.459435 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ec530-b669-43ba-a86f-142381ca1db4 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:22:49.459779 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ec530-b669-43ba-a86f-142381ca1db4 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:22:49.460056 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ec530-b669-43ba-a86f-142381ca1db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:22:49.515416 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-bd0c4a18-65e1-4d07-b718-0ef746fadda7 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:22:49.516677 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-bd0c4a18-65e1-4d07-b718-0ef746fadda7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:22:49.531897 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-232ec530-b669-43ba-a86f-142381ca1db4 None None] MFA Rules not processed for user `bef61ef12079495ba72b7fcd2717aca2`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:22:49.533087 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-232ec530-b669-43ba-a86f-142381ca1db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:22:49.557622 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:22:49.589441 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:22:49.618756 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 692/1395] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:22:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:22:49.622277 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 704/1396] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Oct 4 03:22:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 03:22:49.669560 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2631d78d-0d63-4c7b-a3e6-271a990dc1b8 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:22:49.669920 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2631d78d-0d63-4c7b-a3e6-271a990dc1b8 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:22:49.670916 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2631d78d-0d63-4c7b-a3e6-271a990dc1b8 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:22:49.672523 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 693/1397] 10.222.0.25 () {54 vars in 943 bytes} [Tue Oct 4 03:22:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:22:49.678819 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d766c-9040-4dac-95b4-cc9ef5e78255 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:22:49.679108 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d766c-9040-4dac-95b4-cc9ef5e78255 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:22:49.679411 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d766c-9040-4dac-95b4-cc9ef5e78255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:22:49.757830 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-f71d766c-9040-4dac-95b4-cc9ef5e78255 None None] MFA Rules not processed for user `1d8da6bacc8f432e8f48bb99c7aede11`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:22:49.759048 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-f71d766c-9040-4dac-95b4-cc9ef5e78255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:22:49.869934 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 705/1398] 10.222.0.25 () {58 vars in 1040 bytes} [Tue Oct 4 03:22:49 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:22:49.880052 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2631d78d-0d63-4c7b-a3e6-271a990dc1b8 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:22:49.881577 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-2631d78d-0d63-4c7b-a3e6-271a990dc1b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:22:49.920264 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d766c-9040-4dac-95b4-cc9ef5e78255 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:22:49.921544 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-f71d766c-9040-4dac-95b4-cc9ef5e78255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:22:49.974374 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:22:50.047776 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2631d78d-0d63-4c7b-a3e6-271a990dc1b8 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:22:50.048022 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d766c-9040-4dac-95b4-cc9ef5e78255 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:22:50.087044 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:22:50.169038 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa549d4-06e7-4d6d-a545-ccfc594ad83d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8da6bacc8f432e8f48bb99c7aede11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:22:50.169641 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa549d4-06e7-4d6d-a545-ccfc594ad83d service swift] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:22:50.169919 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa549d4-06e7-4d6d-a545-ccfc594ad83d service swift] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:22:50.170687 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa549d4-06e7-4d6d-a545-ccfc594ad83d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:22:50.170971 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd7710-f954-4587-8e25-ff12eb48cdc0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1f412befb9418fa66a2aabf475aa90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:22:50.171604 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd7710-f954-4587-8e25-ff12eb48cdc0 service nova] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:22:50.171883 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd7710-f954-4587-8e25-ff12eb48cdc0 service nova] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:22:50.172151 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd7710-f954-4587-8e25-ff12eb48cdc0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:22:50.172471 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-4aa549d4-06e7-4d6d-a545-ccfc594ad83d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:22:50.173710 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-34bd7710-f954-4587-8e25-ff12eb48cdc0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:22:50.216569 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:22:50.261291 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa549d4-06e7-4d6d-a545-ccfc594ad83d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:22:50.262907 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa549d4-06e7-4d6d-a545-ccfc594ad83d service swift] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:22:50.266506 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bd7710-f954-4587-8e25-ff12eb48cdc0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:22:50.268165 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bd7710-f954-4587-8e25-ff12eb48cdc0 service nova] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:22:50.271667 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 694/1399] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Oct 4 03:22:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 03:22:50.287150 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 706/1400] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:22:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 03:22:52.501300 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ee152-da17-48b7-bbe2-7a769a0b14f4 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:22:52.501300 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ee152-da17-48b7-bbe2-7a769a0b14f4 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:22:52.501300 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ee152-da17-48b7-bbe2-7a769a0b14f4 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:22:52.502529 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 695/1401] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:22:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:22:52.508164 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f0251-2635-4801-989b-c458f3efef28 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:22:52.508593 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f0251-2635-4801-989b-c458f3efef28 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:22:52.508832 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f0251-2635-4801-989b-c458f3efef28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:22:52.583615 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-fa7f0251-2635-4801-989b-c458f3efef28 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:22:52.584900 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-fa7f0251-2635-4801-989b-c458f3efef28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:22:52.699527 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 707/1402] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:22:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:22:52.997583 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2ee152-da17-48b7-bbe2-7a769a0b14f4 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:22:52.999113 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-fe2ee152-da17-48b7-bbe2-7a769a0b14f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:22:53.086764 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:22:53.171940 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2ee152-da17-48b7-bbe2-7a769a0b14f4 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:22:53.323862 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76db2d0-4643-4a76-abf2-8baf2e4423eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1f412befb9418fa66a2aabf475aa90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:22:53.325362 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76db2d0-4643-4a76-abf2-8baf2e4423eb service nova] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:22:53.326323 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76db2d0-4643-4a76-abf2-8baf2e4423eb service nova] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:22:53.326323 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76db2d0-4643-4a76-abf2-8baf2e4423eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:22:53.329334 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-b76db2d0-4643-4a76-abf2-8baf2e4423eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:22:53.385268 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:22:53.460819 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76db2d0-4643-4a76-abf2-8baf2e4423eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:22:53.462859 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76db2d0-4643-4a76-abf2-8baf2e4423eb service nova] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:22:53.487816 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 696/1403] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:22:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:22:55.722863 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae340a0-11bb-4288-9323-0b06bef0264e None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:22:55.723429 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae340a0-11bb-4288-9323-0b06bef0264e None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:22:55.723429 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae340a0-11bb-4288-9323-0b06bef0264e None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:22:55.724937 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 708/1404] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:22:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:22:55.730124 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf7633-1ce9-4538-8fc4-51d532497e09 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:22:55.730555 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf7633-1ce9-4538-8fc4-51d532497e09 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:22:55.730662 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf7633-1ce9-4538-8fc4-51d532497e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:22:55.809333 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-cbaf7633-1ce9-4538-8fc4-51d532497e09 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:22:55.810608 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-cbaf7633-1ce9-4538-8fc4-51d532497e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:22:55.927618 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 697/1405] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:22:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:22:56.224202 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae340a0-11bb-4288-9323-0b06bef0264e None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:22:56.225737 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-dae340a0-11bb-4288-9323-0b06bef0264e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:22:56.246027 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:22:56.386411 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae340a0-11bb-4288-9323-0b06bef0264e None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:22:56.489041 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:22:56.516594 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9eb0e5-822d-42fd-9c7f-e51ccae99357 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1f412befb9418fa66a2aabf475aa90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:22:56.517510 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9eb0e5-822d-42fd-9c7f-e51ccae99357 service nova] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:22:56.517967 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9eb0e5-822d-42fd-9c7f-e51ccae99357 service nova] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:22:56.518238 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9eb0e5-822d-42fd-9c7f-e51ccae99357 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:22:56.519887 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-9a9eb0e5-822d-42fd-9c7f-e51ccae99357 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:22:56.622216 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9eb0e5-822d-42fd-9c7f-e51ccae99357 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:22:56.624161 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9eb0e5-822d-42fd-9c7f-e51ccae99357 service nova] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:22:56.651906 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 709/1406] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:22:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:22:58.924130 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df7ac15-05dc-4c55-a7cf-426e7d32220c None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:22:58.924679 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df7ac15-05dc-4c55-a7cf-426e7d32220c None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:22:58.924679 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df7ac15-05dc-4c55-a7cf-426e7d32220c None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:22:58.926045 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 698/1407] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:22:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:22:58.931404 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583eb01-0497-40bf-8cf1-7a3316020f12 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:22:58.932230 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583eb01-0497-40bf-8cf1-7a3316020f12 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:22:58.932714 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583eb01-0497-40bf-8cf1-7a3316020f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:22:59.003768 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-5583eb01-0497-40bf-8cf1-7a3316020f12 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:22:59.005063 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-5583eb01-0497-40bf-8cf1-7a3316020f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:22:59.075839 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:22:59.124474 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 710/1408] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:22:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:22:59.425343 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df7ac15-05dc-4c55-a7cf-426e7d32220c None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:22:59.426929 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-9df7ac15-05dc-4c55-a7cf-426e7d32220c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:22:59.435676 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:22:59.599563 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df7ac15-05dc-4c55-a7cf-426e7d32220c None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:22:59.695812 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:22:59.733872 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c9a548-005c-4100-8ab4-31f104332b8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1f412befb9418fa66a2aabf475aa90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:22:59.734473 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c9a548-005c-4100-8ab4-31f104332b8d service nova] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:22:59.734754 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c9a548-005c-4100-8ab4-31f104332b8d service nova] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:22:59.735015 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c9a548-005c-4100-8ab4-31f104332b8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:22:59.736664 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-b2c9a548-005c-4100-8ab4-31f104332b8d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:22:59.954759 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c9a548-005c-4100-8ab4-31f104332b8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:22:59.957120 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c9a548-005c-4100-8ab4-31f104332b8d service nova] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:22:59.977375 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 699/1409] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:22:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:23:09.122268 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=19 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:23:09.974555 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=59 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:23:13.304961 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3feca-08e0-4c9f-9e59-89a6e8bdafed None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:23:13.305543 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3feca-08e0-4c9f-9e59-89a6e8bdafed None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:23:13.305543 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3feca-08e0-4c9f-9e59-89a6e8bdafed None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:23:13.306867 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 711/1410] 10.222.0.25 () {54 vars in 918 bytes} [Tue Oct 4 03:23:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:23:13.312541 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b47b3a9-45ce-4e11-9e20-dbe8ff773e79 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:23:13.312953 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b47b3a9-45ce-4e11-9e20-dbe8ff773e79 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:23:13.313077 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b47b3a9-45ce-4e11-9e20-dbe8ff773e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:23:13.390787 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-3b47b3a9-45ce-4e11-9e20-dbe8ff773e79 None None] MFA Rules not processed for user `94513f6cd19f495e842deb3c13c3e4d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:23:13.392046 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-3b47b3a9-45ce-4e11-9e20-dbe8ff773e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:23:13.497910 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 700/1411] 10.222.0.25 () {58 vars in 1015 bytes} [Tue Oct 4 03:23:13 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:23:13.512334 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aafd1c-dd2e-4678-98b1-0d24c91c92c3 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:23:13.512657 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aafd1c-dd2e-4678-98b1-0d24c91c92c3 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:23:13.513091 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aafd1c-dd2e-4678-98b1-0d24c91c92c3 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:23:13.514498 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 712/1412] 10.222.0.25 () {54 vars in 918 bytes} [Tue Oct 4 03:23:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:23:13.519120 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b91f983-df98-46d0-9efb-6dc6b83f7d2a None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:23:13.519400 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b91f983-df98-46d0-9efb-6dc6b83f7d2a None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:23:13.519716 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b91f983-df98-46d0-9efb-6dc6b83f7d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:23:13.592193 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:23:13.595012 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-5b91f983-df98-46d0-9efb-6dc6b83f7d2a None None] MFA Rules not processed for user `2c1f412befb9418fa66a2aabf475aa90`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:23:13.596895 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-5b91f983-df98-46d0-9efb-6dc6b83f7d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:23:13.717677 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 701/1413] 10.222.0.25 () {58 vars in 1015 bytes} [Tue Oct 4 03:23:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:23:16.300268 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41841b-a014-4b41-876c-d211b55498db None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:23:16.300845 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41841b-a014-4b41-876c-d211b55498db None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:23:16.300845 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41841b-a014-4b41-876c-d211b55498db None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:23:16.302136 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 713/1414] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 03:23:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:23:16.307301 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692426e2-b8dc-4519-a02e-77d29ccab4c4 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:23:16.307703 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692426e2-b8dc-4519-a02e-77d29ccab4c4 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:23:16.307894 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692426e2-b8dc-4519-a02e-77d29ccab4c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:23:16.373805 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-692426e2-b8dc-4519-a02e-77d29ccab4c4 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:23:16.374983 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-692426e2-b8dc-4519-a02e-77d29ccab4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:23:16.428597 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:23:16.474137 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 702/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 03:23:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:23:16.765617 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f41841b-a014-4b41-876c-d211b55498db None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:23:16.767157 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-8f41841b-a014-4b41-876c-d211b55498db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:23:16.911443 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f41841b-a014-4b41-876c-d211b55498db None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:23:16.983555 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:23:17.022770 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb7a5b5-5647-4594-afb0-194c96e26172 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1f412befb9418fa66a2aabf475aa90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:23:17.023377 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb7a5b5-5647-4594-afb0-194c96e26172 service nova] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:23:17.023686 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb7a5b5-5647-4594-afb0-194c96e26172 service nova] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:23:17.023963 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb7a5b5-5647-4594-afb0-194c96e26172 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:23:17.025564 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-9fb7a5b5-5647-4594-afb0-194c96e26172 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:23:17.114669 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb7a5b5-5647-4594-afb0-194c96e26172 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:23:17.116272 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb7a5b5-5647-4594-afb0-194c96e26172 service nova] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:23:17.133819 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 714/1416] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:23:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:23:18.275916 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6513b651-46f5-47f4-bf09-e51e18201247 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:23:18.276482 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6513b651-46f5-47f4-bf09-e51e18201247 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:23:18.276482 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6513b651-46f5-47f4-bf09-e51e18201247 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:23:18.277775 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 703/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 03:23:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:23:18.284062 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a36ea5-6c2d-4f2c-9cfd-dd429ca17ec7 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:23:18.284491 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a36ea5-6c2d-4f2c-9cfd-dd429ca17ec7 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:23:18.284800 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a36ea5-6c2d-4f2c-9cfd-dd429ca17ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:23:18.360901 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-23a36ea5-6c2d-4f2c-9cfd-dd429ca17ec7 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:23:18.362096 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-23a36ea5-6c2d-4f2c-9cfd-dd429ca17ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:23:18.390008 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:23:18.460500 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 715/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 03:23:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:23:18.622298 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6513b651-46f5-47f4-bf09-e51e18201247 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:23:18.623908 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-6513b651-46f5-47f4-bf09-e51e18201247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:23:18.769284 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6513b651-46f5-47f4-bf09-e51e18201247 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:23:18.809280 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:23:18.882021 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db613f4-c6a4-4db5-91c5-2e5a3f5666d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1f412befb9418fa66a2aabf475aa90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:23:18.882535 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db613f4-c6a4-4db5-91c5-2e5a3f5666d3 service nova] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:23:18.882809 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db613f4-c6a4-4db5-91c5-2e5a3f5666d3 service nova] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:23:18.883076 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db613f4-c6a4-4db5-91c5-2e5a3f5666d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:23:18.884685 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-3db613f4-c6a4-4db5-91c5-2e5a3f5666d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:23:18.972323 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db613f4-c6a4-4db5-91c5-2e5a3f5666d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:23:18.973879 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db613f4-c6a4-4db5-91c5-2e5a3f5666d3 service nova] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:23:18.990987 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 704/1419] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:23:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:23:20.116296 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa1edb5-1751-49b8-b019-4de4cac59dad None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:23:20.116870 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa1edb5-1751-49b8-b019-4de4cac59dad None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:23:20.116870 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa1edb5-1751-49b8-b019-4de4cac59dad None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:23:20.118180 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 716/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 03:23:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:23:20.124881 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b7df4-c626-4fdd-9b3e-fdb16606f077 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:23:20.125318 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b7df4-c626-4fdd-9b3e-fdb16606f077 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:23:20.125424 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b7df4-c626-4fdd-9b3e-fdb16606f077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:23:20.177590 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:23:20.199043 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-810b7df4-c626-4fdd-9b3e-fdb16606f077 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:23:20.201056 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-810b7df4-c626-4fdd-9b3e-fdb16606f077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:23:20.295107 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 705/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 03:23:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:23:20.452903 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa1edb5-1751-49b8-b019-4de4cac59dad None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:23:20.454490 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-2aa1edb5-1751-49b8-b019-4de4cac59dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:23:20.603736 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa1edb5-1751-49b8-b019-4de4cac59dad None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:23:20.616215 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:23:20.734312 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76848f7f-d8f7-4a53-aeda-2839590a0715 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1f412befb9418fa66a2aabf475aa90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:23:20.734923 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76848f7f-d8f7-4a53-aeda-2839590a0715 service nova] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:23:20.735230 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76848f7f-d8f7-4a53-aeda-2839590a0715 service nova] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:23:20.735531 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76848f7f-d8f7-4a53-aeda-2839590a0715 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:23:20.737128 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-76848f7f-d8f7-4a53-aeda-2839590a0715 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:23:20.827646 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76848f7f-d8f7-4a53-aeda-2839590a0715 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:23:20.829249 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76848f7f-d8f7-4a53-aeda-2839590a0715 service nova] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:23:20.847114 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 717/1422] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:23:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:23:21.969892 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79daaf13-68eb-4063-9a83-9ad43ca567f7 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:23:21.970415 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79daaf13-68eb-4063-9a83-9ad43ca567f7 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:23:21.970515 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79daaf13-68eb-4063-9a83-9ad43ca567f7 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:23:21.971834 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 706/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 03:23:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:23:21.978171 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea383ae-9cae-4b30-9739-36ca547f2282 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:23:21.978594 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea383ae-9cae-4b30-9739-36ca547f2282 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:23:21.978727 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea383ae-9cae-4b30-9739-36ca547f2282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:23:21.999303 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:23:22.056422 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-3ea383ae-9cae-4b30-9739-36ca547f2282 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:23:22.057619 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-3ea383ae-9cae-4b30-9739-36ca547f2282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:23:22.269210 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 718/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 03:23:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:23:22.424839 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79daaf13-68eb-4063-9a83-9ad43ca567f7 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:23:22.427429 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-79daaf13-68eb-4063-9a83-9ad43ca567f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:23:22.539990 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:23:22.576098 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79daaf13-68eb-4063-9a83-9ad43ca567f7 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:23:22.691133 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08da8cf8-9042-4140-9d3e-6fbf9d74f1f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1f412befb9418fa66a2aabf475aa90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:23:22.691756 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da8cf8-9042-4140-9d3e-6fbf9d74f1f7 service nova] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:23:22.692035 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da8cf8-9042-4140-9d3e-6fbf9d74f1f7 service nova] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:23:22.692302 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da8cf8-9042-4140-9d3e-6fbf9d74f1f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:23:22.693878 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-08da8cf8-9042-4140-9d3e-6fbf9d74f1f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:23:22.771197 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:23:22.784440 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08da8cf8-9042-4140-9d3e-6fbf9d74f1f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:23:22.786006 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08da8cf8-9042-4140-9d3e-6fbf9d74f1f7 service nova] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:23:22.803424 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 707/1425] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:23:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:23:23.913737 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08114d9f-01de-4a34-8a0b-cc4d4e28b57b None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:23:23.914277 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08114d9f-01de-4a34-8a0b-cc4d4e28b57b None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:23:23.914277 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08114d9f-01de-4a34-8a0b-cc4d4e28b57b None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:23:23.915592 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 719/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 03:23:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:23:23.922778 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5ef24-3a59-4af1-abc0-b8a2006c91e0 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:23:23.923190 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5ef24-3a59-4af1-abc0-b8a2006c91e0 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:23:23.923320 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5ef24-3a59-4af1-abc0-b8a2006c91e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:23:23.997341 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-03c5ef24-3a59-4af1-abc0-b8a2006c91e0 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:23:23.998527 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-03c5ef24-3a59-4af1-abc0-b8a2006c91e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:23:24.092160 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 708/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 03:23:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:23:24.243030 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08114d9f-01de-4a34-8a0b-cc4d4e28b57b None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:23:24.244637 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-08114d9f-01de-4a34-8a0b-cc4d4e28b57b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:23:24.327670 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:23:24.391021 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08114d9f-01de-4a34-8a0b-cc4d4e28b57b None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:23:24.504386 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cef581-10ef-40ac-a8ef-09b45ab7b812 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1f412befb9418fa66a2aabf475aa90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:23:24.504932 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cef581-10ef-40ac-a8ef-09b45ab7b812 service nova] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:23:24.505216 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cef581-10ef-40ac-a8ef-09b45ab7b812 service nova] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:23:24.505485 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cef581-10ef-40ac-a8ef-09b45ab7b812 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:23:24.507092 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-62cef581-10ef-40ac-a8ef-09b45ab7b812 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:23:24.555209 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:23:24.597292 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cef581-10ef-40ac-a8ef-09b45ab7b812 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:23:24.598888 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cef581-10ef-40ac-a8ef-09b45ab7b812 service nova] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:23:24.616897 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 720/1428] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:23:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:23:25.698645 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e5562a-f911-4f0b-9341-6ea53c7452de None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:23:25.699207 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e5562a-f911-4f0b-9341-6ea53c7452de None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:23:25.699207 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e5562a-f911-4f0b-9341-6ea53c7452de None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:23:25.700684 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 709/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 03:23:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:23:25.707017 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a68d150-89c0-40b0-8b12-51f865850eda None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:23:25.707471 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a68d150-89c0-40b0-8b12-51f865850eda None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:23:25.707590 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a68d150-89c0-40b0-8b12-51f865850eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:23:25.784304 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-8a68d150-89c0-40b0-8b12-51f865850eda None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:23:25.785498 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-8a68d150-89c0-40b0-8b12-51f865850eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:23:25.877759 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 721/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 03:23:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:23:26.028149 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e5562a-f911-4f0b-9341-6ea53c7452de None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:23:26.029751 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-94e5562a-f911-4f0b-9341-6ea53c7452de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:23:26.078720 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:23:26.174170 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e5562a-f911-4f0b-9341-6ea53c7452de None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:23:26.285523 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b18079-2903-4959-ad8d-e72e215bfa2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1f412befb9418fa66a2aabf475aa90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:23:26.286113 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b18079-2903-4959-ad8d-e72e215bfa2a service nova] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:23:26.286387 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b18079-2903-4959-ad8d-e72e215bfa2a service nova] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:23:26.286655 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b18079-2903-4959-ad8d-e72e215bfa2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:23:26.288263 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-82b18079-2903-4959-ad8d-e72e215bfa2a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:23:26.295088 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:23:26.376835 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b18079-2903-4959-ad8d-e72e215bfa2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:23:26.378396 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b18079-2903-4959-ad8d-e72e215bfa2a service nova] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:23:26.397309 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 710/1431] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:23:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:23:27.452390 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb7f2d-4c9a-4bf4-83f1-dcd3022d9581 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:23:27.452970 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb7f2d-4c9a-4bf4-83f1-dcd3022d9581 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:23:27.452970 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb7f2d-4c9a-4bf4-83f1-dcd3022d9581 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:23:27.454256 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 722/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 03:23:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:23:27.460446 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1361465-98f2-408e-a2e2-5349c3cc9bda None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:23:27.460853 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1361465-98f2-408e-a2e2-5349c3cc9bda None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:23:27.460997 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1361465-98f2-408e-a2e2-5349c3cc9bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:23:27.535086 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-d1361465-98f2-408e-a2e2-5349c3cc9bda None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:23:27.536309 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-d1361465-98f2-408e-a2e2-5349c3cc9bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:23:27.604257 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:23:27.634433 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 711/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 03:23:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:23:27.783213 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bb7f2d-4c9a-4bf4-83f1-dcd3022d9581 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:23:27.784816 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-54bb7f2d-4c9a-4bf4-83f1-dcd3022d9581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:23:27.802911 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:23:27.930569 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bb7f2d-4c9a-4bf4-83f1-dcd3022d9581 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:23:28.017345 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:23:28.043210 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d75833-e3da-43b0-b639-331c4232330b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1f412befb9418fa66a2aabf475aa90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:23:28.044317 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d75833-e3da-43b0-b639-331c4232330b service nova] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:23:28.044599 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d75833-e3da-43b0-b639-331c4232330b service nova] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:23:28.044872 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d75833-e3da-43b0-b639-331c4232330b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:23:28.046488 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-84d75833-e3da-43b0-b639-331c4232330b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:23:28.133936 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d75833-e3da-43b0-b639-331c4232330b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:23:28.135517 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d75833-e3da-43b0-b639-331c4232330b service nova] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:23:28.153708 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 723/1434] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:23:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:23:29.207336 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09bd607-08d8-40c2-a056-89817ab0ef70 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:23:29.207899 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09bd607-08d8-40c2-a056-89817ab0ef70 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:23:29.207899 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09bd607-08d8-40c2-a056-89817ab0ef70 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:23:29.209191 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 712/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 03:23:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:23:29.216276 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f12fd-b547-45cc-8cb5-80f9a4fc3323 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:23:29.216737 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f12fd-b547-45cc-8cb5-80f9a4fc3323 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:23:29.216845 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f12fd-b547-45cc-8cb5-80f9a4fc3323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:23:29.294371 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-043f12fd-b547-45cc-8cb5-80f9a4fc3323 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:23:29.295605 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-043f12fd-b547-45cc-8cb5-80f9a4fc3323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:23:29.336348 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:23:29.390166 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 724/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 03:23:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:23:29.543570 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09bd607-08d8-40c2-a056-89817ab0ef70 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:23:29.545465 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-d09bd607-08d8-40c2-a056-89817ab0ef70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:23:29.694949 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09bd607-08d8-40c2-a056-89817ab0ef70 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:23:29.752303 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:23:29.810478 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4e8468-53ce-4fa2-8329-2a99646f81d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1f412befb9418fa66a2aabf475aa90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:23:29.811010 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e8468-53ce-4fa2-8329-2a99646f81d4 service nova] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:23:29.811291 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e8468-53ce-4fa2-8329-2a99646f81d4 service nova] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:23:29.811600 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e8468-53ce-4fa2-8329-2a99646f81d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:23:29.813189 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-4d4e8468-53ce-4fa2-8329-2a99646f81d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:23:29.901608 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4e8468-53ce-4fa2-8329-2a99646f81d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:23:29.903886 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4e8468-53ce-4fa2-8329-2a99646f81d4 service nova] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:23:29.921355 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 713/1437] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:23:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:23:31.000795 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c224c6-0a5e-45c3-b56e-656e888d8bed None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:23:31.001361 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c224c6-0a5e-45c3-b56e-656e888d8bed None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:23:31.001361 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c224c6-0a5e-45c3-b56e-656e888d8bed None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:23:31.002690 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 725/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 03:23:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:23:31.008950 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff4a353-906f-4288-b540-1a7a2480521f None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:23:31.009364 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff4a353-906f-4288-b540-1a7a2480521f None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:23:31.009475 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff4a353-906f-4288-b540-1a7a2480521f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:23:31.083418 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-9ff4a353-906f-4288-b540-1a7a2480521f None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:23:31.084630 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-9ff4a353-906f-4288-b540-1a7a2480521f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:23:31.086584 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:23:31.180671 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 714/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 03:23:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:23:31.332256 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c224c6-0a5e-45c3-b56e-656e888d8bed None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:23:31.333761 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-89c224c6-0a5e-45c3-b56e-656e888d8bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:23:31.478777 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c224c6-0a5e-45c3-b56e-656e888d8bed None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:23:31.506237 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:23:31.591987 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1331cd21-8982-4af0-a059-9030e9d8c6d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1f412befb9418fa66a2aabf475aa90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:23:31.592586 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331cd21-8982-4af0-a059-9030e9d8c6d3 service nova] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:23:31.592874 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331cd21-8982-4af0-a059-9030e9d8c6d3 service nova] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:23:31.593149 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331cd21-8982-4af0-a059-9030e9d8c6d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:23:31.594747 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-1331cd21-8982-4af0-a059-9030e9d8c6d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:23:31.692755 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1331cd21-8982-4af0-a059-9030e9d8c6d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:23:31.694343 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1331cd21-8982-4af0-a059-9030e9d8c6d3 service nova] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:23:31.713745 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 726/1440] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:23:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:23:33.798498 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388725bf-b7d0-4693-ad56-034867575e33 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:23:33.799167 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388725bf-b7d0-4693-ad56-034867575e33 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:23:33.799167 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388725bf-b7d0-4693-ad56-034867575e33 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:23:33.800413 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 715/1441] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 03:23:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:23:33.805872 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5737d779-5c8d-4113-9c70-5c4f273f5d41 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:23:33.806268 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5737d779-5c8d-4113-9c70-5c4f273f5d41 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:23:33.806428 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5737d779-5c8d-4113-9c70-5c4f273f5d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:23:33.848335 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:23:33.873428 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-5737d779-5c8d-4113-9c70-5c4f273f5d41 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:23:33.874625 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-5737d779-5c8d-4113-9c70-5c4f273f5d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:23:33.971374 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 727/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 03:23:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:23:34.260825 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388725bf-b7d0-4693-ad56-034867575e33 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:23:34.262382 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-388725bf-b7d0-4693-ad56-034867575e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:23:34.367609 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388725bf-b7d0-4693-ad56-034867575e33 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:23:34.400798 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:23:34.441665 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba49134-6f99-4417-8b59-49e4c55962d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:23:34.442261 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba49134-6f99-4417-8b59-49e4c55962d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:23:34.442539 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba49134-6f99-4417-8b59-49e4c55962d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:23:34.442811 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba49134-6f99-4417-8b59-49e4c55962d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:23:34.444435 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-aba49134-6f99-4417-8b59-49e4c55962d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:23:34.551926 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba49134-6f99-4417-8b59-49e4c55962d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:23:34.553260 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba49134-6f99-4417-8b59-49e4c55962d4 service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:23:34.570505 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 716/1443] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:23:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:23:36.870340 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bcd142-699c-4791-8c7c-89bdede9fc81 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:23:36.870906 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bcd142-699c-4791-8c7c-89bdede9fc81 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:23:36.870906 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bcd142-699c-4791-8c7c-89bdede9fc81 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:23:36.872425 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 728/1444] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 03:23:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:23:36.877767 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878bdeb-71dc-4705-ad02-050298e3cc77 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:23:36.878219 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878bdeb-71dc-4705-ad02-050298e3cc77 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:23:36.878315 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878bdeb-71dc-4705-ad02-050298e3cc77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:23:36.945102 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-a878bdeb-71dc-4705-ad02-050298e3cc77 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:23:36.946562 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-a878bdeb-71dc-4705-ad02-050298e3cc77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:23:36.959026 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:23:37.042067 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 717/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 03:23:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:23:37.327081 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bcd142-699c-4791-8c7c-89bdede9fc81 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:23:37.328659 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-18bcd142-699c-4791-8c7c-89bdede9fc81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:23:37.432430 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bcd142-699c-4791-8c7c-89bdede9fc81 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:23:37.445400 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:23:37.506801 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc38844-09f2-436c-9097-ad6664b061cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:23:37.507399 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc38844-09f2-436c-9097-ad6664b061cd service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:23:37.507709 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc38844-09f2-436c-9097-ad6664b061cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:23:37.507994 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc38844-09f2-436c-9097-ad6664b061cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:23:37.509596 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-bfc38844-09f2-436c-9097-ad6664b061cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:23:37.639913 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc38844-09f2-436c-9097-ad6664b061cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:23:37.641266 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc38844-09f2-436c-9097-ad6664b061cd service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:23:37.660661 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 729/1446] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:23:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:23:40.189541 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc16c56e-1510-4d4b-baf2-2fc9f054019c None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:23:40.190116 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc16c56e-1510-4d4b-baf2-2fc9f054019c None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:23:40.190116 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc16c56e-1510-4d4b-baf2-2fc9f054019c None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:23:40.191687 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 718/1447] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 03:23:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:23:40.198588 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5eeabe-b6bf-4bcf-a021-4ced126d7c71 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:23:40.199015 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5eeabe-b6bf-4bcf-a021-4ced126d7c71 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:23:40.200228 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5eeabe-b6bf-4bcf-a021-4ced126d7c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:23:40.258878 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:23:40.278809 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-be5eeabe-b6bf-4bcf-a021-4ced126d7c71 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:23:40.280078 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-be5eeabe-b6bf-4bcf-a021-4ced126d7c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:23:40.381389 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 730/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 03:23:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:23:40.670179 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc16c56e-1510-4d4b-baf2-2fc9f054019c None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:23:40.671754 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-dc16c56e-1510-4d4b-baf2-2fc9f054019c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:23:40.775096 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc16c56e-1510-4d4b-baf2-2fc9f054019c None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:23:40.815873 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:23:40.852772 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b5404-e850-4fc6-a245-c69f98683e30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:23:40.853398 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b5404-e850-4fc6-a245-c69f98683e30 service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:23:40.853676 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b5404-e850-4fc6-a245-c69f98683e30 service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:23:40.853947 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b5404-e850-4fc6-a245-c69f98683e30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:23:40.856506 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-c70b5404-e850-4fc6-a245-c69f98683e30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:23:40.965494 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70b5404-e850-4fc6-a245-c69f98683e30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:23:40.966972 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70b5404-e850-4fc6-a245-c69f98683e30 service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:23:40.985693 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 719/1449] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:23:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:23:43.315213 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b528f7-7b37-4e62-947d-4c00869ef99f None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:23:43.316092 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b528f7-7b37-4e62-947d-4c00869ef99f None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:23:43.316269 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b528f7-7b37-4e62-947d-4c00869ef99f None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:23:43.317680 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 731/1450] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 03:23:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:23:43.323174 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f97f6-4bd7-4c30-aacb-b80beb50908b None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:23:43.323729 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f97f6-4bd7-4c30-aacb-b80beb50908b None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:23:43.324423 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f97f6-4bd7-4c30-aacb-b80beb50908b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:23:43.392389 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-177f97f6-4bd7-4c30-aacb-b80beb50908b None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:23:43.393590 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-177f97f6-4bd7-4c30-aacb-b80beb50908b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:23:43.414013 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:23:43.490785 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 720/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 03:23:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:23:43.782694 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b528f7-7b37-4e62-947d-4c00869ef99f None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:23:43.784316 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-10b528f7-7b37-4e62-947d-4c00869ef99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:23:43.886048 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b528f7-7b37-4e62-947d-4c00869ef99f None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:23:43.906724 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:23:43.960484 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6cec9a-9f35-4867-9452-686270bd158d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:23:43.961082 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6cec9a-9f35-4867-9452-686270bd158d service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:23:43.961360 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6cec9a-9f35-4867-9452-686270bd158d service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:23:43.961626 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6cec9a-9f35-4867-9452-686270bd158d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:23:43.963215 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-1e6cec9a-9f35-4867-9452-686270bd158d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:23:44.070609 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6cec9a-9f35-4867-9452-686270bd158d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:23:44.072350 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6cec9a-9f35-4867-9452-686270bd158d service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:23:44.090970 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 732/1452] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:23:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:23:46.284046 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d941ff4-e7ac-4f7c-8a81-cfe406d245fd None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:23:46.284611 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d941ff4-e7ac-4f7c-8a81-cfe406d245fd None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:23:46.284611 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d941ff4-e7ac-4f7c-8a81-cfe406d245fd None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:23:46.285911 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 721/1453] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 03:23:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:23:46.291140 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0398d61-c5f8-4ca2-a215-de4b25fe4559 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:23:46.291611 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0398d61-c5f8-4ca2-a215-de4b25fe4559 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:23:46.291720 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0398d61-c5f8-4ca2-a215-de4b25fe4559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:23:46.361112 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:23:46.363784 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-a0398d61-c5f8-4ca2-a215-de4b25fe4559 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:23:46.365527 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-a0398d61-c5f8-4ca2-a215-de4b25fe4559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:23:46.459894 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 733/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 03:23:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:23:46.740215 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d941ff4-e7ac-4f7c-8a81-cfe406d245fd None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:23:46.741751 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-7d941ff4-e7ac-4f7c-8a81-cfe406d245fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:23:46.843717 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d941ff4-e7ac-4f7c-8a81-cfe406d245fd None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:23:46.891577 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:23:46.915766 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c2f42a-66bb-4af1-9c7f-0257ae2411fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:23:46.916357 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c2f42a-66bb-4af1-9c7f-0257ae2411fa service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:23:46.917162 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c2f42a-66bb-4af1-9c7f-0257ae2411fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:23:46.917162 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c2f42a-66bb-4af1-9c7f-0257ae2411fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:23:46.919043 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-b6c2f42a-66bb-4af1-9c7f-0257ae2411fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:23:47.025718 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c2f42a-66bb-4af1-9c7f-0257ae2411fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:23:47.028593 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c2f42a-66bb-4af1-9c7f-0257ae2411fa service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:23:47.046876 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 722/1455] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:23:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:23:49.265471 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24134fd5-da50-44a4-b9a3-3f0d6368ff86 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:23:49.266029 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24134fd5-da50-44a4-b9a3-3f0d6368ff86 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:23:49.266029 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24134fd5-da50-44a4-b9a3-3f0d6368ff86 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:23:49.267356 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 734/1456] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 03:23:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:23:49.272972 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb532b3-a0e1-471a-9201-66dc4611a16f None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:23:49.273415 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb532b3-a0e1-471a-9201-66dc4611a16f None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:23:49.273602 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb532b3-a0e1-471a-9201-66dc4611a16f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:23:49.339881 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-9bb532b3-a0e1-471a-9201-66dc4611a16f None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:23:49.341080 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-9bb532b3-a0e1-471a-9201-66dc4611a16f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:23:49.368904 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:23:49.436935 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 723/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 03:23:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:23:49.719207 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24134fd5-da50-44a4-b9a3-3f0d6368ff86 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:23:49.720764 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-24134fd5-da50-44a4-b9a3-3f0d6368ff86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:23:49.827691 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24134fd5-da50-44a4-b9a3-3f0d6368ff86 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:23:49.862141 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:23:49.908740 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457af3a1-f681-43b7-9329-83555fd94108 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:23:49.909269 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457af3a1-f681-43b7-9329-83555fd94108 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:23:49.909564 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457af3a1-f681-43b7-9329-83555fd94108 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:23:49.909827 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457af3a1-f681-43b7-9329-83555fd94108 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:23:49.911438 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-457af3a1-f681-43b7-9329-83555fd94108 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:23:50.023948 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457af3a1-f681-43b7-9329-83555fd94108 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:23:50.025369 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457af3a1-f681-43b7-9329-83555fd94108 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:23:50.045115 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 735/1458] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:23:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:23:52.231639 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833413be-a1a1-4079-8165-f3125a4e96ea None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:23:52.232184 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833413be-a1a1-4079-8165-f3125a4e96ea None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:23:52.232184 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833413be-a1a1-4079-8165-f3125a4e96ea None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:23:52.233516 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 724/1459] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 03:23:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 03:23:52.238959 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec3dfd-53f2-47a7-88d4-739ebc56ca26 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:23:52.239390 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec3dfd-53f2-47a7-88d4-739ebc56ca26 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:23:52.239534 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec3dfd-53f2-47a7-88d4-739ebc56ca26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:23:52.305219 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-ffec3dfd-53f2-47a7-88d4-739ebc56ca26 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:23:52.306419 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-ffec3dfd-53f2-47a7-88d4-739ebc56ca26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:23:52.314540 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:23:52.405989 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 736/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 03:23:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 03:23:52.690406 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833413be-a1a1-4079-8165-f3125a4e96ea None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:23:52.692116 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-833413be-a1a1-4079-8165-f3125a4e96ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:23:52.794478 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833413be-a1a1-4079-8165-f3125a4e96ea None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:23:52.852696 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:23:52.871711 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87537c37-8bc3-4165-8e72-85a3f5903e89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:23:52.872316 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87537c37-8bc3-4165-8e72-85a3f5903e89 service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:23:52.872593 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87537c37-8bc3-4165-8e72-85a3f5903e89 service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:23:52.872863 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87537c37-8bc3-4165-8e72-85a3f5903e89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:23:52.874451 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-87537c37-8bc3-4165-8e72-85a3f5903e89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:23:52.983602 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87537c37-8bc3-4165-8e72-85a3f5903e89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:23:52.985025 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87537c37-8bc3-4165-8e72-85a3f5903e89 service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:23:53.003293 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 725/1461] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:23:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:23:55.219421 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bed82b-0e34-49d4-a73f-e14bb166e49c None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:23:55.219984 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bed82b-0e34-49d4-a73f-e14bb166e49c None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:23:55.219984 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bed82b-0e34-49d4-a73f-e14bb166e49c None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:23:55.221309 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 737/1462] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 03:23:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:23:55.226501 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811150ce-8771-40f5-a5f7-74bb288be80a None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:23:55.226920 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811150ce-8771-40f5-a5f7-74bb288be80a None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:23:55.227046 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811150ce-8771-40f5-a5f7-74bb288be80a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:23:55.291553 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-811150ce-8771-40f5-a5f7-74bb288be80a None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:23:55.293484 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-811150ce-8771-40f5-a5f7-74bb288be80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:23:55.331771 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:23:55.390066 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 726/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 03:23:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:23:55.673067 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bed82b-0e34-49d4-a73f-e14bb166e49c None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:23:55.674580 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-16bed82b-0e34-49d4-a73f-e14bb166e49c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:23:55.779902 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bed82b-0e34-49d4-a73f-e14bb166e49c None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:23:55.816694 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:23:55.853276 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ae9f98-f96c-4e8e-81f6-00687861a56c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:23:55.853878 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae9f98-f96c-4e8e-81f6-00687861a56c service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:23:55.854159 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae9f98-f96c-4e8e-81f6-00687861a56c service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:23:55.854451 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae9f98-f96c-4e8e-81f6-00687861a56c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:23:55.856380 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-b3ae9f98-f96c-4e8e-81f6-00687861a56c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:23:55.965949 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ae9f98-f96c-4e8e-81f6-00687861a56c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:23:55.967379 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ae9f98-f96c-4e8e-81f6-00687861a56c service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:23:55.985254 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 738/1464] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:23:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:23:58.150903 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7605c40c-b2da-4b04-92fa-bc59ad75eb99 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:23:58.151979 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7605c40c-b2da-4b04-92fa-bc59ad75eb99 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:23:58.151979 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7605c40c-b2da-4b04-92fa-bc59ad75eb99 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:23:58.153319 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 727/1465] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 03:23:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:23:58.158539 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bff787-05d4-427e-aba9-5a04d0c4820e None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:23:58.158935 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bff787-05d4-427e-aba9-5a04d0c4820e None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:23:58.159113 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bff787-05d4-427e-aba9-5a04d0c4820e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:23:58.225932 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-75bff787-05d4-427e-aba9-5a04d0c4820e None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:23:58.227137 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-75bff787-05d4-427e-aba9-5a04d0c4820e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:23:58.246229 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:23:58.327466 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 739/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 03:23:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:23:58.618903 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7605c40c-b2da-4b04-92fa-bc59ad75eb99 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:23:58.621100 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-7605c40c-b2da-4b04-92fa-bc59ad75eb99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:23:58.725536 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7605c40c-b2da-4b04-92fa-bc59ad75eb99 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:23:58.794498 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:23:58.801068 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d6c4c-8450-4f37-85bf-c1881f383101 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:23:58.801667 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d6c4c-8450-4f37-85bf-c1881f383101 service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:23:58.801946 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d6c4c-8450-4f37-85bf-c1881f383101 service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:23:58.802222 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d6c4c-8450-4f37-85bf-c1881f383101 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:23:58.803914 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-d20d6c4c-8450-4f37-85bf-c1881f383101 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:23:58.913321 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20d6c4c-8450-4f37-85bf-c1881f383101 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:23:58.914677 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20d6c4c-8450-4f37-85bf-c1881f383101 service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:23:58.933906 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 728/1467] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:23:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 03:24:01.159109 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed2ed4-27cc-4934-bd96-a18df39f8776 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:24:01.159695 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed2ed4-27cc-4934-bd96-a18df39f8776 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:24:01.159695 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed2ed4-27cc-4934-bd96-a18df39f8776 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:24:01.161018 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 740/1468] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 03:24:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:24:01.166359 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8687f7ad-a999-4edc-8d79-fe15ca3697aa None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:24:01.167387 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8687f7ad-a999-4edc-8d79-fe15ca3697aa None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:24:01.167602 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8687f7ad-a999-4edc-8d79-fe15ca3697aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:24:01.233034 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-8687f7ad-a999-4edc-8d79-fe15ca3697aa None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:24:01.234257 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-8687f7ad-a999-4edc-8d79-fe15ca3697aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:24:01.281083 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:24:01.330043 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 729/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 03:24:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:24:01.616075 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ed2ed4-27cc-4934-bd96-a18df39f8776 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:24:01.617678 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-46ed2ed4-27cc-4934-bd96-a18df39f8776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:24:01.720944 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ed2ed4-27cc-4934-bd96-a18df39f8776 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:24:01.766702 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:24:01.793364 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df2dd0-ff7f-4967-b640-a3b3416fc12e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:24:01.793963 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df2dd0-ff7f-4967-b640-a3b3416fc12e service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:24:01.794246 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df2dd0-ff7f-4967-b640-a3b3416fc12e service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:24:01.794521 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df2dd0-ff7f-4967-b640-a3b3416fc12e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:24:01.796158 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-04df2dd0-ff7f-4967-b640-a3b3416fc12e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:24:01.906285 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04df2dd0-ff7f-4967-b640-a3b3416fc12e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:24:01.907705 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04df2dd0-ff7f-4967-b640-a3b3416fc12e service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:24:01.925475 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 741/1470] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:24:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:24:11.328491 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=22 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:24:11.923093 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=66 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:24:22.058487 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed318f6f-9c1a-4493-9531-c56e47baf9db None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:24:22.059091 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed318f6f-9c1a-4493-9531-c56e47baf9db None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:24:22.059091 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed318f6f-9c1a-4493-9531-c56e47baf9db None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:24:22.060405 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 730/1471] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:24:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:24:22.065735 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb04fb-32f4-4510-a941-fc2a6d71d98b None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:24:22.066133 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb04fb-32f4-4510-a941-fc2a6d71d98b None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:24:22.066288 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb04fb-32f4-4510-a941-fc2a6d71d98b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:24:22.132653 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-4ecb04fb-32f4-4510-a941-fc2a6d71d98b None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:24:22.133857 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-4ecb04fb-32f4-4510-a941-fc2a6d71d98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:24:22.230989 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 742/1472] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:24:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 03:24:22.534042 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9fae1-2229-41a3-9eda-262e09693632 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:24:22.534331 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9fae1-2229-41a3-9eda-262e09693632 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:24:22.534606 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9fae1-2229-41a3-9eda-262e09693632 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:24:22.535992 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 731/1473] 10.222.0.25 () {54 vars in 962 bytes} [Tue Oct 4 03:24:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:24:22.540940 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727884c3-4183-4236-a155-fe3c58da1539 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:24:22.541270 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727884c3-4183-4236-a155-fe3c58da1539 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:24:22.541576 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727884c3-4183-4236-a155-fe3c58da1539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:24:22.619395 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-727884c3-4183-4236-a155-fe3c58da1539 None None] MFA Rules not processed for user `95be0e4e1c8641709e07b115047fb4e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:24:22.620551 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-727884c3-4183-4236-a155-fe3c58da1539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:24:22.642105 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:24:22.699352 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 743/1474] 10.222.0.25 () {58 vars in 1059 bytes} [Tue Oct 4 03:24:22 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:24:22.707319 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c9fae1-2229-41a3-9eda-262e09693632 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:24:22.708893 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-b9c9fae1-2229-41a3-9eda-262e09693632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:24:22.810118 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c9fae1-2229-41a3-9eda-262e09693632 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:24:22.882807 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c8cf5-d100-4bbe-869a-16244de1edfd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95be0e4e1c8641709e07b115047fb4e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:24:22.883329 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c8cf5-d100-4bbe-869a-16244de1edfd service glance] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:24:22.883644 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c8cf5-d100-4bbe-869a-16244de1edfd service glance] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:24:22.883923 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c8cf5-d100-4bbe-869a-16244de1edfd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:24:22.886074 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-c01c8cf5-d100-4bbe-869a-16244de1edfd service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:24:22.940469 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:24:22.997640 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01c8cf5-d100-4bbe-869a-16244de1edfd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:24:22.999063 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01c8cf5-d100-4bbe-869a-16244de1edfd service glance] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:24:23.017777 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 732/1475] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:24:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:24:25.252761 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e86e7b-a71d-47bc-9c51-820a13ea5ea4 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:24:25.253285 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e86e7b-a71d-47bc-9c51-820a13ea5ea4 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:24:25.253403 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e86e7b-a71d-47bc-9c51-820a13ea5ea4 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:24:25.254690 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 744/1476] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:24:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:24:25.260179 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54fd2e-285d-438d-82ec-98257e94f736 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:24:25.260654 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54fd2e-285d-438d-82ec-98257e94f736 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:24:25.260788 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54fd2e-285d-438d-82ec-98257e94f736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:24:25.327544 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-7e54fd2e-285d-438d-82ec-98257e94f736 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:24:25.328764 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-7e54fd2e-285d-438d-82ec-98257e94f736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:24:25.423815 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 733/1477] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:24:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:24:25.701952 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e86e7b-a71d-47bc-9c51-820a13ea5ea4 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:24:25.703514 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-79e86e7b-a71d-47bc-9c51-820a13ea5ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:24:25.834391 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e86e7b-a71d-47bc-9c51-820a13ea5ea4 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:24:25.882498 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:24:25.927281 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca90bcf0-6600-4d8d-a97c-cb20688cd3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:24:25.927847 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90bcf0-6600-4d8d-a97c-cb20688cd3ea admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:24:25.928131 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90bcf0-6600-4d8d-a97c-cb20688cd3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:24:25.928405 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90bcf0-6600-4d8d-a97c-cb20688cd3ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:24:25.929047 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca90bcf0-6600-4d8d-a97c-cb20688cd3ea admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:24:25.930765 dv-cinder-849143-9-smb devstack@keystone.service[81379]: WARNING py.warnings [None req-ca90bcf0-6600-4d8d-a97c-cb20688cd3ea admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 03:24:25.930765 dv-cinder-849143-9-smb devstack@keystone.service[81379]: warnings.warn(msg) Oct 04 03:24:25.930765 dv-cinder-849143-9-smb devstack@keystone.service[81379]: Oct 04 03:24:25.932506 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca90bcf0-6600-4d8d-a97c-cb20688cd3ea admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:24:25.952049 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 745/1478] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 03:24:25 2022] GET /identity/v3/projects => generated 2553 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:24:28.143591 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d69215-21db-4b60-90f5-5a02f56d4891 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:24:28.144165 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d69215-21db-4b60-90f5-5a02f56d4891 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:24:28.144165 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d69215-21db-4b60-90f5-5a02f56d4891 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:24:28.145523 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 734/1479] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:24:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:24:28.151605 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763777a-df63-4594-be56-cbe188257b6b None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:24:28.152015 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763777a-df63-4594-be56-cbe188257b6b None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:24:28.152206 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763777a-df63-4594-be56-cbe188257b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:24:28.218344 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-1763777a-df63-4594-be56-cbe188257b6b None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:24:28.219595 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-1763777a-df63-4594-be56-cbe188257b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:24:28.326245 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 746/1480] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:24:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:24:28.617817 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d69215-21db-4b60-90f5-5a02f56d4891 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:24:28.619555 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-12d69215-21db-4b60-90f5-5a02f56d4891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:24:28.630228 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:24:28.774008 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d69215-21db-4b60-90f5-5a02f56d4891 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:24:28.854837 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:24:28.887729 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a664d3d-c955-4bd6-9c50-e8ec2b165c15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1f412befb9418fa66a2aabf475aa90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:24:28.888328 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a664d3d-c955-4bd6-9c50-e8ec2b165c15 service nova] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:24:28.888607 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a664d3d-c955-4bd6-9c50-e8ec2b165c15 service nova] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:24:28.888879 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a664d3d-c955-4bd6-9c50-e8ec2b165c15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:24:28.890467 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-2a664d3d-c955-4bd6-9c50-e8ec2b165c15 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:24:28.987191 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a664d3d-c955-4bd6-9c50-e8ec2b165c15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:24:28.988802 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a664d3d-c955-4bd6-9c50-e8ec2b165c15 service nova] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:24:29.006515 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 735/1481] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:24:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:24:31.364243 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7258b386-1199-400a-85da-9a82a81ac606 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:24:31.364830 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7258b386-1199-400a-85da-9a82a81ac606 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:24:31.364830 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7258b386-1199-400a-85da-9a82a81ac606 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:24:31.366125 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 747/1482] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:24:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:24:31.371420 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9743d5e0-0acf-4939-8f2c-c34ab0552ad9 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:24:31.371850 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9743d5e0-0acf-4939-8f2c-c34ab0552ad9 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:24:31.372001 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9743d5e0-0acf-4939-8f2c-c34ab0552ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:24:31.436180 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-9743d5e0-0acf-4939-8f2c-c34ab0552ad9 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:24:31.437363 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-9743d5e0-0acf-4939-8f2c-c34ab0552ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:24:31.483114 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:24:31.533366 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 736/1483] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:24:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:24:31.823733 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7258b386-1199-400a-85da-9a82a81ac606 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:24:31.825268 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-7258b386-1199-400a-85da-9a82a81ac606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:24:31.847772 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:24:31.927883 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7258b386-1199-400a-85da-9a82a81ac606 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:24:32.000586 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e471b89f-015e-4061-8f57-9fcba14b20ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:24:32.001186 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471b89f-015e-4061-8f57-9fcba14b20ea service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:24:32.001470 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471b89f-015e-4061-8f57-9fcba14b20ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:24:32.001747 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471b89f-015e-4061-8f57-9fcba14b20ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:24:32.003348 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-e471b89f-015e-4061-8f57-9fcba14b20ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:24:32.085088 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:24:32.120808 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e471b89f-015e-4061-8f57-9fcba14b20ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:24:32.122234 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e471b89f-015e-4061-8f57-9fcba14b20ea service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:24:32.139840 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 748/1484] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:24:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:24:34.337665 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db284c-037c-44da-b8e5-99b5dc65c78a None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:24:34.338375 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db284c-037c-44da-b8e5-99b5dc65c78a None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:24:34.338375 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db284c-037c-44da-b8e5-99b5dc65c78a None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:24:34.339558 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 737/1485] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:24:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:24:34.344775 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc66d386-4245-4b2f-9e51-e67dbe36e4ec None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:24:34.345173 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc66d386-4245-4b2f-9e51-e67dbe36e4ec None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:24:34.345365 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc66d386-4245-4b2f-9e51-e67dbe36e4ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:24:34.411632 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-dc66d386-4245-4b2f-9e51-e67dbe36e4ec None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:24:34.412836 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-dc66d386-4245-4b2f-9e51-e67dbe36e4ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:24:34.508441 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 749/1486] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:24:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:24:34.799748 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2db284c-037c-44da-b8e5-99b5dc65c78a None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:24:34.801288 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-f2db284c-037c-44da-b8e5-99b5dc65c78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:24:34.907107 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2db284c-037c-44da-b8e5-99b5dc65c78a None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:24:34.980662 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:24:34.982131 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dcc686-9174-49b9-a61d-f0005e25b4f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:24:34.982774 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dcc686-9174-49b9-a61d-f0005e25b4f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:24:34.983051 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dcc686-9174-49b9-a61d-f0005e25b4f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:24:34.983320 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dcc686-9174-49b9-a61d-f0005e25b4f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:24:34.985530 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-44dcc686-9174-49b9-a61d-f0005e25b4f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:24:35.094661 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dcc686-9174-49b9-a61d-f0005e25b4f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:24:35.096118 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dcc686-9174-49b9-a61d-f0005e25b4f2 service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:24:35.114476 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 738/1487] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:24:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:24:37.445783 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e6a77-9640-45a0-a567-8fdc6f29662e None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:24:37.446936 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e6a77-9640-45a0-a567-8fdc6f29662e None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:24:37.446936 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e6a77-9640-45a0-a567-8fdc6f29662e None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:24:37.448239 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 750/1488] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:24:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:24:37.453589 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93be5ab-dea8-4ec9-8178-63d294881f0b None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:24:37.453996 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93be5ab-dea8-4ec9-8178-63d294881f0b None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:24:37.454145 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93be5ab-dea8-4ec9-8178-63d294881f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:24:37.519537 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-d93be5ab-dea8-4ec9-8178-63d294881f0b None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:24:37.520747 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-d93be5ab-dea8-4ec9-8178-63d294881f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:24:37.573308 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:24:37.617752 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 739/1489] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:24:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:24:37.924262 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e6a77-9640-45a0-a567-8fdc6f29662e None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:24:37.925828 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-372e6a77-9640-45a0-a567-8fdc6f29662e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:24:37.962427 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:24:38.040360 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e6a77-9640-45a0-a567-8fdc6f29662e None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:24:38.123597 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4616104-5baf-40d9-8653-f8e815f613c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:24:38.124199 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4616104-5baf-40d9-8653-f8e815f613c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:24:38.124481 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4616104-5baf-40d9-8653-f8e815f613c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:24:38.124755 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4616104-5baf-40d9-8653-f8e815f613c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:24:38.126342 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-e4616104-5baf-40d9-8653-f8e815f613c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:24:38.206185 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:24:38.235612 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4616104-5baf-40d9-8653-f8e815f613c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:24:38.237024 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4616104-5baf-40d9-8653-f8e815f613c1 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:24:38.255357 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 751/1490] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:24:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:24:40.613840 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3345fd8b-901c-4047-bfa9-31500c415610 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:24:40.614421 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3345fd8b-901c-4047-bfa9-31500c415610 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:24:40.614421 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3345fd8b-901c-4047-bfa9-31500c415610 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:24:40.615744 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 740/1491] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 03:24:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:24:40.621004 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa587a-9a0c-45dc-982a-902ab94ea0a8 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:24:40.621444 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa587a-9a0c-45dc-982a-902ab94ea0a8 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:24:40.621634 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa587a-9a0c-45dc-982a-902ab94ea0a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:24:40.688226 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-4caa587a-9a0c-45dc-982a-902ab94ea0a8 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:24:40.689435 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-4caa587a-9a0c-45dc-982a-902ab94ea0a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:24:40.785712 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 752/1492] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 03:24:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:24:41.081008 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3345fd8b-901c-4047-bfa9-31500c415610 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:24:41.082559 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-3345fd8b-901c-4047-bfa9-31500c415610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:24:41.183925 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3345fd8b-901c-4047-bfa9-31500c415610 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:24:41.257956 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3554d2-b640-497d-9368-c1dec60b9301 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:24:41.259275 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3554d2-b640-497d-9368-c1dec60b9301 service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:24:41.259657 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3554d2-b640-497d-9368-c1dec60b9301 service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:24:41.259960 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3554d2-b640-497d-9368-c1dec60b9301 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:24:41.261571 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-1d3554d2-b640-497d-9368-c1dec60b9301 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:24:41.270078 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:24:41.373338 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3554d2-b640-497d-9368-c1dec60b9301 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:24:41.374751 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3554d2-b640-497d-9368-c1dec60b9301 service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:24:41.392952 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 741/1493] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:24:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:24:50.784185 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=82 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:24:51.390652 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=50 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:25:54.824014 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f615aad-b10f-4cb4-86ba-065e9f856bd9 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:25:54.824609 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f615aad-b10f-4cb4-86ba-065e9f856bd9 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:25:54.824609 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f615aad-b10f-4cb4-86ba-065e9f856bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:25:54.905541 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-5f615aad-b10f-4cb4-86ba-065e9f856bd9 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:25:54.906664 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-5f615aad-b10f-4cb4-86ba-065e9f856bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:25:55.007987 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 753/1494] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:25:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:25:55.015730 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc74b6-8457-44ba-958d-667cc8b7f64a None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:25:55.016264 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc74b6-8457-44ba-958d-667cc8b7f64a None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:25:55.016264 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc74b6-8457-44ba-958d-667cc8b7f64a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:25:55.101944 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-2edc74b6-8457-44ba-958d-667cc8b7f64a None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:25:55.103151 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-2edc74b6-8457-44ba-958d-667cc8b7f64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:25:55.202381 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 742/1495] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:25:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:25:55.206998 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f615aad-b10f-4cb4-86ba-065e9f856bd9 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:25:55.208837 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-5f615aad-b10f-4cb4-86ba-065e9f856bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:25:55.220202 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f615aad-b10f-4cb4-86ba-065e9f856bd9 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:25:55.286401 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:25:55.323477 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f9f671-4a85-4662-a70b-c2cc62ca7262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:25:55.324120 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f9f671-4a85-4662-a70b-c2cc62ca7262 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:25:55.324405 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f9f671-4a85-4662-a70b-c2cc62ca7262 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:25:55.324681 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f9f671-4a85-4662-a70b-c2cc62ca7262 admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:25:55.325357 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f9f671-4a85-4662-a70b-c2cc62ca7262 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:25:55.325684 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f9f671-4a85-4662-a70b-c2cc62ca7262 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:25:55.326677 dv-cinder-849143-9-smb devstack@keystone.service[81379]: WARNING py.warnings [None req-86f9f671-4a85-4662-a70b-c2cc62ca7262 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 03:25:55.326677 dv-cinder-849143-9-smb devstack@keystone.service[81379]: warnings.warn(msg) Oct 04 03:25:55.326677 dv-cinder-849143-9-smb devstack@keystone.service[81379]: Oct 04 03:25:55.327600 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f9f671-4a85-4662-a70b-c2cc62ca7262 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:25:55.339721 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 754/1496] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 03:25:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:25:55.348239 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edc74b6-8457-44ba-958d-667cc8b7f64a None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:25:55.357439 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edc74b6-8457-44ba-958d-667cc8b7f64a None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:25:55.425193 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:25:55.461044 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a965e1-4aa1-4033-84d7-5322faeafb00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:25:55.461566 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a965e1-4aa1-4033-84d7-5322faeafb00 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:25:55.461847 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a965e1-4aa1-4033-84d7-5322faeafb00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:25:55.462119 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a965e1-4aa1-4033-84d7-5322faeafb00 admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:25:55.462740 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a965e1-4aa1-4033-84d7-5322faeafb00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:25:55.464482 dv-cinder-849143-9-smb devstack@keystone.service[81380]: WARNING py.warnings [None req-b5a965e1-4aa1-4033-84d7-5322faeafb00 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 03:25:55.464482 dv-cinder-849143-9-smb devstack@keystone.service[81380]: warnings.warn(msg) Oct 04 03:25:55.464482 dv-cinder-849143-9-smb devstack@keystone.service[81380]: Oct 04 03:25:55.465672 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a965e1-4aa1-4033-84d7-5322faeafb00 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:25:55.520425 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 743/1497] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:25:55 2022] POST /identity/v3/projects => generated 379 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:25:55.525132 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f9f671-4a85-4662-a70b-c2cc62ca7262 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:25:55.526641 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-86f9f671-4a85-4662-a70b-c2cc62ca7262 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:25:55.559843 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f9f671-4a85-4662-a70b-c2cc62ca7262 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:25:55.657937 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc73a75a-dd5c-47e7-94b1-4889cd560006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:25:55.658535 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc73a75a-dd5c-47e7-94b1-4889cd560006 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:25:55.658809 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc73a75a-dd5c-47e7-94b1-4889cd560006 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:25:55.659077 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc73a75a-dd5c-47e7-94b1-4889cd560006 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:25:55.659727 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc73a75a-dd5c-47e7-94b1-4889cd560006 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:25:55.660720 dv-cinder-849143-9-smb devstack@keystone.service[81379]: WARNING py.warnings [None req-cc73a75a-dd5c-47e7-94b1-4889cd560006 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 03:25:55.660720 dv-cinder-849143-9-smb devstack@keystone.service[81379]: warnings.warn(msg) Oct 04 03:25:55.660720 dv-cinder-849143-9-smb devstack@keystone.service[81379]: Oct 04 03:25:55.661987 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc73a75a-dd5c-47e7-94b1-4889cd560006 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:25:55.704209 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 755/1498] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:25:55 2022] POST /identity/v3/users => generated 290 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:25:55.708433 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a965e1-4aa1-4033-84d7-5322faeafb00 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:25:55.710184 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-b5a965e1-4aa1-4033-84d7-5322faeafb00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:25:55.772257 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a965e1-4aa1-4033-84d7-5322faeafb00 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:25:55.854753 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:25:55.873623 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc94858c-3f86-41cf-ba01-e5ba11b20e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:25:55.874255 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc94858c-3f86-41cf-ba01-e5ba11b20e1d admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:25:55.874561 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc94858c-3f86-41cf-ba01-e5ba11b20e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:25:55.874835 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc94858c-3f86-41cf-ba01-e5ba11b20e1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:25:55.875595 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc94858c-3f86-41cf-ba01-e5ba11b20e1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:25:55.876714 dv-cinder-849143-9-smb devstack@keystone.service[81380]: WARNING py.warnings [None req-fc94858c-3f86-41cf-ba01-e5ba11b20e1d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 03:25:55.876714 dv-cinder-849143-9-smb devstack@keystone.service[81380]: warnings.warn(msg) Oct 04 03:25:55.876714 dv-cinder-849143-9-smb devstack@keystone.service[81380]: Oct 04 03:25:55.877851 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc94858c-3f86-41cf-ba01-e5ba11b20e1d admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:25:55.891171 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 744/1499] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:25:55 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:25:55.895232 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc73a75a-dd5c-47e7-94b1-4889cd560006 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:25:55.897390 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-cc73a75a-dd5c-47e7-94b1-4889cd560006 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:25:55.908536 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc73a75a-dd5c-47e7-94b1-4889cd560006 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:25:55.933222 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:25:56.003785 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07084030-54ca-4857-8cf7-34ccd412f9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:25:56.004387 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07084030-54ca-4857-8cf7-34ccd412f9ac admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:25:56.004670 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07084030-54ca-4857-8cf7-34ccd412f9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:25:56.004941 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07084030-54ca-4857-8cf7-34ccd412f9ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:25:56.005889 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07084030-54ca-4857-8cf7-34ccd412f9ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:25:56.006894 dv-cinder-849143-9-smb devstack@keystone.service[81379]: WARNING py.warnings [None req-07084030-54ca-4857-8cf7-34ccd412f9ac admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 03:25:56.006894 dv-cinder-849143-9-smb devstack@keystone.service[81379]: warnings.warn(msg) Oct 04 03:25:56.006894 dv-cinder-849143-9-smb devstack@keystone.service[81379]: Oct 04 03:25:56.007803 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07084030-54ca-4857-8cf7-34ccd412f9ac admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:25:56.019948 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 756/1500] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:25:55 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:25:56.024972 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc94858c-3f86-41cf-ba01-e5ba11b20e1d admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:25:56.026426 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-fc94858c-3f86-41cf-ba01-e5ba11b20e1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:25:56.061425 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc94858c-3f86-41cf-ba01-e5ba11b20e1d admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:25:56.155820 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1f0dc7-cf95-4442-b736-32fbdf6dabb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:25:56.156463 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1f0dc7-cf95-4442-b736-32fbdf6dabb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:25:56.156739 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1f0dc7-cf95-4442-b736-32fbdf6dabb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:25:56.157010 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1f0dc7-cf95-4442-b736-32fbdf6dabb3 admin admin] PATH_INFO: `/v3/projects/e98166d595cd437581116769f3dd44a4/users/a798271bb0bc44979d7945db3f49641d/roles/04d0e4575a28440eb4349b4a6565e8b8` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:25:56.179216 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1f0dc7-cf95-4442-b736-32fbdf6dabb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e98166d595cd437581116769f3dd44a4, user_id=a798271bb0bc44979d7945db3f49641d, role_id=04d0e4575a28440eb4349b4a6565e8b8)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:25:56.180401 dv-cinder-849143-9-smb devstack@keystone.service[81380]: WARNING py.warnings [None req-db1f0dc7-cf95-4442-b736-32fbdf6dabb3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 03:25:56.180401 dv-cinder-849143-9-smb devstack@keystone.service[81380]: warnings.warn(msg) Oct 04 03:25:56.180401 dv-cinder-849143-9-smb devstack@keystone.service[81380]: Oct 04 03:25:56.182306 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1f0dc7-cf95-4442-b736-32fbdf6dabb3 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:25:56.207130 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 745/1501] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:25:56 2022] PUT /identity/v3/projects/e98166d595cd437581116769f3dd44a4/users/a798271bb0bc44979d7945db3f49641d/roles/04d0e4575a28440eb4349b4a6565e8b8 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:25:56.220148 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee22b8-6dee-41ac-a137-caff6ebe462c None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:25:56.220433 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee22b8-6dee-41ac-a137-caff6ebe462c None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:25:56.220708 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee22b8-6dee-41ac-a137-caff6ebe462c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:25:56.279144 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-2bee22b8-6dee-41ac-a137-caff6ebe462c None None] MFA Rules not processed for user `a798271bb0bc44979d7945db3f49641d`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:25:56.280400 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-2bee22b8-6dee-41ac-a137-caff6ebe462c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:25:56.359041 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 757/1502] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:25:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:25:56.372545 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3bdb9-03a7-4ef8-bac8-f6841b81ed0a None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:25:56.372835 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3bdb9-03a7-4ef8-bac8-f6841b81ed0a None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:25:56.373115 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3bdb9-03a7-4ef8-bac8-f6841b81ed0a None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:25:56.374579 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 746/1503] 10.222.0.25 () {54 vars in 963 bytes} [Tue Oct 4 03:25:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 03:25:56.379062 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f579e4ee-4818-437d-a40a-232d4be567d4 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:25:56.379350 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f579e4ee-4818-437d-a40a-232d4be567d4 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:25:56.379655 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f579e4ee-4818-437d-a40a-232d4be567d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:25:56.417104 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:25:56.462788 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-f579e4ee-4818-437d-a40a-232d4be567d4 None None] MFA Rules not processed for user `f537aabf3d1040ff840b02616f839975`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:25:56.464032 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-f579e4ee-4818-437d-a40a-232d4be567d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:25:56.538256 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 758/1504] 10.222.0.25 () {58 vars in 1060 bytes} [Tue Oct 4 03:25:56 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:25:56.545853 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c3bdb9-03a7-4ef8-bac8-f6841b81ed0a None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:25:56.547382 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-14c3bdb9-03a7-4ef8-bac8-f6841b81ed0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:25:56.597282 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:25:56.654629 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c3bdb9-03a7-4ef8-bac8-f6841b81ed0a None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:25:56.735616 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dabe9f-5b43-491d-bcce-3fe160b7098e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f537aabf3d1040ff840b02616f839975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:25:56.736210 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dabe9f-5b43-491d-bcce-3fe160b7098e service cinder] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:25:56.736492 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dabe9f-5b43-491d-bcce-3fe160b7098e service cinder] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:25:56.736762 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dabe9f-5b43-491d-bcce-3fe160b7098e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:25:56.738352 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-f3dabe9f-5b43-491d-bcce-3fe160b7098e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:25:56.837577 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dabe9f-5b43-491d-bcce-3fe160b7098e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:25:56.838924 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dabe9f-5b43-491d-bcce-3fe160b7098e service cinder] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:25:56.842372 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:25:56.856660 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 747/1505] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:25:56 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 03:25:56.901950 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234ff34-5c22-4240-b2df-43c2b287a8e4 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:25:56.902371 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234ff34-5c22-4240-b2df-43c2b287a8e4 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:25:56.902503 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234ff34-5c22-4240-b2df-43c2b287a8e4 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:25:56.903910 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 759/1506] 10.222.0.25 () {52 vars in 830 bytes} [Tue Oct 4 03:25:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:25:56.907235 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dabe9f-5b43-491d-bcce-3fe160b7098e service cinder] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:25:56.908467 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-f3dabe9f-5b43-491d-bcce-3fe160b7098e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:25:57.008866 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dabe9f-5b43-491d-bcce-3fe160b7098e service cinder] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:25:57.106973 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b39da0c-bea4-4908-9e8e-dc8e785cf63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:25:57.107663 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b39da0c-bea4-4908-9e8e-dc8e785cf63a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:25:57.107799 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b39da0c-bea4-4908-9e8e-dc8e785cf63a admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:25:57.108067 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b39da0c-bea4-4908-9e8e-dc8e785cf63a admin admin] PATH_INFO: `/v3/users/a798271bb0bc44979d7945db3f49641d` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:25:57.121539 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b39da0c-bea4-4908-9e8e-dc8e785cf63a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a798271bb0bc44979d7945db3f49641d)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:25:57.122566 dv-cinder-849143-9-smb devstack@keystone.service[81380]: WARNING py.warnings [None req-1b39da0c-bea4-4908-9e8e-dc8e785cf63a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 03:25:57.122566 dv-cinder-849143-9-smb devstack@keystone.service[81380]: warnings.warn(msg) Oct 04 03:25:57.122566 dv-cinder-849143-9-smb devstack@keystone.service[81380]: Oct 04 03:25:57.123845 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b39da0c-bea4-4908-9e8e-dc8e785cf63a admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:25:57.133872 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:25:57.189869 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-1b39da0c-bea4-4908-9e8e-dc8e785cf63a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a798271bb0bc44979d7945db3f49641d'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:25:57.203828 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-1b39da0c-bea4-4908-9e8e-dc8e785cf63a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a798271bb0bc44979d7945db3f49641d'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:25:57.213741 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-1b39da0c-bea4-4908-9e8e-dc8e785cf63a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a798271bb0bc44979d7945db3f49641d'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:25:57.214181 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-1b39da0c-bea4-4908-9e8e-dc8e785cf63a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a798271bb0bc44979d7945db3f49641d'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:25:57.237659 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-1b39da0c-bea4-4908-9e8e-dc8e785cf63a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a798271bb0bc44979d7945db3f49641d'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:25:57.243563 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 748/1507] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:25:56 2022] DELETE /identity/v3/users/a798271bb0bc44979d7945db3f49641d => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:25:57.247844 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee18922-36df-47f1-95b0-3676f3399c9a None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:25:57.248137 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee18922-36df-47f1-95b0-3676f3399c9a None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:25:57.248413 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee18922-36df-47f1-95b0-3676f3399c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:25:57.306087 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-5ee18922-36df-47f1-95b0-3676f3399c9a None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:25:57.307300 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-5ee18922-36df-47f1-95b0-3676f3399c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:25:57.383572 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:25:57.396720 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 760/1508] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:25:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:25:57.406259 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b39da0c-bea4-4908-9e8e-dc8e785cf63a admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:25:57.407510 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-1b39da0c-bea4-4908-9e8e-dc8e785cf63a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:25:57.505427 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b39da0c-bea4-4908-9e8e-dc8e785cf63a admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:25:57.561419 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:25:57.582599 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005a1f64-30f7-4cdd-9a29-27140e00296d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:25:57.583812 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a1f64-30f7-4cdd-9a29-27140e00296d service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:25:57.584102 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a1f64-30f7-4cdd-9a29-27140e00296d service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:25:57.584372 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a1f64-30f7-4cdd-9a29-27140e00296d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:25:57.585989 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-005a1f64-30f7-4cdd-9a29-27140e00296d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:25:57.697469 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005a1f64-30f7-4cdd-9a29-27140e00296d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:25:57.698900 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005a1f64-30f7-4cdd-9a29-27140e00296d service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:25:57.716985 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 749/1509] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:25:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:25:58.061287 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee18922-36df-47f1-95b0-3676f3399c9a None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:25:58.062511 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-5ee18922-36df-47f1-95b0-3676f3399c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:25:58.074398 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee18922-36df-47f1-95b0-3676f3399c9a None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:25:58.174573 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc76d4f3-6c79-4b54-92b2-244b61d8c122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:25:58.175209 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76d4f3-6c79-4b54-92b2-244b61d8c122 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:25:58.175509 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76d4f3-6c79-4b54-92b2-244b61d8c122 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:25:58.175792 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76d4f3-6c79-4b54-92b2-244b61d8c122 admin admin] PATH_INFO: `/v3/projects/e98166d595cd437581116769f3dd44a4` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:25:58.186574 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc76d4f3-6c79-4b54-92b2-244b61d8c122 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e98166d595cd437581116769f3dd44a4)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:25:58.187639 dv-cinder-849143-9-smb devstack@keystone.service[81379]: WARNING py.warnings [None req-dc76d4f3-6c79-4b54-92b2-244b61d8c122 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 03:25:58.187639 dv-cinder-849143-9-smb devstack@keystone.service[81379]: warnings.warn(msg) Oct 04 03:25:58.187639 dv-cinder-849143-9-smb devstack@keystone.service[81379]: Oct 04 03:25:58.188829 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc76d4f3-6c79-4b54-92b2-244b61d8c122 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:25:58.248990 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-dc76d4f3-6c79-4b54-92b2-244b61d8c122 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e98166d595cd437581116769f3dd44a4', 'request_id': 'req-dc76d4f3-6c79-4b54-92b2-244b61d8c122'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:25:58.254934 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-dc76d4f3-6c79-4b54-92b2-244b61d8c122 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e98166d595cd437581116769f3dd44a4', 'request_id': 'req-dc76d4f3-6c79-4b54-92b2-244b61d8c122'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:25:58.268070 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-dc76d4f3-6c79-4b54-92b2-244b61d8c122 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e98166d595cd437581116769f3dd44a4', 'request_id': 'req-dc76d4f3-6c79-4b54-92b2-244b61d8c122'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:25:58.294643 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-dc76d4f3-6c79-4b54-92b2-244b61d8c122 admin admin] The token cache is being invalidate because project e98166d595cd437581116769f3dd44a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:25:58.294935 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-dc76d4f3-6c79-4b54-92b2-244b61d8c122 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:25:58.295369 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-dc76d4f3-6c79-4b54-92b2-244b61d8c122 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:25:58.296838 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 761/1510] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:25:58 2022] DELETE /identity/v3/projects/e98166d595cd437581116769f3dd44a4 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:26:07.714741 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=62 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:26:08.292671 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:27:27.897773 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da76bb30-ed69-4a3e-a305-39b3b05e9100 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:27:27.898333 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da76bb30-ed69-4a3e-a305-39b3b05e9100 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:27:27.898333 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da76bb30-ed69-4a3e-a305-39b3b05e9100 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:27:27.899633 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 750/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 03:27:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:27:27.904510 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b882813-6cac-4aa8-87a8-7bf3d4e32b39 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:27:27.904942 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b882813-6cac-4aa8-87a8-7bf3d4e32b39 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:27:27.905046 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b882813-6cac-4aa8-87a8-7bf3d4e32b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:27:27.984167 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-2b882813-6cac-4aa8-87a8-7bf3d4e32b39 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:27:27.985358 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-2b882813-6cac-4aa8-87a8-7bf3d4e32b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:27:28.087148 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 762/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 03:27:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:27:28.246014 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da76bb30-ed69-4a3e-a305-39b3b05e9100 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:27:28.248121 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-da76bb30-ed69-4a3e-a305-39b3b05e9100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:27:28.367106 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da76bb30-ed69-4a3e-a305-39b3b05e9100 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:27:28.372743 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7bd7f2-e51c-4357-b3af-6c8872c7c5f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1f412befb9418fa66a2aabf475aa90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:27:28.373344 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7bd7f2-e51c-4357-b3af-6c8872c7c5f3 service nova] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:27:28.373628 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7bd7f2-e51c-4357-b3af-6c8872c7c5f3 service nova] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:27:28.373901 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7bd7f2-e51c-4357-b3af-6c8872c7c5f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:27:28.381805 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7bd7f2-e51c-4357-b3af-6c8872c7c5f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:27:28.384283 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7bd7f2-e51c-4357-b3af-6c8872c7c5f3 service nova] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:27:28.393709 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 751/1513] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:27:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:27:29.484883 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f05eb-2562-4af4-8b30-b823b99f3efe None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:27:29.485450 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f05eb-2562-4af4-8b30-b823b99f3efe None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:27:29.485450 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f05eb-2562-4af4-8b30-b823b99f3efe None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:27:29.486828 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 763/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 03:27:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:27:29.494551 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3ea2d-4970-436e-b107-e8642ccd3294 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:27:29.495045 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3ea2d-4970-436e-b107-e8642ccd3294 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:27:29.495144 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3ea2d-4970-436e-b107-e8642ccd3294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:27:29.514233 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-e8c3ea2d-4970-436e-b107-e8642ccd3294 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:27:29.515431 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-e8c3ea2d-4970-436e-b107-e8642ccd3294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:27:29.523839 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 752/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 03:27:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:27:29.676177 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f05eb-2562-4af4-8b30-b823b99f3efe None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:27:29.690257 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f05eb-2562-4af4-8b30-b823b99f3efe None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:27:29.696385 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee8d60-4f7c-4f33-a93b-84e528479ba2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1f412befb9418fa66a2aabf475aa90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:27:29.696977 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee8d60-4f7c-4f33-a93b-84e528479ba2 service nova] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:27:29.697254 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee8d60-4f7c-4f33-a93b-84e528479ba2 service nova] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:27:29.697523 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee8d60-4f7c-4f33-a93b-84e528479ba2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:27:29.705312 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ee8d60-4f7c-4f33-a93b-84e528479ba2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:27:29.706867 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ee8d60-4f7c-4f33-a93b-84e528479ba2 service nova] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:27:29.716690 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 764/1516] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:27:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:27:30.035893 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a27b1-2f34-4f0f-a827-7ba7f0352534 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:27:30.036178 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a27b1-2f34-4f0f-a827-7ba7f0352534 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:27:30.036448 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a27b1-2f34-4f0f-a827-7ba7f0352534 None None] PATH_INFO: `/v3` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:27:30.037722 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 753/1517] 10.222.0.33 () {54 vars in 925 bytes} [Tue Oct 4 03:27:30 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:27:30.044840 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e1f744-fa7c-421b-8e42-cd02e152ff3f None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:27:30.045134 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e1f744-fa7c-421b-8e42-cd02e152ff3f None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:27:30.045415 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e1f744-fa7c-421b-8e42-cd02e152ff3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:27:30.104501 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-86e1f744-fa7c-421b-8e42-cd02e152ff3f None None] MFA Rules not processed for user `94513f6cd19f495e842deb3c13c3e4d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:27:30.105711 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-86e1f744-fa7c-421b-8e42-cd02e152ff3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:27:30.122835 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:27:30.180114 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 765/1518] 10.222.0.33 () {58 vars in 1015 bytes} [Tue Oct 4 03:27:30 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:27:33.752700 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca0bf3-dc92-446e-8930-ec58e92cc32a None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:27:33.753147 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca0bf3-dc92-446e-8930-ec58e92cc32a None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:27:33.753246 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca0bf3-dc92-446e-8930-ec58e92cc32a None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:27:33.754572 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 754/1519] 10.222.0.25 () {54 vars in 961 bytes} [Tue Oct 4 03:27:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:27:33.759703 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f51c8d7-c020-450f-8a7b-2c5f9a87605b None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:27:33.760158 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f51c8d7-c020-450f-8a7b-2c5f9a87605b None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:27:33.760291 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f51c8d7-c020-450f-8a7b-2c5f9a87605b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:27:33.779396 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-3f51c8d7-c020-450f-8a7b-2c5f9a87605b None None] MFA Rules not processed for user `94513f6cd19f495e842deb3c13c3e4d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:27:33.780606 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-3f51c8d7-c020-450f-8a7b-2c5f9a87605b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:27:33.789974 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 766/1520] 10.222.0.25 () {58 vars in 1058 bytes} [Tue Oct 4 03:27:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:27:33.797423 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca0bf3-dc92-446e-8930-ec58e92cc32a None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:27:33.811401 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca0bf3-dc92-446e-8930-ec58e92cc32a None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:27:33.816341 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9071fa-9d67-46f8-95a0-e264f716b93f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94513f6cd19f495e842deb3c13c3e4d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:27:33.816921 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9071fa-9d67-46f8-95a0-e264f716b93f service placement] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:27:33.817200 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9071fa-9d67-46f8-95a0-e264f716b93f service placement] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:27:33.817472 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9071fa-9d67-46f8-95a0-e264f716b93f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:27:33.825725 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9071fa-9d67-46f8-95a0-e264f716b93f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:27:33.827266 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9071fa-9d67-46f8-95a0-e264f716b93f service placement] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:27:33.837107 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 755/1521] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:27:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 03:27:41.210775 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf639f5-fd88-4bf9-aa28-b9c90054e97e None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:27:41.211372 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf639f5-fd88-4bf9-aa28-b9c90054e97e None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:27:41.211372 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf639f5-fd88-4bf9-aa28-b9c90054e97e None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:27:41.212710 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 767/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 03:27:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:27:41.218917 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ccc5da-add0-4485-9437-e44833d51f5e None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:27:41.219336 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ccc5da-add0-4485-9437-e44833d51f5e None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:27:41.219475 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ccc5da-add0-4485-9437-e44833d51f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:27:41.239209 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-37ccc5da-add0-4485-9437-e44833d51f5e None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:27:41.240452 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-37ccc5da-add0-4485-9437-e44833d51f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:27:41.248841 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 756/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 03:27:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:27:41.404987 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf639f5-fd88-4bf9-aa28-b9c90054e97e None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:27:41.420277 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf639f5-fd88-4bf9-aa28-b9c90054e97e None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:27:41.425754 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7822f194-417d-4f1b-9af2-7d4bd5333a1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1f412befb9418fa66a2aabf475aa90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:27:41.426337 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7822f194-417d-4f1b-9af2-7d4bd5333a1a service nova] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:27:41.426622 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7822f194-417d-4f1b-9af2-7d4bd5333a1a service nova] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:27:41.426899 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7822f194-417d-4f1b-9af2-7d4bd5333a1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:27:41.435136 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7822f194-417d-4f1b-9af2-7d4bd5333a1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:27:41.436746 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7822f194-417d-4f1b-9af2-7d4bd5333a1a service nova] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:27:41.446265 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 768/1524] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:27:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:27:42.515552 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0acfc91-11cb-4733-bf53-b13e6fd47b91 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:27:42.516149 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0acfc91-11cb-4733-bf53-b13e6fd47b91 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:27:42.516149 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0acfc91-11cb-4733-bf53-b13e6fd47b91 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:27:42.517455 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 757/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 03:27:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:27:42.524325 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438415c2-9399-42d2-8e5c-dc148e3316e6 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:27:42.524774 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438415c2-9399-42d2-8e5c-dc148e3316e6 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:27:42.524886 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438415c2-9399-42d2-8e5c-dc148e3316e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:27:42.543895 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-438415c2-9399-42d2-8e5c-dc148e3316e6 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:27:42.545079 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-438415c2-9399-42d2-8e5c-dc148e3316e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:27:42.552709 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 769/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 03:27:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:27:42.707469 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0acfc91-11cb-4733-bf53-b13e6fd47b91 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:27:42.726312 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0acfc91-11cb-4733-bf53-b13e6fd47b91 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:27:42.731739 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba101163-6466-4e8a-b3c9-399e3db91d1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1f412befb9418fa66a2aabf475aa90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:27:42.732321 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba101163-6466-4e8a-b3c9-399e3db91d1f service nova] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:27:42.732597 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba101163-6466-4e8a-b3c9-399e3db91d1f service nova] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:27:42.732867 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba101163-6466-4e8a-b3c9-399e3db91d1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:27:42.740919 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba101163-6466-4e8a-b3c9-399e3db91d1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:27:42.742512 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba101163-6466-4e8a-b3c9-399e3db91d1f service nova] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:27:42.751767 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 758/1527] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:27:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:27:46.713780 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c36954b-e58b-4c89-ad9a-e8a3d2893749 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:27:46.714344 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c36954b-e58b-4c89-ad9a-e8a3d2893749 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:27:46.714344 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c36954b-e58b-4c89-ad9a-e8a3d2893749 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:27:46.715843 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 770/1528] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 03:27:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:27:46.721158 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d027ebef-257e-431f-b530-5a5a200e69ed None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:27:46.721614 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d027ebef-257e-431f-b530-5a5a200e69ed None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:27:46.721707 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d027ebef-257e-431f-b530-5a5a200e69ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:27:46.743322 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-d027ebef-257e-431f-b530-5a5a200e69ed None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:27:46.744535 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-d027ebef-257e-431f-b530-5a5a200e69ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:27:46.752281 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 759/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 03:27:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:27:47.036927 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c36954b-e58b-4c89-ad9a-e8a3d2893749 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:27:47.038797 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-6c36954b-e58b-4c89-ad9a-e8a3d2893749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:27:47.117801 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c36954b-e58b-4c89-ad9a-e8a3d2893749 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:27:47.121323 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308863b5-e5f1-4a8b-9fbb-189403f925ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:27:47.121918 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308863b5-e5f1-4a8b-9fbb-189403f925ba service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:27:47.122197 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308863b5-e5f1-4a8b-9fbb-189403f925ba service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:27:47.122471 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308863b5-e5f1-4a8b-9fbb-189403f925ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:27:47.131098 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308863b5-e5f1-4a8b-9fbb-189403f925ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:27:47.133219 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308863b5-e5f1-4a8b-9fbb-189403f925ba service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:27:47.142585 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 771/1530] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:27:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:27:49.284371 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01210383-c1a8-4b09-9dab-ac2ca12161e8 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:27:49.284941 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01210383-c1a8-4b09-9dab-ac2ca12161e8 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:27:49.284941 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01210383-c1a8-4b09-9dab-ac2ca12161e8 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:27:49.286234 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 760/1531] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 03:27:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:27:49.292716 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc73f9bf-a842-4cb5-9095-7bcd6f5601e9 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:27:49.293290 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc73f9bf-a842-4cb5-9095-7bcd6f5601e9 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:27:49.293290 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc73f9bf-a842-4cb5-9095-7bcd6f5601e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:27:49.313380 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-fc73f9bf-a842-4cb5-9095-7bcd6f5601e9 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:27:49.314492 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-fc73f9bf-a842-4cb5-9095-7bcd6f5601e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:27:49.322491 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 772/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 03:27:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:27:49.620848 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01210383-c1a8-4b09-9dab-ac2ca12161e8 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:27:49.631409 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01210383-c1a8-4b09-9dab-ac2ca12161e8 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:27:49.635386 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8412978-f6d4-4f8e-baa9-4ec4f05ad4ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:27:49.635932 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8412978-f6d4-4f8e-baa9-4ec4f05ad4ea service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:27:49.636214 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8412978-f6d4-4f8e-baa9-4ec4f05ad4ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:27:49.636488 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8412978-f6d4-4f8e-baa9-4ec4f05ad4ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:27:49.646010 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8412978-f6d4-4f8e-baa9-4ec4f05ad4ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:27:49.647422 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8412978-f6d4-4f8e-baa9-4ec4f05ad4ea service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:27:49.657346 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 761/1533] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:27:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:27:53.255830 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2cdf6f-74e3-464b-8d07-417b4d7f49aa None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:27:53.256357 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2cdf6f-74e3-464b-8d07-417b4d7f49aa None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:27:53.256357 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2cdf6f-74e3-464b-8d07-417b4d7f49aa None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:27:53.257830 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 773/1534] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 03:27:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:27:53.262934 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4373d-1e5f-4adf-840d-67f053c91854 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:27:53.263359 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4373d-1e5f-4adf-840d-67f053c91854 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:27:53.263475 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4373d-1e5f-4adf-840d-67f053c91854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:27:53.283213 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-11b4373d-1e5f-4adf-840d-67f053c91854 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:27:53.284438 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-11b4373d-1e5f-4adf-840d-67f053c91854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:27:53.293173 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 762/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 03:27:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:27:53.595093 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2cdf6f-74e3-464b-8d07-417b4d7f49aa None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:27:53.596781 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-3a2cdf6f-74e3-464b-8d07-417b4d7f49aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:27:53.660850 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:27:53.674563 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2cdf6f-74e3-464b-8d07-417b4d7f49aa None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:27:53.678075 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef3a647-d3ad-4bc1-8d4f-6bd2d3fe9a7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f537aabf3d1040ff840b02616f839975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:27:53.678727 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3a647-d3ad-4bc1-8d4f-6bd2d3fe9a7f service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:27:53.679110 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3a647-d3ad-4bc1-8d4f-6bd2d3fe9a7f service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:27:53.679505 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3a647-d3ad-4bc1-8d4f-6bd2d3fe9a7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:27:53.688258 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef3a647-d3ad-4bc1-8d4f-6bd2d3fe9a7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:27:53.689699 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef3a647-d3ad-4bc1-8d4f-6bd2d3fe9a7f service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:27:53.700082 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 774/1536] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:27:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:27:55.874890 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dda3fa-1072-4380-9d42-6a54159a493f None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:27:55.875558 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dda3fa-1072-4380-9d42-6a54159a493f None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:27:55.875558 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dda3fa-1072-4380-9d42-6a54159a493f None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:27:55.876965 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 763/1537] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 03:27:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:27:55.885329 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e8f74-b970-4077-a216-ed11dd8b0d3b None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:27:55.885329 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e8f74-b970-4077-a216-ed11dd8b0d3b None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:27:55.885329 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e8f74-b970-4077-a216-ed11dd8b0d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:27:55.903760 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-e68e8f74-b970-4077-a216-ed11dd8b0d3b None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:27:55.904967 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-e68e8f74-b970-4077-a216-ed11dd8b0d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:27:55.912864 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 775/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 03:27:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:27:56.217916 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dda3fa-1072-4380-9d42-6a54159a493f None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:27:56.219618 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-30dda3fa-1072-4380-9d42-6a54159a493f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:27:56.235236 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dda3fa-1072-4380-9d42-6a54159a493f None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:27:56.239093 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6dba9a-e012-4b4f-b36b-a40d69539c0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f537aabf3d1040ff840b02616f839975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:27:56.239781 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6dba9a-e012-4b4f-b36b-a40d69539c0b service cinder] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:27:56.240065 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6dba9a-e012-4b4f-b36b-a40d69539c0b service cinder] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:27:56.240344 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6dba9a-e012-4b4f-b36b-a40d69539c0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:27:56.250049 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6dba9a-e012-4b4f-b36b-a40d69539c0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:27:56.251462 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6dba9a-e012-4b4f-b36b-a40d69539c0b service cinder] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:27:56.260875 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 764/1539] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:27:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:28:05.898763 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=11 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:28:06.256569 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=89 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:29:22.677515 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b207bac8-d696-4040-a5ae-791ea95f6b80 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:22.678680 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b207bac8-d696-4040-a5ae-791ea95f6b80 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:22.678773 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b207bac8-d696-4040-a5ae-791ea95f6b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:22.682323 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1783557-ecbb-4c26-9669-1ad8f03ed9c4 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:22.683162 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1783557-ecbb-4c26-9669-1ad8f03ed9c4 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:22.683654 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1783557-ecbb-4c26-9669-1ad8f03ed9c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:22.707208 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-b207bac8-d696-4040-a5ae-791ea95f6b80 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:29:22.710361 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-b207bac8-d696-4040-a5ae-791ea95f6b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:22.720488 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-a1783557-ecbb-4c26-9669-1ad8f03ed9c4 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:29:22.721997 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-a1783557-ecbb-4c26-9669-1ad8f03ed9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:22.732239 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 776/1540] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:29:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:29:22.733782 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf45d8d-e285-413c-9df7-47f1de2c40e7 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:22.734286 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf45d8d-e285-413c-9df7-47f1de2c40e7 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:22.734774 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf45d8d-e285-413c-9df7-47f1de2c40e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:22.735980 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 765/1541] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:29:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 03:29:22.745121 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657bb761-ae78-472c-a998-3b773775d4fe None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:22.745775 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657bb761-ae78-472c-a998-3b773775d4fe None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:22.746290 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657bb761-ae78-472c-a998-3b773775d4fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:22.765527 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-9bf45d8d-e285-413c-9df7-47f1de2c40e7 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:29:22.767016 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-9bf45d8d-e285-413c-9df7-47f1de2c40e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:22.783814 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 777/1542] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:29:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:29:22.785013 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-657bb761-ae78-472c-a998-3b773775d4fe None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:29:22.785212 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16051704-f962-4cd0-b46a-481770eaa873 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:22.785692 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16051704-f962-4cd0-b46a-481770eaa873 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:22.786131 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16051704-f962-4cd0-b46a-481770eaa873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:22.795666 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-657bb761-ae78-472c-a998-3b773775d4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:22.825092 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-16051704-f962-4cd0-b46a-481770eaa873 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:29:22.826778 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-16051704-f962-4cd0-b46a-481770eaa873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:22.833435 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 766/1543] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:29:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 03:29:22.839527 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f20f2c-d464-42e1-b591-f6d918817277 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:22.840488 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f20f2c-d464-42e1-b591-f6d918817277 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:22.841154 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f20f2c-d464-42e1-b591-f6d918817277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:22.846234 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 778/1544] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:29:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:29:22.847950 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f64507-78dc-4c1d-8f2a-f9667429b7e0 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:22.848429 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f64507-78dc-4c1d-8f2a-f9667429b7e0 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:22.849045 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f64507-78dc-4c1d-8f2a-f9667429b7e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:22.886828 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-c6f64507-78dc-4c1d-8f2a-f9667429b7e0 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:29:22.888645 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-c6f64507-78dc-4c1d-8f2a-f9667429b7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:22.895785 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-09f20f2c-d464-42e1-b591-f6d918817277 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:29:22.897981 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-09f20f2c-d464-42e1-b591-f6d918817277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:22.908802 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 779/1545] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:29:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:29:22.909705 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f64507-78dc-4c1d-8f2a-f9667429b7e0 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:22.929054 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 767/1546] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:29:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:29:22.929753 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f64507-78dc-4c1d-8f2a-f9667429b7e0 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:22.930577 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f20f2c-d464-42e1-b591-f6d918817277 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:22.937566 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a086618-6d96-48af-8a5f-523da650e76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:22.938219 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a086618-6d96-48af-8a5f-523da650e76c admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:22.938551 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a086618-6d96-48af-8a5f-523da650e76c admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:22.939350 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a086618-6d96-48af-8a5f-523da650e76c admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:22.939475 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a086618-6d96-48af-8a5f-523da650e76c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:29:22.944346 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a086618-6d96-48af-8a5f-523da650e76c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:22.944346 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a086618-6d96-48af-8a5f-523da650e76c admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:22.948535 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f20f2c-d464-42e1-b591-f6d918817277 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:22.962495 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 780/1547] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 03:29:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:29:22.964220 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a39bfd-7bfa-4a72-ae7f-5054a3adbb71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:22.965070 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a39bfd-7bfa-4a72-ae7f-5054a3adbb71 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:22.965534 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a39bfd-7bfa-4a72-ae7f-5054a3adbb71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:22.965992 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a39bfd-7bfa-4a72-ae7f-5054a3adbb71 admin admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:22.966846 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a39bfd-7bfa-4a72-ae7f-5054a3adbb71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:29:22.967332 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a39bfd-7bfa-4a72-ae7f-5054a3adbb71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:22.968560 dv-cinder-849143-9-smb devstack@keystone.service[81380]: WARNING py.warnings [None req-c2a39bfd-7bfa-4a72-ae7f-5054a3adbb71 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 03:29:22.968560 dv-cinder-849143-9-smb devstack@keystone.service[81380]: warnings.warn(msg) Oct 04 03:29:22.968560 dv-cinder-849143-9-smb devstack@keystone.service[81380]: Oct 04 03:29:22.969800 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a39bfd-7bfa-4a72-ae7f-5054a3adbb71 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:22.975511 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec43a4-fea0-443e-b47d-cf3c7c630b76 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:22.975511 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec43a4-fea0-443e-b47d-cf3c7c630b76 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:22.975511 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec43a4-fea0-443e-b47d-cf3c7c630b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:22.994623 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 768/1548] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 03:29:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:29:22.995924 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a39bfd-7bfa-4a72-ae7f-5054a3adbb71 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:23.003800 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-fbec43a4-fea0-443e-b47d-cf3c7c630b76 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:29:23.005037 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-fbec43a4-fea0-443e-b47d-cf3c7c630b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:23.015513 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a39bfd-7bfa-4a72-ae7f-5054a3adbb71 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:23.022968 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 781/1549] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:29:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:29:23.024029 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbec43a4-fea0-443e-b47d-cf3c7c630b76 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:23.025158 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f30a45-a672-4437-9dba-9047831d55b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:23.026003 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f30a45-a672-4437-9dba-9047831d55b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:23.026466 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f30a45-a672-4437-9dba-9047831d55b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:23.026921 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f30a45-a672-4437-9dba-9047831d55b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:23.027848 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f30a45-a672-4437-9dba-9047831d55b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:29:23.028343 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f30a45-a672-4437-9dba-9047831d55b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:23.030118 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f30a45-a672-4437-9dba-9047831d55b6 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:23.040623 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbec43a4-fea0-443e-b47d-cf3c7c630b76 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:23.059355 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27607f4-303e-4001-a7eb-a0f9b058e9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:23.060003 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27607f4-303e-4001-a7eb-a0f9b058e9f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:23.060285 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27607f4-303e-4001-a7eb-a0f9b058e9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:23.060696 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 769/1550] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 03:29:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:29:23.060824 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27607f4-303e-4001-a7eb-a0f9b058e9f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:23.061183 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27607f4-303e-4001-a7eb-a0f9b058e9f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:23.061482 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f30a45-a672-4437-9dba-9047831d55b6 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:23.062203 dv-cinder-849143-9-smb devstack@keystone.service[81379]: WARNING py.warnings [None req-f27607f4-303e-4001-a7eb-a0f9b058e9f9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 03:29:23.062203 dv-cinder-849143-9-smb devstack@keystone.service[81379]: warnings.warn(msg) Oct 04 03:29:23.062203 dv-cinder-849143-9-smb devstack@keystone.service[81379]: Oct 04 03:29:23.063396 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27607f4-303e-4001-a7eb-a0f9b058e9f9 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:23.083862 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f30a45-a672-4437-9dba-9047831d55b6 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:23.107779 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050d7637-c76e-40c5-ba07-ea572670d8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:23.108519 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d7637-c76e-40c5-ba07-ea572670d8a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:23.108853 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d7637-c76e-40c5-ba07-ea572670d8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:23.109179 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d7637-c76e-40c5-ba07-ea572670d8a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:23.122565 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050d7637-c76e-40c5-ba07-ea572670d8a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:23.122565 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050d7637-c76e-40c5-ba07-ea572670d8a7 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:23.128512 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 782/1551] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:29:23 2022] POST /identity/v3/projects => generated 365 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:29:23.129285 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27607f4-303e-4001-a7eb-a0f9b058e9f9 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:23.168286 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 770/1552] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:29:23 2022] POST /identity/v3/projects => generated 387 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:29:23.169604 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2196fd48-ede4-4ce5-8b60-3e7b80789e11 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:23.175077 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2196fd48-ede4-4ce5-8b60-3e7b80789e11 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:23.175077 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2196fd48-ede4-4ce5-8b60-3e7b80789e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:23.196688 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-2196fd48-ede4-4ce5-8b60-3e7b80789e11 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:29:23.198099 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-2196fd48-ede4-4ce5-8b60-3e7b80789e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:23.215878 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27607f4-303e-4001-a7eb-a0f9b058e9f9 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:23.271590 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 771/1553] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:29:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:29:23.271590 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2196fd48-ede4-4ce5-8b60-3e7b80789e11 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:23.276102 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2196fd48-ede4-4ce5-8b60-3e7b80789e11 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:23.280979 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a450159-cec7-4d51-8615-f8bd3218cf15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:23.281576 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a450159-cec7-4d51-8615-f8bd3218cf15 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:23.281859 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a450159-cec7-4d51-8615-f8bd3218cf15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:23.282133 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a450159-cec7-4d51-8615-f8bd3218cf15 admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:23.282764 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a450159-cec7-4d51-8615-f8bd3218cf15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:23.284685 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a450159-cec7-4d51-8615-f8bd3218cf15 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:23.288402 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf42fd1-5e82-4e8a-a712-38d6996e8505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:23.289007 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf42fd1-5e82-4e8a-a712-38d6996e8505 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:23.289288 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf42fd1-5e82-4e8a-a712-38d6996e8505 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:23.289559 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf42fd1-5e82-4e8a-a712-38d6996e8505 admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:23.290394 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf42fd1-5e82-4e8a-a712-38d6996e8505 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:29:23.290702 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf42fd1-5e82-4e8a-a712-38d6996e8505 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:23.292304 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf42fd1-5e82-4e8a-a712-38d6996e8505 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:23.312154 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 783/1554] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 03:29:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:29:23.313136 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf42fd1-5e82-4e8a-a712-38d6996e8505 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:23.323935 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf42fd1-5e82-4e8a-a712-38d6996e8505 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:23.326562 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 772/1555] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:29:23 2022] POST /identity/v3/projects => generated 377 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:29:23.328099 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4629210-8722-448b-8cfb-78b28a567109 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:23.328382 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4629210-8722-448b-8cfb-78b28a567109 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:23.328657 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4629210-8722-448b-8cfb-78b28a567109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:23.331644 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e112d17f-9aac-4486-8d8d-3c00371a51a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:23.332247 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112d17f-9aac-4486-8d8d-3c00371a51a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:23.332529 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112d17f-9aac-4486-8d8d-3c00371a51a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:23.332798 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112d17f-9aac-4486-8d8d-3c00371a51a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:23.333426 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e112d17f-9aac-4486-8d8d-3c00371a51a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:23.335813 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e112d17f-9aac-4486-8d8d-3c00371a51a0 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:23.348363 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-b4629210-8722-448b-8cfb-78b28a567109 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:29:23.350001 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-b4629210-8722-448b-8cfb-78b28a567109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:23.357906 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 784/1556] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:29:23 2022] POST /identity/v3/users => generated 283 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:29:23.358795 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e112d17f-9aac-4486-8d8d-3c00371a51a0 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:23.372040 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e112d17f-9aac-4486-8d8d-3c00371a51a0 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:23.377146 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:29:23.417308 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 773/1557] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:29:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:29:23.418617 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241cc66-dc21-4486-826f-5e04f059d9a0 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:23.418835 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241cc66-dc21-4486-826f-5e04f059d9a0 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:23.419108 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241cc66-dc21-4486-826f-5e04f059d9a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:23.435198 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dab7f46-7403-4c00-8304-a04b39ea8cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:23.435919 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab7f46-7403-4c00-8304-a04b39ea8cf7 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:23.436207 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab7f46-7403-4c00-8304-a04b39ea8cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:23.436486 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab7f46-7403-4c00-8304-a04b39ea8cf7 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:23.437134 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dab7f46-7403-4c00-8304-a04b39ea8cf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:23.439219 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dab7f46-7403-4c00-8304-a04b39ea8cf7 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:23.439877 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-5241cc66-dc21-4486-826f-5e04f059d9a0 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:29:23.441082 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-5241cc66-dc21-4486-826f-5e04f059d9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:23.450314 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 774/1558] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:29:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:29:23.451329 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a2fbde-de6c-48da-9329-3dc1e9e81029 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:23.451758 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a2fbde-de6c-48da-9329-3dc1e9e81029 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:23.452098 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a2fbde-de6c-48da-9329-3dc1e9e81029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:23.460636 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:29:23.470770 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 785/1559] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:29:23 2022] POST /identity/v3/users => generated 294 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:29:23.470770 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b7355-40d9-442f-b786-70f7ca0d2b52 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:23.470770 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b7355-40d9-442f-b786-70f7ca0d2b52 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:23.470770 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b7355-40d9-442f-b786-70f7ca0d2b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:23.472902 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-46a2fbde-de6c-48da-9329-3dc1e9e81029 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:29:23.474103 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-46a2fbde-de6c-48da-9329-3dc1e9e81029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:23.485782 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 775/1560] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:29:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:29:23.485782 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a2fbde-de6c-48da-9329-3dc1e9e81029 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:23.489212 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-210b7355-40d9-442f-b786-70f7ca0d2b52 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:29:23.490967 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-210b7355-40d9-442f-b786-70f7ca0d2b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:23.495842 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a2fbde-de6c-48da-9329-3dc1e9e81029 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:23.499279 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 786/1561] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:29:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:29:23.500051 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210b7355-40d9-442f-b786-70f7ca0d2b52 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:23.500914 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0699df-449a-48bb-9924-0dfb0598fea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:23.501514 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0699df-449a-48bb-9924-0dfb0598fea5 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:23.501799 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0699df-449a-48bb-9924-0dfb0598fea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:23.502238 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0699df-449a-48bb-9924-0dfb0598fea5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:23.502868 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0699df-449a-48bb-9924-0dfb0598fea5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:23.505157 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0699df-449a-48bb-9924-0dfb0598fea5 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:23.510579 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210b7355-40d9-442f-b786-70f7ca0d2b52 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:23.515098 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c93701c-b118-480e-bb93-089d2175ff0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:23.515722 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93701c-b118-480e-bb93-089d2175ff0a admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:23.516004 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93701c-b118-480e-bb93-089d2175ff0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:23.516284 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93701c-b118-480e-bb93-089d2175ff0a admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:23.516912 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c93701c-b118-480e-bb93-089d2175ff0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:23.518797 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c93701c-b118-480e-bb93-089d2175ff0a admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:23.538966 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 776/1562] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:29:23 2022] POST /identity/v3/projects => generated 381 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:29:23.538966 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0699df-449a-48bb-9924-0dfb0598fea5 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:23.544597 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 787/1563] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:29:23 2022] POST /identity/v3/users => generated 289 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:29:23.544597 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17278db-451d-44e0-a3dc-837ce3bded93 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:23.544597 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17278db-451d-44e0-a3dc-837ce3bded93 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:23.544597 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17278db-451d-44e0-a3dc-837ce3bded93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:23.563294 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-a17278db-451d-44e0-a3dc-837ce3bded93 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:29:23.564519 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-a17278db-451d-44e0-a3dc-837ce3bded93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:23.601274 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0699df-449a-48bb-9924-0dfb0598fea5 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:23.606218 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cbf8f3-6d0a-4c3a-bfad-f0d155c977bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:23.606853 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cbf8f3-6d0a-4c3a-bfad-f0d155c977bb admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:23.607143 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cbf8f3-6d0a-4c3a-bfad-f0d155c977bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:23.607414 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cbf8f3-6d0a-4c3a-bfad-f0d155c977bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:23.608122 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cbf8f3-6d0a-4c3a-bfad-f0d155c977bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:23.609718 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cbf8f3-6d0a-4c3a-bfad-f0d155c977bb admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:23.620240 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 777/1564] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:29:23 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:29:23.621407 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee09956-8625-4187-8f02-76cbe4f5859c None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:23.621693 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee09956-8625-4187-8f02-76cbe4f5859c None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:23.621974 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee09956-8625-4187-8f02-76cbe4f5859c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:23.626894 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 788/1565] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:29:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:29:23.627814 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17278db-451d-44e0-a3dc-837ce3bded93 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:23.638459 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17278db-451d-44e0-a3dc-837ce3bded93 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:23.643144 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981879e5-5588-40a6-8ab1-3ed4ec11c823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:23.643822 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981879e5-5588-40a6-8ab1-3ed4ec11c823 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:23.644107 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981879e5-5588-40a6-8ab1-3ed4ec11c823 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:23.644384 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981879e5-5588-40a6-8ab1-3ed4ec11c823 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:23.645038 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981879e5-5588-40a6-8ab1-3ed4ec11c823 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:23.645460 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-8ee09956-8625-4187-8f02-76cbe4f5859c None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:29:23.646649 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-8ee09956-8625-4187-8f02-76cbe4f5859c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:23.646767 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981879e5-5588-40a6-8ab1-3ed4ec11c823 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:23.654841 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 778/1566] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:29:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:29:23.655521 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee09956-8625-4187-8f02-76cbe4f5859c None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:23.657695 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 789/1567] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:29:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:29:23.659356 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118d1a21-39ec-4517-b25d-2b2d6b4f6977 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:23.659728 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118d1a21-39ec-4517-b25d-2b2d6b4f6977 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:23.660076 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118d1a21-39ec-4517-b25d-2b2d6b4f6977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:23.665546 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee09956-8625-4187-8f02-76cbe4f5859c None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:23.670104 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cb9e13-1ccc-4daf-ac39-605f37dbf1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:23.670968 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb9e13-1ccc-4daf-ac39-605f37dbf1cf admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:23.671251 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb9e13-1ccc-4daf-ac39-605f37dbf1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:23.671544 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb9e13-1ccc-4daf-ac39-605f37dbf1cf admin admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:23.672177 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cb9e13-1ccc-4daf-ac39-605f37dbf1cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:29:23.672471 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cb9e13-1ccc-4daf-ac39-605f37dbf1cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:23.674039 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cb9e13-1ccc-4daf-ac39-605f37dbf1cf admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:23.680345 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-118d1a21-39ec-4517-b25d-2b2d6b4f6977 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:29:23.681542 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-118d1a21-39ec-4517-b25d-2b2d6b4f6977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:23.686414 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 779/1568] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 03:29:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:29:23.687286 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cb9e13-1ccc-4daf-ac39-605f37dbf1cf admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:23.689551 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 790/1569] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:29:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:29:23.695044 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118d1a21-39ec-4517-b25d-2b2d6b4f6977 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:23.703534 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cb9e13-1ccc-4daf-ac39-605f37dbf1cf admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:23.705184 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118d1a21-39ec-4517-b25d-2b2d6b4f6977 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:23.708334 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2fb035-a075-4f46-849f-e8ea30ec29a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:23.708935 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2fb035-a075-4f46-849f-e8ea30ec29a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:23.709328 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2fb035-a075-4f46-849f-e8ea30ec29a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:23.710124 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2fb035-a075-4f46-849f-e8ea30ec29a8 admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:23.710425 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85192b5b-7573-47f6-993d-b1c28ddf9f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:23.710898 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2fb035-a075-4f46-849f-e8ea30ec29a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:23.711179 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85192b5b-7573-47f6-993d-b1c28ddf9f97 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:23.711573 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85192b5b-7573-47f6-993d-b1c28ddf9f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:23.711825 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85192b5b-7573-47f6-993d-b1c28ddf9f97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:23.712180 dv-cinder-849143-9-smb devstack@keystone.service[81380]: WARNING py.warnings [None req-6c2fb035-a075-4f46-849f-e8ea30ec29a8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 03:29:23.712180 dv-cinder-849143-9-smb devstack@keystone.service[81380]: warnings.warn(msg) Oct 04 03:29:23.712180 dv-cinder-849143-9-smb devstack@keystone.service[81380]: Oct 04 03:29:23.712469 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85192b5b-7573-47f6-993d-b1c28ddf9f97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:23.713664 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2fb035-a075-4f46-849f-e8ea30ec29a8 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:23.714195 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85192b5b-7573-47f6-993d-b1c28ddf9f97 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:23.725837 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 791/1570] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:29:23 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:29:23.726971 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85192b5b-7573-47f6-993d-b1c28ddf9f97 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:23.739706 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85192b5b-7573-47f6-993d-b1c28ddf9f97 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:23.741622 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 780/1571] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:29:23 2022] POST /identity/v3/users => generated 291 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:29:23.741622 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2fb035-a075-4f46-849f-e8ea30ec29a8 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:23.748703 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c24e5a8-ad67-46f4-9830-62d96cdb62c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:23.749322 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c24e5a8-ad67-46f4-9830-62d96cdb62c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:23.749626 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c24e5a8-ad67-46f4-9830-62d96cdb62c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:23.749969 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c24e5a8-ad67-46f4-9830-62d96cdb62c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:23.750639 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c24e5a8-ad67-46f4-9830-62d96cdb62c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:23.752287 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c24e5a8-ad67-46f4-9830-62d96cdb62c7 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:23.752505 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2fb035-a075-4f46-849f-e8ea30ec29a8 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:23.758305 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c210dfd-105a-4ddf-bc1b-7bbbf9b16fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:23.758868 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c210dfd-105a-4ddf-bc1b-7bbbf9b16fc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:23.759152 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c210dfd-105a-4ddf-bc1b-7bbbf9b16fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:23.759430 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c210dfd-105a-4ddf-bc1b-7bbbf9b16fc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:23.760098 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c210dfd-105a-4ddf-bc1b-7bbbf9b16fc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:29:23.760406 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c210dfd-105a-4ddf-bc1b-7bbbf9b16fc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:23.761966 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c210dfd-105a-4ddf-bc1b-7bbbf9b16fc2 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:23.766109 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 792/1572] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:29:23 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:29:23.766109 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c24e5a8-ad67-46f4-9830-62d96cdb62c7 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:23.781333 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c24e5a8-ad67-46f4-9830-62d96cdb62c7 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:23.781523 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 781/1573] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 03:29:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:29:23.781523 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c210dfd-105a-4ddf-bc1b-7bbbf9b16fc2 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:23.781724 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c70a2d2-ff19-4367-908c-dc5d76d70441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:23.781724 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70a2d2-ff19-4367-908c-dc5d76d70441 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:23.781724 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70a2d2-ff19-4367-908c-dc5d76d70441 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:23.781724 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70a2d2-ff19-4367-908c-dc5d76d70441 admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:23.782099 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c70a2d2-ff19-4367-908c-dc5d76d70441 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:29:23.782099 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c70a2d2-ff19-4367-908c-dc5d76d70441 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:23.783028 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c70a2d2-ff19-4367-908c-dc5d76d70441 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:23.785556 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c210dfd-105a-4ddf-bc1b-7bbbf9b16fc2 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:23.790532 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa7f3f-64d9-4f3a-bf26-91abf1facf91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:23.791148 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa7f3f-64d9-4f3a-bf26-91abf1facf91 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:23.791429 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa7f3f-64d9-4f3a-bf26-91abf1facf91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:23.791748 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa7f3f-64d9-4f3a-bf26-91abf1facf91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:23.792377 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aa7f3f-64d9-4f3a-bf26-91abf1facf91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:23.793939 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aa7f3f-64d9-4f3a-bf26-91abf1facf91 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:23.795311 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 793/1574] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 03:29:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:29:23.796054 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c70a2d2-ff19-4367-908c-dc5d76d70441 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:23.805415 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c70a2d2-ff19-4367-908c-dc5d76d70441 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:23.809940 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026713cb-bf55-4b70-8ce5-382834131df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:23.810537 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026713cb-bf55-4b70-8ce5-382834131df5 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:23.810813 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026713cb-bf55-4b70-8ce5-382834131df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:23.814256 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 782/1575] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:29:23 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:29:23.814422 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026713cb-bf55-4b70-8ce5-382834131df5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:23.814422 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026713cb-bf55-4b70-8ce5-382834131df5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:29:23.814422 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026713cb-bf55-4b70-8ce5-382834131df5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:23.814659 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa7f3f-64d9-4f3a-bf26-91abf1facf91 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:23.814744 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026713cb-bf55-4b70-8ce5-382834131df5 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:23.822832 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa7f3f-64d9-4f3a-bf26-91abf1facf91 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:23.830738 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 794/1576] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 03:29:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:29:23.830738 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026713cb-bf55-4b70-8ce5-382834131df5 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:23.831242 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f2ebb2-b4b0-4c2e-b36c-13499f5577c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:23.831856 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2ebb2-b4b0-4c2e-b36c-13499f5577c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:23.832142 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2ebb2-b4b0-4c2e-b36c-13499f5577c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:23.832415 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2ebb2-b4b0-4c2e-b36c-13499f5577c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:23.833034 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f2ebb2-b4b0-4c2e-b36c-13499f5577c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:23.835995 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f2ebb2-b4b0-4c2e-b36c-13499f5577c6 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:23.840754 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026713cb-bf55-4b70-8ce5-382834131df5 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:23.845277 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b812af-e688-43ee-8201-ddf2cea06096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:23.845858 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b812af-e688-43ee-8201-ddf2cea06096 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:23.846138 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b812af-e688-43ee-8201-ddf2cea06096 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:23.846405 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b812af-e688-43ee-8201-ddf2cea06096 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:23.847035 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b812af-e688-43ee-8201-ddf2cea06096 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:23.848616 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b812af-e688-43ee-8201-ddf2cea06096 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:23.850378 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:29:23.864908 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 783/1577] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:29:23 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:29:23.866208 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 795/1578] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:29:23 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:29:23.866350 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f2ebb2-b4b0-4c2e-b36c-13499f5577c6 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:23.867326 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b812af-e688-43ee-8201-ddf2cea06096 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:23.877026 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b812af-e688-43ee-8201-ddf2cea06096 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:23.915901 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:29:23.930961 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f2ebb2-b4b0-4c2e-b36c-13499f5577c6 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:23.935590 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5289d6-851f-40c2-9749-fcc2d475ba64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:23.935786 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a921306a-33b3-4c92-81b6-dc7b1b58a5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:23.936242 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5289d6-851f-40c2-9749-fcc2d475ba64 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:23.936370 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a921306a-33b3-4c92-81b6-dc7b1b58a5fb admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:23.936504 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5289d6-851f-40c2-9749-fcc2d475ba64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:23.936652 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a921306a-33b3-4c92-81b6-dc7b1b58a5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:23.936764 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5289d6-851f-40c2-9749-fcc2d475ba64 admin admin] PATH_INFO: `/v3/projects/2cdbdb7c052645e28477dd56010aeb29/users/e9652447e9a14a8aa8a59b63667e7e2d/roles/04d0e4575a28440eb4349b4a6565e8b8` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:23.936951 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a921306a-33b3-4c92-81b6-dc7b1b58a5fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:23.937616 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a921306a-33b3-4c92-81b6-dc7b1b58a5fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:23.939310 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a921306a-33b3-4c92-81b6-dc7b1b58a5fb admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:23.949972 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 784/1579] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:29:23 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:29:23.950759 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a921306a-33b3-4c92-81b6-dc7b1b58a5fb admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:23.955137 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5289d6-851f-40c2-9749-fcc2d475ba64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cdbdb7c052645e28477dd56010aeb29, user_id=e9652447e9a14a8aa8a59b63667e7e2d, role_id=04d0e4575a28440eb4349b4a6565e8b8)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:23.956200 dv-cinder-849143-9-smb devstack@keystone.service[81379]: WARNING py.warnings [None req-0f5289d6-851f-40c2-9749-fcc2d475ba64 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 03:29:23.956200 dv-cinder-849143-9-smb devstack@keystone.service[81379]: warnings.warn(msg) Oct 04 03:29:23.956200 dv-cinder-849143-9-smb devstack@keystone.service[81379]: Oct 04 03:29:23.958117 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5289d6-851f-40c2-9749-fcc2d475ba64 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:23.961306 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a921306a-33b3-4c92-81b6-dc7b1b58a5fb admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:23.966895 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5c61cb-961d-451c-9278-8ccc89d06bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:23.967668 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c61cb-961d-451c-9278-8ccc89d06bcb admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:23.967952 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c61cb-961d-451c-9278-8ccc89d06bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:23.968232 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c61cb-961d-451c-9278-8ccc89d06bcb admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:23.968858 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5c61cb-961d-451c-9278-8ccc89d06bcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:23.970730 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5c61cb-961d-451c-9278-8ccc89d06bcb admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:23.972756 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 796/1580] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:29:23 2022] PUT /identity/v3/projects/2cdbdb7c052645e28477dd56010aeb29/users/e9652447e9a14a8aa8a59b63667e7e2d/roles/04d0e4575a28440eb4349b4a6565e8b8 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:29:23.973298 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5289d6-851f-40c2-9749-fcc2d475ba64 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:24.009967 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 785/1581] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:29:23 2022] POST /identity/v3/projects => generated 379 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:29:24.009967 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5c61cb-961d-451c-9278-8ccc89d06bcb admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:24.045459 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5289d6-851f-40c2-9749-fcc2d475ba64 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:24.070711 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5c61cb-961d-451c-9278-8ccc89d06bcb admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:24.075369 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c952355-3eed-40cc-add7-6ccbfe70f29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:24.076069 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c952355-3eed-40cc-add7-6ccbfe70f29c admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:24.076350 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c952355-3eed-40cc-add7-6ccbfe70f29c admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:24.076625 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c952355-3eed-40cc-add7-6ccbfe70f29c admin admin] PATH_INFO: `/v3/projects/96643b79b7724c398b1df29f9ea0bbd4/users/542b137fb8cd4d25867d95a13d2cb651/roles/04d0e4575a28440eb4349b4a6565e8b8` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:24.091883 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c952355-3eed-40cc-add7-6ccbfe70f29c admin admin] RBAC: Authorizing `identity:create_grant(project_id=96643b79b7724c398b1df29f9ea0bbd4, user_id=542b137fb8cd4d25867d95a13d2cb651, role_id=04d0e4575a28440eb4349b4a6565e8b8)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:24.094515 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c952355-3eed-40cc-add7-6ccbfe70f29c admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:24.103013 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c8fc4-8381-4602-af84-65bd7b1c0baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:24.103656 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c8fc4-8381-4602-af84-65bd7b1c0baf admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:24.103943 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c8fc4-8381-4602-af84-65bd7b1c0baf admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:24.104226 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c8fc4-8381-4602-af84-65bd7b1c0baf admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:24.104864 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29c8fc4-8381-4602-af84-65bd7b1c0baf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:24.106754 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29c8fc4-8381-4602-af84-65bd7b1c0baf admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:24.108532 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 786/1582] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:29:24 2022] PUT /identity/v3/projects/96643b79b7724c398b1df29f9ea0bbd4/users/542b137fb8cd4d25867d95a13d2cb651/roles/04d0e4575a28440eb4349b4a6565e8b8 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:29:24.109434 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c952355-3eed-40cc-add7-6ccbfe70f29c admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:24.135788 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 797/1583] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:29:23 2022] POST /identity/v3/projects => generated 375 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:29:24.137199 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c8fc4-8381-4602-af84-65bd7b1c0baf admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:24.150816 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:29:24.172366 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c952355-3eed-40cc-add7-6ccbfe70f29c admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:24.206291 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c8fc4-8381-4602-af84-65bd7b1c0baf admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:24.210854 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddc4f36-1bc4-40bd-bc21-b8fc94e59e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:24.211530 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc4f36-1bc4-40bd-bc21-b8fc94e59e1c admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:24.211806 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc4f36-1bc4-40bd-bc21-b8fc94e59e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:24.212081 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc4f36-1bc4-40bd-bc21-b8fc94e59e1c admin admin] PATH_INFO: `/v3/projects/2011dec80f764558a3a0fe210cdd0755/users/02f76bc3ab354c4a8e9941e1403274ae/roles/04d0e4575a28440eb4349b4a6565e8b8` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:24.220237 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:29:24.227868 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddc4f36-1bc4-40bd-bc21-b8fc94e59e1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2011dec80f764558a3a0fe210cdd0755, user_id=02f76bc3ab354c4a8e9941e1403274ae, role_id=04d0e4575a28440eb4349b4a6565e8b8)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:24.230064 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe272968-66a9-4c97-9126-60311e25f469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:24.230509 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddc4f36-1bc4-40bd-bc21-b8fc94e59e1c admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:24.231012 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe272968-66a9-4c97-9126-60311e25f469 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:24.231316 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe272968-66a9-4c97-9126-60311e25f469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:24.231625 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe272968-66a9-4c97-9126-60311e25f469 admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:24.232266 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe272968-66a9-4c97-9126-60311e25f469 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:24.234120 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe272968-66a9-4c97-9126-60311e25f469 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:24.244008 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 798/1584] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:29:24 2022] PUT /identity/v3/projects/2011dec80f764558a3a0fe210cdd0755/users/02f76bc3ab354c4a8e9941e1403274ae/roles/04d0e4575a28440eb4349b4a6565e8b8 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:29:24.244871 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddc4f36-1bc4-40bd-bc21-b8fc94e59e1c admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:24.267600 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 787/1585] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:29:24 2022] POST /identity/v3/projects => generated 391 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:29:24.268333 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe272968-66a9-4c97-9126-60311e25f469 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:24.313386 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddc4f36-1bc4-40bd-bc21-b8fc94e59e1c admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:24.330774 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe272968-66a9-4c97-9126-60311e25f469 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:24.336782 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b192da7-652c-4e11-bc73-6cf7c7efa98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:24.337411 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b192da7-652c-4e11-bc73-6cf7c7efa98e admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:24.337711 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b192da7-652c-4e11-bc73-6cf7c7efa98e admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:24.337968 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b192da7-652c-4e11-bc73-6cf7c7efa98e admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:24.338614 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b192da7-652c-4e11-bc73-6cf7c7efa98e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:24.340247 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b192da7-652c-4e11-bc73-6cf7c7efa98e admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:24.350922 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 788/1586] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:29:24 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:29:24.352208 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5027f3b3-f808-4a7a-871b-29b355187c06 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:24.352500 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5027f3b3-f808-4a7a-871b-29b355187c06 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:24.352774 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5027f3b3-f808-4a7a-871b-29b355187c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:24.372578 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561ef181-329a-4a02-b2b2-500e7dae1383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:24.373191 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ef181-329a-4a02-b2b2-500e7dae1383 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:24.373473 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ef181-329a-4a02-b2b2-500e7dae1383 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:24.373750 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ef181-329a-4a02-b2b2-500e7dae1383 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:24.374383 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561ef181-329a-4a02-b2b2-500e7dae1383 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:24.376320 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561ef181-329a-4a02-b2b2-500e7dae1383 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:24.379904 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-5027f3b3-f808-4a7a-871b-29b355187c06 None None] MFA Rules not processed for user `e9652447e9a14a8aa8a59b63667e7e2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:29:24.381723 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-5027f3b3-f808-4a7a-871b-29b355187c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:24.399163 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 799/1587] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:29:24 2022] POST /identity/v3/users => generated 292 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:29:24.400160 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561ef181-329a-4a02-b2b2-500e7dae1383 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:24.410008 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561ef181-329a-4a02-b2b2-500e7dae1383 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:24.415128 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf2e3d0-446f-424f-93f4-0f3c5d3ae2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:24.415740 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf2e3d0-446f-424f-93f4-0f3c5d3ae2f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:24.416017 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf2e3d0-446f-424f-93f4-0f3c5d3ae2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:24.416286 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf2e3d0-446f-424f-93f4-0f3c5d3ae2f7 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:24.416932 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf2e3d0-446f-424f-93f4-0f3c5d3ae2f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:24.418848 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf2e3d0-446f-424f-93f4-0f3c5d3ae2f7 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:24.442141 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 800/1588] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:29:24 2022] POST /identity/v3/users => generated 290 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:29:24.443683 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3243da78-e0f7-48be-a07f-610bf6c99931 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:24.444079 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3243da78-e0f7-48be-a07f-610bf6c99931 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:24.444385 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3243da78-e0f7-48be-a07f-610bf6c99931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:24.450114 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 789/1589] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:29:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:29:24.450928 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5027f3b3-f808-4a7a-871b-29b355187c06 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:24.461685 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5027f3b3-f808-4a7a-871b-29b355187c06 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:24.466168 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4835a22-4087-4f72-9d62-9ec8a173ce18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:24.466762 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4835a22-4087-4f72-9d62-9ec8a173ce18 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:24.466991 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-3243da78-e0f7-48be-a07f-610bf6c99931 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:29:24.467107 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4835a22-4087-4f72-9d62-9ec8a173ce18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:24.467311 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4835a22-4087-4f72-9d62-9ec8a173ce18 admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:24.468097 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4835a22-4087-4f72-9d62-9ec8a173ce18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:24.468238 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-3243da78-e0f7-48be-a07f-610bf6c99931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:24.470008 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4835a22-4087-4f72-9d62-9ec8a173ce18 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:24.476776 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 801/1590] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:29:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:29:24.481121 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37efb2f-4371-4e17-bef2-b60f5c102441 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:24.481121 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37efb2f-4371-4e17-bef2-b60f5c102441 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:24.481345 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37efb2f-4371-4e17-bef2-b60f5c102441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:24.493901 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 790/1591] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:29:24 2022] POST /identity/v3/users => generated 288 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:29:24.494843 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4835a22-4087-4f72-9d62-9ec8a173ce18 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:24.499915 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:29:24.505606 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4835a22-4087-4f72-9d62-9ec8a173ce18 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:24.505962 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-f37efb2f-4371-4e17-bef2-b60f5c102441 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:29:24.508123 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-f37efb2f-4371-4e17-bef2-b60f5c102441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:24.511196 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4578616-0abf-4e76-9f5e-cfd4a5d82f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:24.511823 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4578616-0abf-4e76-9f5e-cfd4a5d82f5e admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:24.512106 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4578616-0abf-4e76-9f5e-cfd4a5d82f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:24.512383 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4578616-0abf-4e76-9f5e-cfd4a5d82f5e admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:24.513007 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4578616-0abf-4e76-9f5e-cfd4a5d82f5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:24.514946 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4578616-0abf-4e76-9f5e-cfd4a5d82f5e admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:24.515786 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 802/1592] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:29:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:29:24.519639 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37efb2f-4371-4e17-bef2-b60f5c102441 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:24.530853 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37efb2f-4371-4e17-bef2-b60f5c102441 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:24.535988 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54616067-d8a7-4462-a681-2729fc760431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:24.536663 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54616067-d8a7-4462-a681-2729fc760431 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:24.536944 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54616067-d8a7-4462-a681-2729fc760431 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:24.537214 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54616067-d8a7-4462-a681-2729fc760431 admin admin] PATH_INFO: `/v3/projects/18412a6002ce4900a089ca90f2e9f7b3/users/0ce066d8dc8243bc9bb0b36250288677/roles/04d0e4575a28440eb4349b4a6565e8b8` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:24.541767 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 791/1593] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:29:24 2022] POST /identity/v3/users => generated 296 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:29:24.541767 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4578616-0abf-4e76-9f5e-cfd4a5d82f5e admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:24.549324 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4578616-0abf-4e76-9f5e-cfd4a5d82f5e admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:24.553170 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54616067-d8a7-4462-a681-2729fc760431 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18412a6002ce4900a089ca90f2e9f7b3, user_id=0ce066d8dc8243bc9bb0b36250288677, role_id=04d0e4575a28440eb4349b4a6565e8b8)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:24.553925 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a170e-f011-4d52-a282-e31924f25a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:24.554508 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a170e-f011-4d52-a282-e31924f25a84 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:24.554797 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a170e-f011-4d52-a282-e31924f25a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:24.555073 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a170e-f011-4d52-a282-e31924f25a84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:24.555730 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9a170e-f011-4d52-a282-e31924f25a84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:24.555850 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54616067-d8a7-4462-a681-2729fc760431 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:24.557289 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9a170e-f011-4d52-a282-e31924f25a84 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:24.569770 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 803/1595] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:29:24 2022] PUT /identity/v3/projects/18412a6002ce4900a089ca90f2e9f7b3/users/0ce066d8dc8243bc9bb0b36250288677/roles/04d0e4575a28440eb4349b4a6565e8b8 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:29:24.578534 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 792/1595] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:29:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:29:24.578649 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54616067-d8a7-4462-a681-2729fc760431 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:24.579268 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a170e-f011-4d52-a282-e31924f25a84 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:24.602540 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:29:24.643425 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a170e-f011-4d52-a282-e31924f25a84 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:24.648436 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54616067-d8a7-4462-a681-2729fc760431 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:24.653453 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8be5df7-0205-418b-9034-ebf51d615df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:24.654136 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be5df7-0205-418b-9034-ebf51d615df3 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:24.654424 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be5df7-0205-418b-9034-ebf51d615df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:24.654701 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be5df7-0205-418b-9034-ebf51d615df3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:24.655348 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8be5df7-0205-418b-9034-ebf51d615df3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:24.656981 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8be5df7-0205-418b-9034-ebf51d615df3 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:24.667339 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 804/1596] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:29:24 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:29:24.668184 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8be5df7-0205-418b-9034-ebf51d615df3 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:24.694219 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd798e7-8691-4b63-bb69-b6559c652ce7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f537aabf3d1040ff840b02616f839975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:24.694768 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd798e7-8691-4b63-bb69-b6559c652ce7 service cinder] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:24.694878 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd798e7-8691-4b63-bb69-b6559c652ce7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:24.695157 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd798e7-8691-4b63-bb69-b6559c652ce7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:24.724421 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8be5df7-0205-418b-9034-ebf51d615df3 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:24.728982 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fb529f-1615-482b-87fb-b48ff533dc70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:24.729582 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fb529f-1615-482b-87fb-b48ff533dc70 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:24.729976 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fb529f-1615-482b-87fb-b48ff533dc70 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:24.730138 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fb529f-1615-482b-87fb-b48ff533dc70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:24.739395 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fb529f-1615-482b-87fb-b48ff533dc70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:24.741601 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fb529f-1615-482b-87fb-b48ff533dc70 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:24.751343 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 805/1597] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:29:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:29:24.751992 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fb529f-1615-482b-87fb-b48ff533dc70 service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:24.753858 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd798e7-8691-4b63-bb69-b6559c652ce7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:24.755294 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd798e7-8691-4b63-bb69-b6559c652ce7 service cinder] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:24.761146 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fb529f-1615-482b-87fb-b48ff533dc70 service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:24.764743 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 793/1598] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:29:24 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:29:24.766244 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b4c29-8408-4c80-9dc4-ceb423969dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:24.766757 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b4c29-8408-4c80-9dc4-ceb423969dd3 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:24.767049 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b4c29-8408-4c80-9dc4-ceb423969dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:24.767316 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b4c29-8408-4c80-9dc4-ceb423969dd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:24.767994 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3b4c29-8408-4c80-9dc4-ceb423969dd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:24.769565 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3b4c29-8408-4c80-9dc4-ceb423969dd3 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:24.773795 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd798e7-8691-4b63-bb69-b6559c652ce7 service cinder] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:24.784820 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 806/1599] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:29:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:29:24.784820 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b4c29-8408-4c80-9dc4-ceb423969dd3 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:24.786195 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd798e7-8691-4b63-bb69-b6559c652ce7 service cinder] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:24.792649 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f3be53-f895-4026-a242-4be504235b0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:24.793434 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f3be53-f895-4026-a242-4be504235b0c service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:24.793726 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f3be53-f895-4026-a242-4be504235b0c service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:24.794005 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f3be53-f895-4026-a242-4be504235b0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:24.795103 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b4c29-8408-4c80-9dc4-ceb423969dd3 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:24.800594 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8674b26-16a5-4fa4-8b5f-13ca27bc2185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:24.801245 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8674b26-16a5-4fa4-8b5f-13ca27bc2185 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:24.801516 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8674b26-16a5-4fa4-8b5f-13ca27bc2185 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:24.801792 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8674b26-16a5-4fa4-8b5f-13ca27bc2185 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:24.802440 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8674b26-16a5-4fa4-8b5f-13ca27bc2185 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:24.804421 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8674b26-16a5-4fa4-8b5f-13ca27bc2185 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:24.805944 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f3be53-f895-4026-a242-4be504235b0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:24.807843 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f3be53-f895-4026-a242-4be504235b0c service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:24.819084 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 807/1600] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:29:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:29:24.819084 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8674b26-16a5-4fa4-8b5f-13ca27bc2185 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:24.820640 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 794/1601] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:29:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:29:24.821870 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b00ab8-47d5-4c40-ba72-ee2e4f204d8b None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:24.822322 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b00ab8-47d5-4c40-ba72-ee2e4f204d8b None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:24.822601 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b00ab8-47d5-4c40-ba72-ee2e4f204d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:24.828281 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8674b26-16a5-4fa4-8b5f-13ca27bc2185 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:24.833917 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a27900-d543-40d4-993b-892649358332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:24.835353 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a27900-d543-40d4-993b-892649358332 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:24.835805 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a27900-d543-40d4-993b-892649358332 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:24.836179 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a27900-d543-40d4-993b-892649358332 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:24.836953 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a27900-d543-40d4-993b-892649358332 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:24.838855 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a27900-d543-40d4-993b-892649358332 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:24.852109 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 808/1602] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:29:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:29:24.853320 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a27900-d543-40d4-993b-892649358332 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:24.862612 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-79b00ab8-47d5-4c40-ba72-ee2e4f204d8b None None] MFA Rules not processed for user `0ce066d8dc8243bc9bb0b36250288677`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:29:24.864540 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-79b00ab8-47d5-4c40-ba72-ee2e4f204d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:24.865725 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a27900-d543-40d4-993b-892649358332 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:24.870880 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501c7975-7fe5-4745-afda-93b540502c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:24.871599 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c7975-7fe5-4745-afda-93b540502c5c admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:24.871882 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c7975-7fe5-4745-afda-93b540502c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:24.872151 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c7975-7fe5-4745-afda-93b540502c5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:24.872880 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501c7975-7fe5-4745-afda-93b540502c5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:24.874622 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501c7975-7fe5-4745-afda-93b540502c5c admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:24.889733 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 809/1603] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:29:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:29:24.889733 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501c7975-7fe5-4745-afda-93b540502c5c admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:24.906231 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501c7975-7fe5-4745-afda-93b540502c5c admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:24.914156 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccec93a-9018-4d7b-85e0-080033f38596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:24.915640 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccec93a-9018-4d7b-85e0-080033f38596 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:24.917824 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccec93a-9018-4d7b-85e0-080033f38596 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:24.918479 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccec93a-9018-4d7b-85e0-080033f38596 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:24.919380 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccec93a-9018-4d7b-85e0-080033f38596 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:24.921266 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccec93a-9018-4d7b-85e0-080033f38596 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:24.942078 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 810/1604] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:29:24 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:29:24.944255 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccec93a-9018-4d7b-85e0-080033f38596 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:24.960866 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccec93a-9018-4d7b-85e0-080033f38596 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:24.965925 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00ce86e-e2ff-45ba-86d5-cce7bd04a5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:24.966904 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ce86e-e2ff-45ba-86d5-cce7bd04a5f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:24.967192 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ce86e-e2ff-45ba-86d5-cce7bd04a5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:24.967465 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ce86e-e2ff-45ba-86d5-cce7bd04a5f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:24.968188 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00ce86e-e2ff-45ba-86d5-cce7bd04a5f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:24.970208 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00ce86e-e2ff-45ba-86d5-cce7bd04a5f3 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:24.971601 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 795/1605] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:29:24 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:29:24.972641 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b00ab8-47d5-4c40-ba72-ee2e4f204d8b None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:24.980283 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:29:24.986318 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 811/1606] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:29:24 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:29:24.987461 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00ce86e-e2ff-45ba-86d5-cce7bd04a5f3 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:24.989724 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b00ab8-47d5-4c40-ba72-ee2e4f204d8b None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:24.996557 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6f32fd-9e71-4e63-a3f6-fae228d93108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:24.997522 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6f32fd-9e71-4e63-a3f6-fae228d93108 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:24.997901 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6f32fd-9e71-4e63-a3f6-fae228d93108 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:24.998248 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6f32fd-9e71-4e63-a3f6-fae228d93108 admin admin] PATH_INFO: `/v3/projects/a8d6ee89cb464afa95e222b2a1e7279b/users/b8795829c34046628cae345dd4d45e75/roles/04d0e4575a28440eb4349b4a6565e8b8` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:25.002384 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00ce86e-e2ff-45ba-86d5-cce7bd04a5f3 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:25.009634 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c76e020-e5a2-4253-a20c-5f9cac07462b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:25.010660 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c76e020-e5a2-4253-a20c-5f9cac07462b admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:25.011192 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c76e020-e5a2-4253-a20c-5f9cac07462b admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:25.011608 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c76e020-e5a2-4253-a20c-5f9cac07462b admin admin] PATH_INFO: `/v3/projects/caaf5d7d94d442c28466101666bdcab0/users/3e1b3303d5ca4f5e90176c05f35e70cd/roles/04d0e4575a28440eb4349b4a6565e8b8` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:25.016570 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:29:25.017748 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6f32fd-9e71-4e63-a3f6-fae228d93108 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8d6ee89cb464afa95e222b2a1e7279b, user_id=b8795829c34046628cae345dd4d45e75, role_id=04d0e4575a28440eb4349b4a6565e8b8)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:25.021020 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6f32fd-9e71-4e63-a3f6-fae228d93108 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:25.038481 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c76e020-e5a2-4253-a20c-5f9cac07462b admin admin] RBAC: Authorizing `identity:create_grant(project_id=caaf5d7d94d442c28466101666bdcab0, user_id=3e1b3303d5ca4f5e90176c05f35e70cd, role_id=04d0e4575a28440eb4349b4a6565e8b8)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:25.043217 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c76e020-e5a2-4253-a20c-5f9cac07462b admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:25.046544 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 796/1607] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:29:24 2022] PUT /identity/v3/projects/a8d6ee89cb464afa95e222b2a1e7279b/users/b8795829c34046628cae345dd4d45e75/roles/04d0e4575a28440eb4349b4a6565e8b8 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:29:25.048280 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6f32fd-9e71-4e63-a3f6-fae228d93108 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:25.073160 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 812/1608] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:29:24 2022] PUT /identity/v3/projects/caaf5d7d94d442c28466101666bdcab0/users/3e1b3303d5ca4f5e90176c05f35e70cd/roles/04d0e4575a28440eb4349b4a6565e8b8 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:29:25.074268 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c76e020-e5a2-4253-a20c-5f9cac07462b admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:25.142823 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6f32fd-9e71-4e63-a3f6-fae228d93108 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:25.186497 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c76e020-e5a2-4253-a20c-5f9cac07462b admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:25.196430 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fe6e5c-901c-4a85-987c-589090978d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:25.197140 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe6e5c-901c-4a85-987c-589090978d9d admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:25.197422 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe6e5c-901c-4a85-987c-589090978d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:25.197705 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe6e5c-901c-4a85-987c-589090978d9d admin admin] PATH_INFO: `/v3/projects/b62fd4925f3840edb9806630cd78c9fa/users/a267cf7109c64f538824c162fedd084b/roles/04d0e4575a28440eb4349b4a6565e8b8` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:25.218161 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fe6e5c-901c-4a85-987c-589090978d9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b62fd4925f3840edb9806630cd78c9fa, user_id=a267cf7109c64f538824c162fedd084b, role_id=04d0e4575a28440eb4349b4a6565e8b8)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:25.224339 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fe6e5c-901c-4a85-987c-589090978d9d admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:25.231835 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e17e72-498c-4119-b04e-5d6f25e854ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:25.232865 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e17e72-498c-4119-b04e-5d6f25e854ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:25.233559 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e17e72-498c-4119-b04e-5d6f25e854ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:25.234011 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e17e72-498c-4119-b04e-5d6f25e854ca admin admin] PATH_INFO: `/v3/projects/354343c5e5ea48148626b0ec9af93d56/users/5e6b0c230f054f8f8cb7c9daa508316f/roles/04d0e4575a28440eb4349b4a6565e8b8` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:25.242521 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 813/1609] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:29:25 2022] PUT /identity/v3/projects/b62fd4925f3840edb9806630cd78c9fa/users/a267cf7109c64f538824c162fedd084b/roles/04d0e4575a28440eb4349b4a6565e8b8 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:29:25.244371 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d597e-fdd9-44a9-932c-a337294bd302 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:25.244903 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d597e-fdd9-44a9-932c-a337294bd302 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:25.245336 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d597e-fdd9-44a9-932c-a337294bd302 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:25.248005 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 814/1610] 10.222.0.25 () {54 vars in 961 bytes} [Tue Oct 4 03:29:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:29:25.249782 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce8bf86-04bc-4921-84d6-570dde3ef7f6 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:25.250259 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce8bf86-04bc-4921-84d6-570dde3ef7f6 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:25.250859 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce8bf86-04bc-4921-84d6-570dde3ef7f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:25.255586 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e17e72-498c-4119-b04e-5d6f25e854ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=354343c5e5ea48148626b0ec9af93d56, user_id=5e6b0c230f054f8f8cb7c9daa508316f, role_id=04d0e4575a28440eb4349b4a6565e8b8)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:25.260358 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e17e72-498c-4119-b04e-5d6f25e854ca admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:25.279014 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 797/1611] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:29:25 2022] PUT /identity/v3/projects/354343c5e5ea48148626b0ec9af93d56/users/5e6b0c230f054f8f8cb7c9daa508316f/roles/04d0e4575a28440eb4349b4a6565e8b8 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:29:25.280125 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-2ce8bf86-04bc-4921-84d6-570dde3ef7f6 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:29:25.280770 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0595da2-4269-42aa-b7a8-fc3b0f1cb580 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:25.281146 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0595da2-4269-42aa-b7a8-fc3b0f1cb580 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:25.281577 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0595da2-4269-42aa-b7a8-fc3b0f1cb580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:25.282266 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-2ce8bf86-04bc-4921-84d6-570dde3ef7f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:25.308041 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-c0595da2-4269-42aa-b7a8-fc3b0f1cb580 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:29:25.310305 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-c0595da2-4269-42aa-b7a8-fc3b0f1cb580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:25.388197 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 815/1612] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:29:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:29:25.389894 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3dddde-7578-4beb-bca6-bcd29e4a40ea None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:25.391202 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3dddde-7578-4beb-bca6-bcd29e4a40ea None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:25.391868 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3dddde-7578-4beb-bca6-bcd29e4a40ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:25.415675 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 798/1613] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:29:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:29:25.418067 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6bc1f0-9888-4490-ace3-1983a812c494 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:25.418067 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6bc1f0-9888-4490-ace3-1983a812c494 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:25.418067 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6bc1f0-9888-4490-ace3-1983a812c494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:25.424974 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-3c3dddde-7578-4beb-bca6-bcd29e4a40ea None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:29:25.426222 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-3c3dddde-7578-4beb-bca6-bcd29e4a40ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:25.450667 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 816/1614] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:29:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:29:25.454153 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c172b-83a0-4ecf-a74d-6daf79d311b1 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:25.454254 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c172b-83a0-4ecf-a74d-6daf79d311b1 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:25.454635 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c172b-83a0-4ecf-a74d-6daf79d311b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:25.475643 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:29:25.547024 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-342c172b-83a0-4ecf-a74d-6daf79d311b1 None None] MFA Rules not processed for user `5e6b0c230f054f8f8cb7c9daa508316f`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:29:25.548294 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-342c172b-83a0-4ecf-a74d-6daf79d311b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:25.550616 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-2e6bc1f0-9888-4490-ace3-1983a812c494 None None] MFA Rules not processed for user `2c1f412befb9418fa66a2aabf475aa90`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:29:25.551813 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-2e6bc1f0-9888-4490-ace3-1983a812c494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:25.714969 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:29:25.749552 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 817/1615] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:29:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:29:25.756880 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342c172b-83a0-4ecf-a74d-6daf79d311b1 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:25.758504 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-342c172b-83a0-4ecf-a74d-6daf79d311b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:25.762232 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 799/1616] 10.222.0.25 () {58 vars in 1058 bytes} [Tue Oct 4 03:29:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:29:25.763272 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6bc1f0-9888-4490-ace3-1983a812c494 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:25.765087 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-2e6bc1f0-9888-4490-ace3-1983a812c494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:25.851514 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342c172b-83a0-4ecf-a74d-6daf79d311b1 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:25.855241 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039eeaf7-3c8d-42a5-855b-317dbe270cd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:25.855907 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039eeaf7-3c8d-42a5-855b-317dbe270cd2 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:25.856189 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039eeaf7-3c8d-42a5-855b-317dbe270cd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:25.856461 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039eeaf7-3c8d-42a5-855b-317dbe270cd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:25.867233 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6bc1f0-9888-4490-ace3-1983a812c494 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:25.867642 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039eeaf7-3c8d-42a5-855b-317dbe270cd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:25.869096 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039eeaf7-3c8d-42a5-855b-317dbe270cd2 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:25.872545 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abde952-b6f2-4729-84ca-bce9f5dce569 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:25.873599 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abde952-b6f2-4729-84ca-bce9f5dce569 service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:25.874189 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abde952-b6f2-4729-84ca-bce9f5dce569 service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:25.874467 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abde952-b6f2-4729-84ca-bce9f5dce569 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:25.879609 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 818/1617] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:29:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:29:25.880458 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039eeaf7-3c8d-42a5-855b-317dbe270cd2 service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:25.888310 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039eeaf7-3c8d-42a5-855b-317dbe270cd2 service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:25.889977 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abde952-b6f2-4729-84ca-bce9f5dce569 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:25.892159 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abde952-b6f2-4729-84ca-bce9f5dce569 service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:25.892385 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c602f83-9e2d-41bd-b714-08f89c3808ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:25.892981 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c602f83-9e2d-41bd-b714-08f89c3808ae service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:25.893355 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c602f83-9e2d-41bd-b714-08f89c3808ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:25.893631 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c602f83-9e2d-41bd-b714-08f89c3808ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:25.903575 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c602f83-9e2d-41bd-b714-08f89c3808ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:25.905002 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c602f83-9e2d-41bd-b714-08f89c3808ae service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:25.905654 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 800/1618] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:29:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:29:25.906607 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abde952-b6f2-4729-84ca-bce9f5dce569 service neutron] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:25.915704 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 819/1619] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:29:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:29:25.916942 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c865a-9c8b-4a4c-9530-34f4fc7f7148 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:25.917226 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c865a-9c8b-4a4c-9530-34f4fc7f7148 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:25.917496 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c865a-9c8b-4a4c-9530-34f4fc7f7148 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:25.918763 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 820/1620] 10.222.0.25 () {54 vars in 961 bytes} [Tue Oct 4 03:29:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:29:25.921823 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abde952-b6f2-4729-84ca-bce9f5dce569 service neutron] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:25.924215 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f92a7-5873-4647-bd4e-f00c60474866 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:25.924504 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f92a7-5873-4647-bd4e-f00c60474866 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:25.924786 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f92a7-5873-4647-bd4e-f00c60474866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:25.930316 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f02cee-4e55-4809-af13-4ecb1b5a29f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1f412befb9418fa66a2aabf475aa90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:25.931275 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f02cee-4e55-4809-af13-4ecb1b5a29f0 service nova] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:25.931759 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f02cee-4e55-4809-af13-4ecb1b5a29f0 service nova] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:25.932187 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f02cee-4e55-4809-af13-4ecb1b5a29f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:25.946249 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-4e5f92a7-5873-4647-bd4e-f00c60474866 None None] MFA Rules not processed for user `2c1f412befb9418fa66a2aabf475aa90`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:29:25.947447 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-4e5f92a7-5873-4647-bd4e-f00c60474866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:25.956878 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 821/1621] 10.222.0.25 () {58 vars in 1058 bytes} [Tue Oct 4 03:29:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:29:25.965170 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f92a7-5873-4647-bd4e-f00c60474866 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:25.981185 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f92a7-5873-4647-bd4e-f00c60474866 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:25.988064 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb5ff80-1a6b-4cf6-b4c7-d8e05d843cd5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1f412befb9418fa66a2aabf475aa90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:25.988670 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb5ff80-1a6b-4cf6-b4c7-d8e05d843cd5 service nova] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:25.988948 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb5ff80-1a6b-4cf6-b4c7-d8e05d843cd5 service nova] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:25.989219 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb5ff80-1a6b-4cf6-b4c7-d8e05d843cd5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:25.999076 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb5ff80-1a6b-4cf6-b4c7-d8e05d843cd5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:26.000879 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb5ff80-1a6b-4cf6-b4c7-d8e05d843cd5 service nova] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:26.010603 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 822/1622] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:29:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 03:29:26.019992 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f02cee-4e55-4809-af13-4ecb1b5a29f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:26.022602 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f02cee-4e55-4809-af13-4ecb1b5a29f0 service nova] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:26.040351 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 801/1623] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:29:25 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:29:26.288722 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd7563-6b17-48de-bdf9-2638635d3aac None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:26.289082 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd7563-6b17-48de-bdf9-2638635d3aac None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:26.289423 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd7563-6b17-48de-bdf9-2638635d3aac None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:26.292447 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 823/1624] 10.222.0.25 () {54 vars in 912 bytes} [Tue Oct 4 03:29:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:29:26.298427 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646aaeed-cc9c-45f5-b59d-70d7a5f4f10b None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:26.299414 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646aaeed-cc9c-45f5-b59d-70d7a5f4f10b None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:26.299747 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646aaeed-cc9c-45f5-b59d-70d7a5f4f10b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:26.323732 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4416a062-0321-4db0-9f19-72a77758c1fe None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:26.324243 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4416a062-0321-4db0-9f19-72a77758c1fe None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:26.324577 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-646aaeed-cc9c-45f5-b59d-70d7a5f4f10b None None] MFA Rules not processed for user `2c1f412befb9418fa66a2aabf475aa90`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:29:26.324713 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4416a062-0321-4db0-9f19-72a77758c1fe None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:26.325735 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-646aaeed-cc9c-45f5-b59d-70d7a5f4f10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:26.326467 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 824/1625] 10.222.0.25 () {54 vars in 912 bytes} [Tue Oct 4 03:29:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 03:29:26.332403 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d491ae9e-892d-4052-a22b-17fea6405939 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:26.332689 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d491ae9e-892d-4052-a22b-17fea6405939 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:26.332965 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d491ae9e-892d-4052-a22b-17fea6405939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:26.337950 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 802/1626] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Oct 4 03:29:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:29:26.354939 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-d491ae9e-892d-4052-a22b-17fea6405939 None None] MFA Rules not processed for user `2c1f412befb9418fa66a2aabf475aa90`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:29:26.356408 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-d491ae9e-892d-4052-a22b-17fea6405939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:26.359982 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646aaeed-cc9c-45f5-b59d-70d7a5f4f10b None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:26.368482 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 825/1627] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Oct 4 03:29:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:29:26.384144 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d491ae9e-892d-4052-a22b-17fea6405939 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:26.394290 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:29:26.430456 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646aaeed-cc9c-45f5-b59d-70d7a5f4f10b None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:26.434957 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38936eb7-0e66-4cb6-b627-654e49abb758 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f537aabf3d1040ff840b02616f839975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:26.435804 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38936eb7-0e66-4cb6-b627-654e49abb758 service cinder] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:26.436106 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38936eb7-0e66-4cb6-b627-654e49abb758 service cinder] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:26.436425 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38936eb7-0e66-4cb6-b627-654e49abb758 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:26.450656 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38936eb7-0e66-4cb6-b627-654e49abb758 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:26.452228 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38936eb7-0e66-4cb6-b627-654e49abb758 service cinder] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:26.457738 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d491ae9e-892d-4052-a22b-17fea6405939 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:26.464043 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d3fb3b-da8e-44fd-aebe-2c556a4f5fec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f537aabf3d1040ff840b02616f839975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:26.464771 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d3fb3b-da8e-44fd-aebe-2c556a4f5fec service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:26.465047 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d3fb3b-da8e-44fd-aebe-2c556a4f5fec service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:26.465479 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d3fb3b-da8e-44fd-aebe-2c556a4f5fec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:26.467133 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 803/1628] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:29:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:29:26.479559 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d3fb3b-da8e-44fd-aebe-2c556a4f5fec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:26.481228 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d3fb3b-da8e-44fd-aebe-2c556a4f5fec service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:26.494354 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 826/1629] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:29:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 03:29:26.685433 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38936eb7-0e66-4cb6-b627-654e49abb758 service cinder] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:26.701800 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38936eb7-0e66-4cb6-b627-654e49abb758 service cinder] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:26.710604 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639ab3df-24d6-4359-aae6-26b71eb3eaa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:26.710992 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ab3df-24d6-4359-aae6-26b71eb3eaa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:26.712131 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ab3df-24d6-4359-aae6-26b71eb3eaa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:26.712553 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ab3df-24d6-4359-aae6-26b71eb3eaa8 admin admin] PATH_INFO: `/v3/users/5e6b0c230f054f8f8cb7c9daa508316f` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:26.714623 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639ab3df-24d6-4359-aae6-26b71eb3eaa8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e6b0c230f054f8f8cb7c9daa508316f)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:26.718775 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639ab3df-24d6-4359-aae6-26b71eb3eaa8 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:26.853774 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-639ab3df-24d6-4359-aae6-26b71eb3eaa8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e6b0c230f054f8f8cb7c9daa508316f'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:29:26.862867 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-639ab3df-24d6-4359-aae6-26b71eb3eaa8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e6b0c230f054f8f8cb7c9daa508316f'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:29:26.886206 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-639ab3df-24d6-4359-aae6-26b71eb3eaa8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e6b0c230f054f8f8cb7c9daa508316f'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:29:26.887267 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-639ab3df-24d6-4359-aae6-26b71eb3eaa8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e6b0c230f054f8f8cb7c9daa508316f'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:29:26.924091 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-639ab3df-24d6-4359-aae6-26b71eb3eaa8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e6b0c230f054f8f8cb7c9daa508316f'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:29:26.947619 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 804/1630] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:29:26 2022] DELETE /identity/v3/users/5e6b0c230f054f8f8cb7c9daa508316f => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:29:26.951562 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c8e865-d7d9-44c0-872b-339f4a12ecc1 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:26.952475 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c8e865-d7d9-44c0-872b-339f4a12ecc1 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:26.952908 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c8e865-d7d9-44c0-872b-339f4a12ecc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:26.986856 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-70c8e865-d7d9-44c0-872b-339f4a12ecc1 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:29:26.990422 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-70c8e865-d7d9-44c0-872b-339f4a12ecc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:27.103569 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:29:27.122595 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 827/1631] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:29:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:29:27.192529 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639ab3df-24d6-4359-aae6-26b71eb3eaa8 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:27.194970 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-639ab3df-24d6-4359-aae6-26b71eb3eaa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:27.341293 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639ab3df-24d6-4359-aae6-26b71eb3eaa8 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:27.353446 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c187edf8-1d1f-4932-b4f0-436368849654 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:27.355264 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c187edf8-1d1f-4932-b4f0-436368849654 service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:27.355626 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c187edf8-1d1f-4932-b4f0-436368849654 service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:27.357824 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c187edf8-1d1f-4932-b4f0-436368849654 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:27.383176 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c187edf8-1d1f-4932-b4f0-436368849654 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:27.384841 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c187edf8-1d1f-4932-b4f0-436368849654 service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:27.410253 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 805/1632] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:29:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:29:29.479548 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c8e865-d7d9-44c0-872b-339f4a12ecc1 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:29.481231 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-70c8e865-d7d9-44c0-872b-339f4a12ecc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:29.510289 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c8e865-d7d9-44c0-872b-339f4a12ecc1 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:29.521344 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf6fba5-3b4b-4773-82d1-ebb816332776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:29.523307 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf6fba5-3b4b-4773-82d1-ebb816332776 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:29.523628 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf6fba5-3b4b-4773-82d1-ebb816332776 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:29.523905 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf6fba5-3b4b-4773-82d1-ebb816332776 admin admin] PATH_INFO: `/v3/projects/354343c5e5ea48148626b0ec9af93d56` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:29.534511 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf6fba5-3b4b-4773-82d1-ebb816332776 admin admin] RBAC: Authorizing `identity:delete_project(project_id=354343c5e5ea48148626b0ec9af93d56)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:29.536671 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf6fba5-3b4b-4773-82d1-ebb816332776 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:29.643787 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-7cf6fba5-3b4b-4773-82d1-ebb816332776 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '354343c5e5ea48148626b0ec9af93d56', 'request_id': 'req-7cf6fba5-3b4b-4773-82d1-ebb816332776'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:29:29.661344 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-7cf6fba5-3b4b-4773-82d1-ebb816332776 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '354343c5e5ea48148626b0ec9af93d56', 'request_id': 'req-7cf6fba5-3b4b-4773-82d1-ebb816332776'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:29:29.672553 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-7cf6fba5-3b4b-4773-82d1-ebb816332776 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '354343c5e5ea48148626b0ec9af93d56', 'request_id': 'req-7cf6fba5-3b4b-4773-82d1-ebb816332776'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:29:29.699981 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-7cf6fba5-3b4b-4773-82d1-ebb816332776 admin admin] The token cache is being invalidate because project 354343c5e5ea48148626b0ec9af93d56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:29:29.701895 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-7cf6fba5-3b4b-4773-82d1-ebb816332776 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:29:29.702903 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-7cf6fba5-3b4b-4773-82d1-ebb816332776 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:29:29.706899 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 828/1633] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:29:29 2022] DELETE /identity/v3/projects/354343c5e5ea48148626b0ec9af93d56 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 03:29:29.712759 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f5ca82-fb7d-4d5c-8363-170258a18bb0 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:29.713623 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f5ca82-fb7d-4d5c-8363-170258a18bb0 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:29.713623 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f5ca82-fb7d-4d5c-8363-170258a18bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:29.763049 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-26f5ca82-fb7d-4d5c-8363-170258a18bb0 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:29:29.768061 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-26f5ca82-fb7d-4d5c-8363-170258a18bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:29.902812 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:29:29.985762 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 806/1634] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:29:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:29:29.987957 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c7879-d039-4c0f-abf0-6f1b356d2bab None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:29.988135 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c7879-d039-4c0f-abf0-6f1b356d2bab None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:29.988413 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c7879-d039-4c0f-abf0-6f1b356d2bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:30.038869 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-d85c7879-d039-4c0f-abf0-6f1b356d2bab None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:29:30.040354 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-d85c7879-d039-4c0f-abf0-6f1b356d2bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:30.057809 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 829/1635] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:29:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:29:30.059077 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f5ca82-fb7d-4d5c-8363-170258a18bb0 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:30.073765 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f5ca82-fb7d-4d5c-8363-170258a18bb0 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:30.079301 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e034ffc7-8d22-4da4-ba1b-ce239d330423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:30.080699 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e034ffc7-8d22-4da4-ba1b-ce239d330423 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:30.081140 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e034ffc7-8d22-4da4-ba1b-ce239d330423 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:30.081563 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e034ffc7-8d22-4da4-ba1b-ce239d330423 admin admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:30.082354 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e034ffc7-8d22-4da4-ba1b-ce239d330423 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:29:30.082858 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e034ffc7-8d22-4da4-ba1b-ce239d330423 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:30.086222 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e034ffc7-8d22-4da4-ba1b-ce239d330423 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:30.111690 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 807/1636] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 03:29:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:29:30.114382 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85c7879-d039-4c0f-abf0-6f1b356d2bab None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:30.129178 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85c7879-d039-4c0f-abf0-6f1b356d2bab None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:30.136502 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0c9850-6f50-48bd-8a81-7a8de77aecec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:30.140921 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c9850-6f50-48bd-8a81-7a8de77aecec admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:30.141419 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c9850-6f50-48bd-8a81-7a8de77aecec admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:30.142112 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c9850-6f50-48bd-8a81-7a8de77aecec admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:30.143298 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0c9850-6f50-48bd-8a81-7a8de77aecec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:30.149301 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0c9850-6f50-48bd-8a81-7a8de77aecec admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:30.197365 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 830/1637] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:29:30 2022] POST /identity/v3/projects => generated 365 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:29:30.202429 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e034ffc7-8d22-4da4-ba1b-ce239d330423 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:30.218699 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e034ffc7-8d22-4da4-ba1b-ce239d330423 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:30.329513 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138f37ae-aeb4-43d1-b8c7-508fdb33fb0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:30.330218 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f37ae-aeb4-43d1-b8c7-508fdb33fb0d admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:30.330814 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f37ae-aeb4-43d1-b8c7-508fdb33fb0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:30.331162 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f37ae-aeb4-43d1-b8c7-508fdb33fb0d admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:30.331905 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138f37ae-aeb4-43d1-b8c7-508fdb33fb0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:30.334651 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138f37ae-aeb4-43d1-b8c7-508fdb33fb0d admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:30.427417 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 808/1638] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:29:30 2022] POST /identity/v3/users => generated 283 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:29:30.432350 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0c9850-6f50-48bd-8a81-7a8de77aecec admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:30.444023 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0c9850-6f50-48bd-8a81-7a8de77aecec admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:30.452466 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3971c94d-e9e5-4087-99be-75968e21a056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:30.453456 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3971c94d-e9e5-4087-99be-75968e21a056 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:30.453456 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3971c94d-e9e5-4087-99be-75968e21a056 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:30.453643 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3971c94d-e9e5-4087-99be-75968e21a056 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:30.454274 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3971c94d-e9e5-4087-99be-75968e21a056 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:30.459435 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3971c94d-e9e5-4087-99be-75968e21a056 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:30.477550 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 831/1639] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:29:30 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:29:30.482161 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138f37ae-aeb4-43d1-b8c7-508fdb33fb0d admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:30.499530 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138f37ae-aeb4-43d1-b8c7-508fdb33fb0d admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:30.516511 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b1598b-9b1a-4ced-b35c-44769b84d478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:30.517614 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b1598b-9b1a-4ced-b35c-44769b84d478 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:30.518022 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b1598b-9b1a-4ced-b35c-44769b84d478 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:30.518393 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b1598b-9b1a-4ced-b35c-44769b84d478 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:30.520602 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b1598b-9b1a-4ced-b35c-44769b84d478 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:30.528118 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b1598b-9b1a-4ced-b35c-44769b84d478 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:30.562282 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 809/1640] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:29:30 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:29:30.563538 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3971c94d-e9e5-4087-99be-75968e21a056 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:30.579162 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3971c94d-e9e5-4087-99be-75968e21a056 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:30.596619 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cf0e4d-111c-4841-9c4f-880a693e978d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:30.597778 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf0e4d-111c-4841-9c4f-880a693e978d admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:30.598214 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf0e4d-111c-4841-9c4f-880a693e978d admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:30.598856 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf0e4d-111c-4841-9c4f-880a693e978d admin admin] PATH_INFO: `/v3/projects/4d600d07376d4501b747f75a0ec86cc4/users/9f3f5f170bf945d7b19963e03a88833f/roles/04d0e4575a28440eb4349b4a6565e8b8` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:30.656539 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cf0e4d-111c-4841-9c4f-880a693e978d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d600d07376d4501b747f75a0ec86cc4, user_id=9f3f5f170bf945d7b19963e03a88833f, role_id=04d0e4575a28440eb4349b4a6565e8b8)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:30.659272 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cf0e4d-111c-4841-9c4f-880a693e978d admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:30.689592 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 832/1641] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:29:30 2022] PUT /identity/v3/projects/4d600d07376d4501b747f75a0ec86cc4/users/9f3f5f170bf945d7b19963e03a88833f/roles/04d0e4575a28440eb4349b4a6565e8b8 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:29:30.703854 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aedf68-55f1-4fbe-be1b-df557bd5ea2f None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:30.703854 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aedf68-55f1-4fbe-be1b-df557bd5ea2f None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:30.704405 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aedf68-55f1-4fbe-be1b-df557bd5ea2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:30.773390 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-36aedf68-55f1-4fbe-be1b-df557bd5ea2f None None] MFA Rules not processed for user `9f3f5f170bf945d7b19963e03a88833f`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:29:30.778388 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-36aedf68-55f1-4fbe-be1b-df557bd5ea2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:30.882149 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 810/1642] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:29:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:29:30.886592 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cf0e4d-111c-4841-9c4f-880a693e978d admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:30.993961 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cf0e4d-111c-4841-9c4f-880a693e978d admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:30.999952 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cbc184-52df-45c0-a108-033bbd11ae89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:31.014560 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cbc184-52df-45c0-a108-033bbd11ae89 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:31.015120 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cbc184-52df-45c0-a108-033bbd11ae89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:31.016219 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cbc184-52df-45c0-a108-033bbd11ae89 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:31.018410 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cbc184-52df-45c0-a108-033bbd11ae89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:31.029518 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cbc184-52df-45c0-a108-033bbd11ae89 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:31.076766 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 833/1643] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:29:30 2022] POST /identity/v3/projects => generated 365 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:29:31.080754 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aedf68-55f1-4fbe-be1b-df557bd5ea2f None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:31.103803 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aedf68-55f1-4fbe-be1b-df557bd5ea2f None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:31.187987 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:29:31.282543 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de11215-1289-47f5-828e-b7063a34e02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:31.283181 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de11215-1289-47f5-828e-b7063a34e02c admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:31.283466 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de11215-1289-47f5-828e-b7063a34e02c admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:31.283770 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de11215-1289-47f5-828e-b7063a34e02c admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:31.284427 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de11215-1289-47f5-828e-b7063a34e02c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:31.286509 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de11215-1289-47f5-828e-b7063a34e02c admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:31.337344 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 811/1644] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:29:31 2022] POST /identity/v3/users => generated 289 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:29:31.340882 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cbc184-52df-45c0-a108-033bbd11ae89 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:31.346557 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:29:31.359477 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cbc184-52df-45c0-a108-033bbd11ae89 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:31.367932 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfda3901-287b-4450-8654-2a290328803a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:31.368790 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda3901-287b-4450-8654-2a290328803a admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:31.368912 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda3901-287b-4450-8654-2a290328803a admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:31.369101 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda3901-287b-4450-8654-2a290328803a admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:31.369829 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfda3901-287b-4450-8654-2a290328803a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:31.371559 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfda3901-287b-4450-8654-2a290328803a admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:31.390017 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 834/1645] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:29:31 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:29:31.394319 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de11215-1289-47f5-828e-b7063a34e02c admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:31.418060 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de11215-1289-47f5-828e-b7063a34e02c admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:31.427270 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f87f3-123c-493c-9bff-f7a5dff763e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:31.429506 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f87f3-123c-493c-9bff-f7a5dff763e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:31.430165 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f87f3-123c-493c-9bff-f7a5dff763e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:31.431028 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f87f3-123c-493c-9bff-f7a5dff763e4 admin admin] PATH_INFO: `/v3/projects/7638764ee4b1437ab5abbdac4bbe2455/users/3128006b609447a08f53779287cc499e/roles/fe9379cda35c4ff78576fe48b60bea3c` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:31.464171 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160f87f3-123c-493c-9bff-f7a5dff763e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7638764ee4b1437ab5abbdac4bbe2455, user_id=3128006b609447a08f53779287cc499e, role_id=fe9379cda35c4ff78576fe48b60bea3c)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:31.471275 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160f87f3-123c-493c-9bff-f7a5dff763e4 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:31.493748 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 812/1646] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:29:31 2022] PUT /identity/v3/projects/7638764ee4b1437ab5abbdac4bbe2455/users/3128006b609447a08f53779287cc499e/roles/fe9379cda35c4ff78576fe48b60bea3c => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:29:31.497368 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfda3901-287b-4450-8654-2a290328803a admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:31.512443 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfda3901-287b-4450-8654-2a290328803a admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:31.686084 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242f808b-7db2-43e0-9044-c3157a240abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:31.686084 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f808b-7db2-43e0-9044-c3157a240abb admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:31.686084 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f808b-7db2-43e0-9044-c3157a240abb admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:31.686084 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f808b-7db2-43e0-9044-c3157a240abb admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:31.686816 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242f808b-7db2-43e0-9044-c3157a240abb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:31.686816 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242f808b-7db2-43e0-9044-c3157a240abb admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:31.717290 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 835/1647] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:29:31 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:29:31.721626 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f87f3-123c-493c-9bff-f7a5dff763e4 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:31.736878 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f87f3-123c-493c-9bff-f7a5dff763e4 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:31.751412 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ddc41-0b19-4ff5-b335-acb1650e4bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:31.752385 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ddc41-0b19-4ff5-b335-acb1650e4bc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:31.752671 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ddc41-0b19-4ff5-b335-acb1650e4bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:31.752948 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ddc41-0b19-4ff5-b335-acb1650e4bc9 admin admin] PATH_INFO: `/v3/projects/7638764ee4b1437ab5abbdac4bbe2455/users/3128006b609447a08f53779287cc499e/roles/fe9379cda35c4ff78576fe48b60bea3c` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:31.757358 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1ddc41-0b19-4ff5-b335-acb1650e4bc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7638764ee4b1437ab5abbdac4bbe2455, user_id=3128006b609447a08f53779287cc499e, role_id=fe9379cda35c4ff78576fe48b60bea3c)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:31.763408 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1ddc41-0b19-4ff5-b335-acb1650e4bc9 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:31.800384 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 813/1648] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:29:31 2022] PUT /identity/v3/projects/7638764ee4b1437ab5abbdac4bbe2455/users/3128006b609447a08f53779287cc499e/roles/fe9379cda35c4ff78576fe48b60bea3c => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:29:31.811137 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501cac2-484b-4514-ba6e-acd2137e50f4 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:31.811568 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501cac2-484b-4514-ba6e-acd2137e50f4 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:31.811953 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501cac2-484b-4514-ba6e-acd2137e50f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:31.896091 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-c501cac2-484b-4514-ba6e-acd2137e50f4 None None] MFA Rules not processed for user `3128006b609447a08f53779287cc499e`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:29:31.898782 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-c501cac2-484b-4514-ba6e-acd2137e50f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:32.072177 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 836/1649] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:29:31 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:29:32.191576 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ddc41-0b19-4ff5-b335-acb1650e4bc9 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:32.194372 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-9c1ddc41-0b19-4ff5-b335-acb1650e4bc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:32.360719 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ddc41-0b19-4ff5-b335-acb1650e4bc9 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:32.395643 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4933f2-86aa-4281-a3df-3a3da61f8612 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f537aabf3d1040ff840b02616f839975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:32.398110 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4933f2-86aa-4281-a3df-3a3da61f8612 service cinder] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:32.398110 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4933f2-86aa-4281-a3df-3a3da61f8612 service cinder] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:32.398110 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4933f2-86aa-4281-a3df-3a3da61f8612 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:32.408797 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4933f2-86aa-4281-a3df-3a3da61f8612 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:32.410057 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4933f2-86aa-4281-a3df-3a3da61f8612 service cinder] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:32.426557 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 814/1650] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:29:32 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:29:33.420322 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501cac2-484b-4514-ba6e-acd2137e50f4 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:33.426199 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4933f2-86aa-4281-a3df-3a3da61f8612 service cinder] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:33.427147 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-c501cac2-484b-4514-ba6e-acd2137e50f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:33.519809 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4933f2-86aa-4281-a3df-3a3da61f8612 service cinder] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:33.526750 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4002d66a-f437-4ae2-8a4f-6c359dbc13db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:33.527795 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4002d66a-f437-4ae2-8a4f-6c359dbc13db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:33.528079 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4002d66a-f437-4ae2-8a4f-6c359dbc13db admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:33.528928 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4002d66a-f437-4ae2-8a4f-6c359dbc13db admin admin] PATH_INFO: `/v3/users/9f3f5f170bf945d7b19963e03a88833f` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:33.530280 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4002d66a-f437-4ae2-8a4f-6c359dbc13db admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f3f5f170bf945d7b19963e03a88833f)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:33.532630 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4002d66a-f437-4ae2-8a4f-6c359dbc13db admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:33.551434 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501cac2-484b-4514-ba6e-acd2137e50f4 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:33.564649 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6ee9e4-be9d-4f25-8972-198e3238ac26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:33.565317 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ee9e4-be9d-4f25-8972-198e3238ac26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:33.565581 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ee9e4-be9d-4f25-8972-198e3238ac26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:33.565855 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ee9e4-be9d-4f25-8972-198e3238ac26 admin admin] PATH_INFO: `/v3/users/0ce066d8dc8243bc9bb0b36250288677` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:33.567042 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6ee9e4-be9d-4f25-8972-198e3238ac26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ce066d8dc8243bc9bb0b36250288677)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:33.569004 dv-cinder-849143-9-smb devstack@keystone.service[81379]: WARNING py.warnings [None req-5c6ee9e4-be9d-4f25-8972-198e3238ac26 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 03:29:33.569004 dv-cinder-849143-9-smb devstack@keystone.service[81379]: warnings.warn(msg) Oct 04 03:29:33.569004 dv-cinder-849143-9-smb devstack@keystone.service[81379]: Oct 04 03:29:33.570207 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6ee9e4-be9d-4f25-8972-198e3238ac26 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:33.594693 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:29:33.609068 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:29:33.609701 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-4002d66a-f437-4ae2-8a4f-6c359dbc13db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f3f5f170bf945d7b19963e03a88833f'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:29:33.618710 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-4002d66a-f437-4ae2-8a4f-6c359dbc13db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f3f5f170bf945d7b19963e03a88833f'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:29:33.629580 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-4002d66a-f437-4ae2-8a4f-6c359dbc13db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f3f5f170bf945d7b19963e03a88833f'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:29:33.632071 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-4002d66a-f437-4ae2-8a4f-6c359dbc13db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f3f5f170bf945d7b19963e03a88833f'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:29:33.653712 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-4002d66a-f437-4ae2-8a4f-6c359dbc13db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f3f5f170bf945d7b19963e03a88833f'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:29:33.665907 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 815/1651] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:29:33 2022] DELETE /identity/v3/users/9f3f5f170bf945d7b19963e03a88833f => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 03:29:33.668987 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a131351-3e2f-4888-815e-e5ce02e4cb6f None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:33.669285 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a131351-3e2f-4888-815e-e5ce02e4cb6f None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:33.669565 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a131351-3e2f-4888-815e-e5ce02e4cb6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:33.703693 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-4a131351-3e2f-4888-815e-e5ce02e4cb6f None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:29:33.706375 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-4a131351-3e2f-4888-815e-e5ce02e4cb6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:33.718617 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-5c6ee9e4-be9d-4f25-8972-198e3238ac26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ce066d8dc8243bc9bb0b36250288677'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:29:33.719433 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-5c6ee9e4-be9d-4f25-8972-198e3238ac26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ce066d8dc8243bc9bb0b36250288677'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:29:33.736005 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-5c6ee9e4-be9d-4f25-8972-198e3238ac26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ce066d8dc8243bc9bb0b36250288677'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:29:33.736657 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-5c6ee9e4-be9d-4f25-8972-198e3238ac26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ce066d8dc8243bc9bb0b36250288677'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:29:33.774322 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-5c6ee9e4-be9d-4f25-8972-198e3238ac26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ce066d8dc8243bc9bb0b36250288677'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:29:33.790974 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 816/1652] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:29:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:29:33.814654 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 837/1653] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:29:33 2022] DELETE /identity/v3/users/0ce066d8dc8243bc9bb0b36250288677 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:29:33.821171 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdec7929-cf07-4fb8-a198-6d9f7708c47e None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:33.821447 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdec7929-cf07-4fb8-a198-6d9f7708c47e None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:33.822968 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdec7929-cf07-4fb8-a198-6d9f7708c47e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:33.823073 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a131351-3e2f-4888-815e-e5ce02e4cb6f None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:33.824443 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-4a131351-3e2f-4888-815e-e5ce02e4cb6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:33.858165 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-fdec7929-cf07-4fb8-a198-6d9f7708c47e None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:29:33.859404 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-fdec7929-cf07-4fb8-a198-6d9f7708c47e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:33.921326 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a131351-3e2f-4888-815e-e5ce02e4cb6f None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:33.991395 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 838/1654] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:29:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:29:34.000362 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bd0574-7716-4631-9fa2-869e23548960 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:34.001153 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd0574-7716-4631-9fa2-869e23548960 service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:34.001540 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd0574-7716-4631-9fa2-869e23548960 service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:34.001919 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd0574-7716-4631-9fa2-869e23548960 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:34.016248 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bd0574-7716-4631-9fa2-869e23548960 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:34.019150 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bd0574-7716-4631-9fa2-869e23548960 service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:34.055427 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 817/1655] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:29:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:29:34.055971 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdec7929-cf07-4fb8-a198-6d9f7708c47e None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:34.057990 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-fdec7929-cf07-4fb8-a198-6d9f7708c47e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:34.072643 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdec7929-cf07-4fb8-a198-6d9f7708c47e None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:34.081555 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4fb0cd-da01-4317-bce5-30818f09ab99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:34.083419 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4fb0cd-da01-4317-bce5-30818f09ab99 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:34.084577 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4fb0cd-da01-4317-bce5-30818f09ab99 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:34.085061 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4fb0cd-da01-4317-bce5-30818f09ab99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:34.101202 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4fb0cd-da01-4317-bce5-30818f09ab99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:34.103884 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4fb0cd-da01-4317-bce5-30818f09ab99 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:34.122476 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 839/1656] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:29:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 03:29:36.868142 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bd0574-7716-4631-9fa2-869e23548960 service neutron] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:36.870489 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-31bd0574-7716-4631-9fa2-869e23548960 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:36.893749 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4fb0cd-da01-4317-bce5-30818f09ab99 service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:36.895315 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-db4fb0cd-da01-4317-bce5-30818f09ab99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:36.906989 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bd0574-7716-4631-9fa2-869e23548960 service neutron] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:36.927371 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1256b82b-8c2b-4a01-9819-c7e63fecd7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:36.931244 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4fb0cd-da01-4317-bce5-30818f09ab99 service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:36.936109 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1256b82b-8c2b-4a01-9819-c7e63fecd7fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:36.936525 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1256b82b-8c2b-4a01-9819-c7e63fecd7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:36.943768 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1256b82b-8c2b-4a01-9819-c7e63fecd7fa admin admin] PATH_INFO: `/v3/projects/4d600d07376d4501b747f75a0ec86cc4` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:36.953810 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1256b82b-8c2b-4a01-9819-c7e63fecd7fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d600d07376d4501b747f75a0ec86cc4)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:36.964793 dv-cinder-849143-9-smb devstack@keystone.service[81380]: WARNING py.warnings [None req-1256b82b-8c2b-4a01-9819-c7e63fecd7fa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 03:29:36.964793 dv-cinder-849143-9-smb devstack@keystone.service[81380]: warnings.warn(msg) Oct 04 03:29:36.964793 dv-cinder-849143-9-smb devstack@keystone.service[81380]: Oct 04 03:29:36.967551 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13de0eeb-661d-4a3f-b39b-f7fcf04efa66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:36.968284 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1256b82b-8c2b-4a01-9819-c7e63fecd7fa admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:36.970364 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13de0eeb-661d-4a3f-b39b-f7fcf04efa66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:36.971527 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13de0eeb-661d-4a3f-b39b-f7fcf04efa66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:36.972781 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13de0eeb-661d-4a3f-b39b-f7fcf04efa66 admin admin] PATH_INFO: `/v3/users/e9652447e9a14a8aa8a59b63667e7e2d` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:36.980421 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13de0eeb-661d-4a3f-b39b-f7fcf04efa66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9652447e9a14a8aa8a59b63667e7e2d)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:36.995456 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13de0eeb-661d-4a3f-b39b-f7fcf04efa66 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:37.007966 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:29:37.156782 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-13de0eeb-661d-4a3f-b39b-f7fcf04efa66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9652447e9a14a8aa8a59b63667e7e2d'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:29:37.157935 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-13de0eeb-661d-4a3f-b39b-f7fcf04efa66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9652447e9a14a8aa8a59b63667e7e2d'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:29:37.180612 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-13de0eeb-661d-4a3f-b39b-f7fcf04efa66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9652447e9a14a8aa8a59b63667e7e2d'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:29:37.185614 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-13de0eeb-661d-4a3f-b39b-f7fcf04efa66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9652447e9a14a8aa8a59b63667e7e2d'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:29:37.187155 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-1256b82b-8c2b-4a01-9819-c7e63fecd7fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d600d07376d4501b747f75a0ec86cc4', 'request_id': 'req-1256b82b-8c2b-4a01-9819-c7e63fecd7fa'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:29:37.212575 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-1256b82b-8c2b-4a01-9819-c7e63fecd7fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d600d07376d4501b747f75a0ec86cc4', 'request_id': 'req-1256b82b-8c2b-4a01-9819-c7e63fecd7fa'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:29:37.235180 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-13de0eeb-661d-4a3f-b39b-f7fcf04efa66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9652447e9a14a8aa8a59b63667e7e2d'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:29:37.244113 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:29:37.254178 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-1256b82b-8c2b-4a01-9819-c7e63fecd7fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d600d07376d4501b747f75a0ec86cc4', 'request_id': 'req-1256b82b-8c2b-4a01-9819-c7e63fecd7fa'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:29:37.285193 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-1256b82b-8c2b-4a01-9819-c7e63fecd7fa admin admin] The token cache is being invalidate because project 4d600d07376d4501b747f75a0ec86cc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:29:37.285535 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-1256b82b-8c2b-4a01-9819-c7e63fecd7fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:29:37.286644 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-1256b82b-8c2b-4a01-9819-c7e63fecd7fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:29:37.289939 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 818/1658] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:29:36 2022] DELETE /identity/v3/projects/4d600d07376d4501b747f75a0ec86cc4 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 03:29:37.290938 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 840/1658] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:29:36 2022] DELETE /identity/v3/users/e9652447e9a14a8aa8a59b63667e7e2d => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 03:29:37.294414 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1256b82b-8c2b-4a01-9819-c7e63fecd7fa admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:37.296502 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1381b462-135d-4247-a053-e65d2880a106 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:37.297037 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1381b462-135d-4247-a053-e65d2880a106 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:37.297541 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1381b462-135d-4247-a053-e65d2880a106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:37.301275 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-1256b82b-8c2b-4a01-9819-c7e63fecd7fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:37.375208 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-1381b462-135d-4247-a053-e65d2880a106 None None] MFA Rules not processed for user `542b137fb8cd4d25867d95a13d2cb651`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:29:37.377399 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-1381b462-135d-4247-a053-e65d2880a106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:37.501053 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1256b82b-8c2b-4a01-9819-c7e63fecd7fa admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:37.561282 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 841/1659] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:29:37 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:29:37.573045 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bcf872-ebdc-41bd-bf8c-5b8896e2061d None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:37.573338 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bcf872-ebdc-41bd-bf8c-5b8896e2061d None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:37.573621 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bcf872-ebdc-41bd-bf8c-5b8896e2061d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:37.677062 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-b0bcf872-ebdc-41bd-bf8c-5b8896e2061d None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:29:37.683075 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-b0bcf872-ebdc-41bd-bf8c-5b8896e2061d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:37.720315 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3732eb6c-be9c-4ee1-959e-91d11a234645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:37.722207 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732eb6c-be9c-4ee1-959e-91d11a234645 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:37.724808 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732eb6c-be9c-4ee1-959e-91d11a234645 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:37.725534 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732eb6c-be9c-4ee1-959e-91d11a234645 admin admin] PATH_INFO: `/v3/projects/18412a6002ce4900a089ca90f2e9f7b3` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:37.728727 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3732eb6c-be9c-4ee1-959e-91d11a234645 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18412a6002ce4900a089ca90f2e9f7b3)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:37.746224 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3732eb6c-be9c-4ee1-959e-91d11a234645 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:37.889737 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:29:37.909157 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-3732eb6c-be9c-4ee1-959e-91d11a234645 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18412a6002ce4900a089ca90f2e9f7b3', 'request_id': 'req-3732eb6c-be9c-4ee1-959e-91d11a234645'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:29:37.919415 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 842/1660] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:29:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:29:37.923912 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bcf872-ebdc-41bd-bf8c-5b8896e2061d None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:37.928887 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-b0bcf872-ebdc-41bd-bf8c-5b8896e2061d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:37.935755 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-3732eb6c-be9c-4ee1-959e-91d11a234645 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18412a6002ce4900a089ca90f2e9f7b3', 'request_id': 'req-3732eb6c-be9c-4ee1-959e-91d11a234645'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:29:37.955172 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-3732eb6c-be9c-4ee1-959e-91d11a234645 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18412a6002ce4900a089ca90f2e9f7b3', 'request_id': 'req-3732eb6c-be9c-4ee1-959e-91d11a234645'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:29:37.972563 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bcf872-ebdc-41bd-bf8c-5b8896e2061d None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:37.985510 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-3732eb6c-be9c-4ee1-959e-91d11a234645 admin admin] The token cache is being invalidate because project 18412a6002ce4900a089ca90f2e9f7b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:29:37.986314 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-3732eb6c-be9c-4ee1-959e-91d11a234645 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:29:37.987525 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-3732eb6c-be9c-4ee1-959e-91d11a234645 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:29:37.989595 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 819/1661] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:29:37 2022] DELETE /identity/v3/projects/18412a6002ce4900a089ca90f2e9f7b3 => generated 0 bytes in 699 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:29:37.991552 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3732eb6c-be9c-4ee1-959e-91d11a234645 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:37.993849 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-3732eb6c-be9c-4ee1-959e-91d11a234645 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:38.152079 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4685624f-d7f7-4e97-95b2-4c6b291de276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:38.153189 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685624f-d7f7-4e97-95b2-4c6b291de276 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:38.153579 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685624f-d7f7-4e97-95b2-4c6b291de276 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:38.153957 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685624f-d7f7-4e97-95b2-4c6b291de276 admin admin] PATH_INFO: `/v3/users/3128006b609447a08f53779287cc499e` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:38.155238 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4685624f-d7f7-4e97-95b2-4c6b291de276 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3128006b609447a08f53779287cc499e)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:38.157330 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4685624f-d7f7-4e97-95b2-4c6b291de276 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:38.187351 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3732eb6c-be9c-4ee1-959e-91d11a234645 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:38.205003 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9392c84-c31f-47b0-8a2f-48f6666df5c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1f412befb9418fa66a2aabf475aa90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:38.205558 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9392c84-c31f-47b0-8a2f-48f6666df5c0 service nova] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:38.207637 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:29:38.208207 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9392c84-c31f-47b0-8a2f-48f6666df5c0 service nova] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:38.208501 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9392c84-c31f-47b0-8a2f-48f6666df5c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:38.214533 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-c9392c84-c31f-47b0-8a2f-48f6666df5c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:38.273337 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-4685624f-d7f7-4e97-95b2-4c6b291de276 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3128006b609447a08f53779287cc499e'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:29:38.274231 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-4685624f-d7f7-4e97-95b2-4c6b291de276 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3128006b609447a08f53779287cc499e'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:29:38.294164 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-4685624f-d7f7-4e97-95b2-4c6b291de276 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3128006b609447a08f53779287cc499e'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:29:38.294841 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-4685624f-d7f7-4e97-95b2-4c6b291de276 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3128006b609447a08f53779287cc499e'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:29:38.315390 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-4685624f-d7f7-4e97-95b2-4c6b291de276 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3128006b609447a08f53779287cc499e'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:29:38.335701 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9392c84-c31f-47b0-8a2f-48f6666df5c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:38.340859 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9392c84-c31f-47b0-8a2f-48f6666df5c0 service nova] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:38.362529 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 820/1662] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:29:37 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:29:38.363192 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 843/1663] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:29:37 2022] DELETE /identity/v3/users/3128006b609447a08f53779287cc499e => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:29:38.364714 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef7cd5-0171-4e78-b405-879a31e1b87c None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:38.366689 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef7cd5-0171-4e78-b405-879a31e1b87c None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:38.367204 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9392c84-c31f-47b0-8a2f-48f6666df5c0 service nova] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:38.367595 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef7cd5-0171-4e78-b405-879a31e1b87c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:38.372328 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-c9392c84-c31f-47b0-8a2f-48f6666df5c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:38.448214 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-f6ef7cd5-0171-4e78-b405-879a31e1b87c None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:29:38.449867 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-f6ef7cd5-0171-4e78-b405-879a31e1b87c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:38.627794 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9392c84-c31f-47b0-8a2f-48f6666df5c0 service nova] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:38.693783 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:29:38.736400 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 844/1664] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:29:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:29:38.743395 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfdca52-aa6a-42cc-bb9f-c1091c9b2452 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:38.753090 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfdca52-aa6a-42cc-bb9f-c1091c9b2452 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:38.753442 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfdca52-aa6a-42cc-bb9f-c1091c9b2452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:38.805587 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df793c15-201c-4079-af96-168a6747d356 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:38.808677 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df793c15-201c-4079-af96-168a6747d356 service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:38.809091 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df793c15-201c-4079-af96-168a6747d356 service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:38.809301 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df793c15-201c-4079-af96-168a6747d356 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:38.815603 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-df793c15-201c-4079-af96-168a6747d356 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:38.822421 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-dbfdca52-aa6a-42cc-bb9f-c1091c9b2452 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:29:38.823779 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-dbfdca52-aa6a-42cc-bb9f-c1091c9b2452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:38.851169 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 845/1665] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:29:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:29:38.855540 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfdca52-aa6a-42cc-bb9f-c1091c9b2452 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:38.871029 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df793c15-201c-4079-af96-168a6747d356 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:38.875435 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df793c15-201c-4079-af96-168a6747d356 service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:38.880202 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfdca52-aa6a-42cc-bb9f-c1091c9b2452 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:38.897518 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca18b1-7a50-462a-a32b-eb977ba4b8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:38.899468 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca18b1-7a50-462a-a32b-eb977ba4b8f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:38.914701 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca18b1-7a50-462a-a32b-eb977ba4b8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:38.918013 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca18b1-7a50-462a-a32b-eb977ba4b8f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:38.919289 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ca18b1-7a50-462a-a32b-eb977ba4b8f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:29:38.920719 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 821/1666] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:29:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:29:38.923569 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ca18b1-7a50-462a-a32b-eb977ba4b8f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:38.926175 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ca18b1-7a50-462a-a32b-eb977ba4b8f9 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:38.970320 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 846/1667] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 03:29:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:29:38.974886 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df793c15-201c-4079-af96-168a6747d356 service neutron] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:38.992705 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df793c15-201c-4079-af96-168a6747d356 service neutron] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:39.021459 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b225749e-b180-4e45-b25d-76f70f5f6cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:39.022210 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225749e-b180-4e45-b25d-76f70f5f6cc3 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:39.022571 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225749e-b180-4e45-b25d-76f70f5f6cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:39.022854 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225749e-b180-4e45-b25d-76f70f5f6cc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:39.023740 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b225749e-b180-4e45-b25d-76f70f5f6cc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:39.026280 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b225749e-b180-4e45-b25d-76f70f5f6cc3 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:39.085968 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 822/1668] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:29:38 2022] POST /identity/v3/projects => generated 405 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:29:39.090449 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca18b1-7a50-462a-a32b-eb977ba4b8f9 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:39.109249 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca18b1-7a50-462a-a32b-eb977ba4b8f9 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:39.281261 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5289b6cf-ef57-471a-ac7f-80c77e22cd42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:39.282002 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5289b6cf-ef57-471a-ac7f-80c77e22cd42 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:39.282317 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5289b6cf-ef57-471a-ac7f-80c77e22cd42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:39.282698 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5289b6cf-ef57-471a-ac7f-80c77e22cd42 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:39.283386 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5289b6cf-ef57-471a-ac7f-80c77e22cd42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:39.285863 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5289b6cf-ef57-471a-ac7f-80c77e22cd42 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:39.327877 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 847/1669] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:29:39 2022] POST /identity/v3/users => generated 303 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:29:39.329167 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b225749e-b180-4e45-b25d-76f70f5f6cc3 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:39.344972 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b225749e-b180-4e45-b25d-76f70f5f6cc3 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:39.355310 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8472f82-6b09-449a-81a8-567713148c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:39.356126 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8472f82-6b09-449a-81a8-567713148c89 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:39.356770 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8472f82-6b09-449a-81a8-567713148c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:39.357180 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8472f82-6b09-449a-81a8-567713148c89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:39.358616 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8472f82-6b09-449a-81a8-567713148c89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:39.360844 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8472f82-6b09-449a-81a8-567713148c89 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:39.383125 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 823/1670] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:29:39 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:29:39.384951 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5289b6cf-ef57-471a-ac7f-80c77e22cd42 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:39.402893 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5289b6cf-ef57-471a-ac7f-80c77e22cd42 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:39.409066 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f312a674-4bd2-4ada-8725-1b17e9e7bd2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:39.409691 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312a674-4bd2-4ada-8725-1b17e9e7bd2a admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:39.409974 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312a674-4bd2-4ada-8725-1b17e9e7bd2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:39.410250 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312a674-4bd2-4ada-8725-1b17e9e7bd2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:39.411121 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f312a674-4bd2-4ada-8725-1b17e9e7bd2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:39.414483 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f312a674-4bd2-4ada-8725-1b17e9e7bd2a admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:39.422161 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:29:39.444914 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 848/1671] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:29:39 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:29:39.446874 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8472f82-6b09-449a-81a8-567713148c89 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:39.464826 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8472f82-6b09-449a-81a8-567713148c89 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:39.473143 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531299db-9faf-4d91-9e43-3a693d9c9550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:39.475829 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531299db-9faf-4d91-9e43-3a693d9c9550 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:39.476295 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531299db-9faf-4d91-9e43-3a693d9c9550 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:39.476888 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531299db-9faf-4d91-9e43-3a693d9c9550 admin admin] PATH_INFO: `/v3/projects/197ffba89a3e433394b5d49ab838b517/users/c9521db74a4b4492b1453236d7e9d2ca/roles/04d0e4575a28440eb4349b4a6565e8b8` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:39.519213 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531299db-9faf-4d91-9e43-3a693d9c9550 admin admin] RBAC: Authorizing `identity:create_grant(project_id=197ffba89a3e433394b5d49ab838b517, user_id=c9521db74a4b4492b1453236d7e9d2ca, role_id=04d0e4575a28440eb4349b4a6565e8b8)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:39.525007 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531299db-9faf-4d91-9e43-3a693d9c9550 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:39.551998 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 824/1672] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:29:39 2022] PUT /identity/v3/projects/197ffba89a3e433394b5d49ab838b517/users/c9521db74a4b4492b1453236d7e9d2ca/roles/04d0e4575a28440eb4349b4a6565e8b8 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:29:39.553822 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbfe396-9ef8-455e-aace-e023f9faad0a None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:39.554117 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbfe396-9ef8-455e-aace-e023f9faad0a None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:39.554390 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbfe396-9ef8-455e-aace-e023f9faad0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:39.588908 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-6dbfe396-9ef8-455e-aace-e023f9faad0a None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:29:39.608289 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-6dbfe396-9ef8-455e-aace-e023f9faad0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:39.829531 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 849/1673] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:29:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:29:39.944246 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531299db-9faf-4d91-9e43-3a693d9c9550 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:39.947190 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-531299db-9faf-4d91-9e43-3a693d9c9550 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:39.972419 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbfe396-9ef8-455e-aace-e023f9faad0a None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:39.975201 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-6dbfe396-9ef8-455e-aace-e023f9faad0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:40.002989 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbfe396-9ef8-455e-aace-e023f9faad0a None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:40.017148 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b6c657-23f6-4ebf-a114-485079615d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:40.017807 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b6c657-23f6-4ebf-a114-485079615d7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:40.018091 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b6c657-23f6-4ebf-a114-485079615d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:40.018367 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b6c657-23f6-4ebf-a114-485079615d7c admin admin] PATH_INFO: `/v3/projects/7638764ee4b1437ab5abbdac4bbe2455` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:40.024551 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b6c657-23f6-4ebf-a114-485079615d7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7638764ee4b1437ab5abbdac4bbe2455)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:40.026514 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b6c657-23f6-4ebf-a114-485079615d7c admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:40.093168 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531299db-9faf-4d91-9e43-3a693d9c9550 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:40.103591 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dac4a2-ab2c-4b43-a50e-01ba5512454e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:40.105078 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dac4a2-ab2c-4b43-a50e-01ba5512454e service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:40.110105 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dac4a2-ab2c-4b43-a50e-01ba5512454e service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:40.110420 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dac4a2-ab2c-4b43-a50e-01ba5512454e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:40.134415 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dac4a2-ab2c-4b43-a50e-01ba5512454e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:40.138349 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dac4a2-ab2c-4b43-a50e-01ba5512454e service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:40.169299 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 825/1674] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:29:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:29:40.181274 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-49b6c657-23f6-4ebf-a114-485079615d7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7638764ee4b1437ab5abbdac4bbe2455', 'request_id': 'req-49b6c657-23f6-4ebf-a114-485079615d7c'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:29:40.192618 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-49b6c657-23f6-4ebf-a114-485079615d7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7638764ee4b1437ab5abbdac4bbe2455', 'request_id': 'req-49b6c657-23f6-4ebf-a114-485079615d7c'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:29:40.203130 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-49b6c657-23f6-4ebf-a114-485079615d7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7638764ee4b1437ab5abbdac4bbe2455', 'request_id': 'req-49b6c657-23f6-4ebf-a114-485079615d7c'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:29:40.235752 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-49b6c657-23f6-4ebf-a114-485079615d7c admin admin] The token cache is being invalidate because project 7638764ee4b1437ab5abbdac4bbe2455 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:29:40.236059 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-49b6c657-23f6-4ebf-a114-485079615d7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:29:40.239394 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-49b6c657-23f6-4ebf-a114-485079615d7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:29:40.241940 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 850/1675] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:29:39 2022] DELETE /identity/v3/projects/7638764ee4b1437ab5abbdac4bbe2455 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:29:40.246725 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2afc13c-60df-472c-9d26-9715be9cec97 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:40.247010 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2afc13c-60df-472c-9d26-9715be9cec97 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:40.247276 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2afc13c-60df-472c-9d26-9715be9cec97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:40.273738 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-a2afc13c-60df-472c-9d26-9715be9cec97 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:29:40.274968 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-a2afc13c-60df-472c-9d26-9715be9cec97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:40.447586 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 826/1676] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:29:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:29:40.453700 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f401921-dc6e-4b85-a1e3-c3a3772bb271 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:40.453986 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f401921-dc6e-4b85-a1e3-c3a3772bb271 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:40.454263 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f401921-dc6e-4b85-a1e3-c3a3772bb271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:40.493156 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-2f401921-dc6e-4b85-a1e3-c3a3772bb271 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:29:40.495733 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-2f401921-dc6e-4b85-a1e3-c3a3772bb271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:40.523392 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 851/1677] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:29:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:29:40.524040 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2afc13c-60df-472c-9d26-9715be9cec97 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:40.540761 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2afc13c-60df-472c-9d26-9715be9cec97 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:40.555515 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662ca450-5908-4529-95fe-01f8006a3e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:40.558025 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ca450-5908-4529-95fe-01f8006a3e0b admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:40.560522 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ca450-5908-4529-95fe-01f8006a3e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:40.561344 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ca450-5908-4529-95fe-01f8006a3e0b admin admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:40.564691 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662ca450-5908-4529-95fe-01f8006a3e0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:29:40.565933 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662ca450-5908-4529-95fe-01f8006a3e0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:40.572791 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662ca450-5908-4529-95fe-01f8006a3e0b admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:40.596149 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:29:40.609356 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 827/1678] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 03:29:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:29:40.614526 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f401921-dc6e-4b85-a1e3-c3a3772bb271 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:40.629578 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f401921-dc6e-4b85-a1e3-c3a3772bb271 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:40.650911 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19b4d78-fd01-4ea9-826b-ffacb81c3474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:40.650911 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b4d78-fd01-4ea9-826b-ffacb81c3474 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:40.650911 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b4d78-fd01-4ea9-826b-ffacb81c3474 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:40.651157 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b4d78-fd01-4ea9-826b-ffacb81c3474 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:40.652387 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19b4d78-fd01-4ea9-826b-ffacb81c3474 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:40.656804 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19b4d78-fd01-4ea9-826b-ffacb81c3474 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:40.732938 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662ca450-5908-4529-95fe-01f8006a3e0b admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:40.744018 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 852/1679] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:29:40 2022] POST /identity/v3/projects => generated 387 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:29:40.750008 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662ca450-5908-4529-95fe-01f8006a3e0b admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:40.887385 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd23a64-ce09-4461-9fea-c48f4426507d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:40.888104 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd23a64-ce09-4461-9fea-c48f4426507d admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:40.888451 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd23a64-ce09-4461-9fea-c48f4426507d admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:40.888794 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd23a64-ce09-4461-9fea-c48f4426507d admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:40.889670 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd23a64-ce09-4461-9fea-c48f4426507d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:40.893483 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd23a64-ce09-4461-9fea-c48f4426507d admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:40.948754 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19b4d78-fd01-4ea9-826b-ffacb81c3474 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:40.949256 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 828/1680] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:29:40 2022] POST /identity/v3/users => generated 294 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:29:40.960680 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19b4d78-fd01-4ea9-826b-ffacb81c3474 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:40.975125 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f59ab-9aed-4a07-a424-fe44e1cc3710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:40.975809 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f59ab-9aed-4a07-a424-fe44e1cc3710 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:40.977885 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f59ab-9aed-4a07-a424-fe44e1cc3710 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:40.978549 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f59ab-9aed-4a07-a424-fe44e1cc3710 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:40.980052 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6f59ab-9aed-4a07-a424-fe44e1cc3710 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:40.985429 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6f59ab-9aed-4a07-a424-fe44e1cc3710 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:41.018914 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 853/1681] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:29:41.020640 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd23a64-ce09-4461-9fea-c48f4426507d admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:41.040863 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd23a64-ce09-4461-9fea-c48f4426507d admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:41.055042 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9516bc87-dc11-4b11-a0e4-a7757d339141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:41.055954 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9516bc87-dc11-4b11-a0e4-a7757d339141 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:41.056264 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9516bc87-dc11-4b11-a0e4-a7757d339141 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:41.059205 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9516bc87-dc11-4b11-a0e4-a7757d339141 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:41.065484 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9516bc87-dc11-4b11-a0e4-a7757d339141 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:41.067190 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9516bc87-dc11-4b11-a0e4-a7757d339141 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:41.094998 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f59ab-9aed-4a07-a424-fe44e1cc3710 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:41.105145 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 829/1682] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:29:41 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 03:29:41.119192 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f59ab-9aed-4a07-a424-fe44e1cc3710 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:41.124645 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395fa1dd-3c82-42b0-8576-f0e2ae61a13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:41.125632 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395fa1dd-3c82-42b0-8576-f0e2ae61a13d admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:41.126053 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395fa1dd-3c82-42b0-8576-f0e2ae61a13d admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:41.126956 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395fa1dd-3c82-42b0-8576-f0e2ae61a13d admin admin] PATH_INFO: `/v3/projects/1933ab78b11d4e0b84d7bc038a54084f/users/8e2f574100454ebd9e750061ba79b0fd/roles/04d0e4575a28440eb4349b4a6565e8b8` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:41.153595 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395fa1dd-3c82-42b0-8576-f0e2ae61a13d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1933ab78b11d4e0b84d7bc038a54084f, user_id=8e2f574100454ebd9e750061ba79b0fd, role_id=04d0e4575a28440eb4349b4a6565e8b8)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:41.156996 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395fa1dd-3c82-42b0-8576-f0e2ae61a13d admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:41.203869 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaaf6b4-6a25-4bcd-b932-75d3d9d671b4 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:41.204162 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaaf6b4-6a25-4bcd-b932-75d3d9d671b4 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:41.204516 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaaf6b4-6a25-4bcd-b932-75d3d9d671b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:41.205329 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 854/1683] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:29:41 2022] PUT /identity/v3/projects/1933ab78b11d4e0b84d7bc038a54084f/users/8e2f574100454ebd9e750061ba79b0fd/roles/04d0e4575a28440eb4349b4a6565e8b8 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:29:41.326287 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-7eaaf6b4-6a25-4bcd-b932-75d3d9d671b4 None None] MFA Rules not processed for user `8e2f574100454ebd9e750061ba79b0fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:29:41.327088 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-7eaaf6b4-6a25-4bcd-b932-75d3d9d671b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:41.384541 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395fa1dd-3c82-42b0-8576-f0e2ae61a13d admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:41.386773 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-395fa1dd-3c82-42b0-8576-f0e2ae61a13d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:41.449023 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:29:41.561762 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 830/1684] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:29:41 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 03:29:41.566270 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaaf6b4-6a25-4bcd-b932-75d3d9d671b4 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:41.587867 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395fa1dd-3c82-42b0-8576-f0e2ae61a13d admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:41.595167 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaaf6b4-6a25-4bcd-b932-75d3d9d671b4 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:41.605383 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515832a9-2404-4a27-8e71-fe94d8665253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:41.606045 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515832a9-2404-4a27-8e71-fe94d8665253 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:41.606328 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515832a9-2404-4a27-8e71-fe94d8665253 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:41.606606 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515832a9-2404-4a27-8e71-fe94d8665253 admin admin] PATH_INFO: `/v3/projects/2cdbdb7c052645e28477dd56010aeb29` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:41.608208 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515832a9-2404-4a27-8e71-fe94d8665253 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cdbdb7c052645e28477dd56010aeb29)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:41.610120 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515832a9-2404-4a27-8e71-fe94d8665253 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:41.625185 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bf1b29-9aa2-44ad-8022-f0d8fb3e5a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:41.625820 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bf1b29-9aa2-44ad-8022-f0d8fb3e5a7c admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:41.626103 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bf1b29-9aa2-44ad-8022-f0d8fb3e5a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:41.626384 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bf1b29-9aa2-44ad-8022-f0d8fb3e5a7c admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:41.627864 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bf1b29-9aa2-44ad-8022-f0d8fb3e5a7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:41.638132 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bf1b29-9aa2-44ad-8022-f0d8fb3e5a7c admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:41.743954 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 831/1685] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:29:41 2022] POST /identity/v3/projects => generated 385 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 03:29:41.746534 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bf1b29-9aa2-44ad-8022-f0d8fb3e5a7c admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:41.772244 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-515832a9-2404-4a27-8e71-fe94d8665253 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cdbdb7c052645e28477dd56010aeb29', 'request_id': 'req-515832a9-2404-4a27-8e71-fe94d8665253'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:29:41.789565 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-515832a9-2404-4a27-8e71-fe94d8665253 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cdbdb7c052645e28477dd56010aeb29', 'request_id': 'req-515832a9-2404-4a27-8e71-fe94d8665253'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:29:41.806813 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-515832a9-2404-4a27-8e71-fe94d8665253 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cdbdb7c052645e28477dd56010aeb29', 'request_id': 'req-515832a9-2404-4a27-8e71-fe94d8665253'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:29:41.841619 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-515832a9-2404-4a27-8e71-fe94d8665253 admin admin] The token cache is being invalidate because project 2cdbdb7c052645e28477dd56010aeb29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:29:41.842025 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-515832a9-2404-4a27-8e71-fe94d8665253 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:29:41.844400 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-515832a9-2404-4a27-8e71-fe94d8665253 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:29:41.854905 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 855/1686] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:29:41 2022] DELETE /identity/v3/projects/2cdbdb7c052645e28477dd56010aeb29 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:29:41.857700 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc022e41-cefb-4a7f-a27d-26c6050b1ea6 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:41.860768 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc022e41-cefb-4a7f-a27d-26c6050b1ea6 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:41.861375 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc022e41-cefb-4a7f-a27d-26c6050b1ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:41.902657 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:29:41.934143 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bf1b29-9aa2-44ad-8022-f0d8fb3e5a7c admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:41.937405 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-fc022e41-cefb-4a7f-a27d-26c6050b1ea6 None None] MFA Rules not processed for user `3e1b3303d5ca4f5e90176c05f35e70cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:29:41.938653 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-fc022e41-cefb-4a7f-a27d-26c6050b1ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:41.939882 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890124c6-477f-4be3-bef3-68f5e70314d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:41.940738 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890124c6-477f-4be3-bef3-68f5e70314d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:41.941124 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890124c6-477f-4be3-bef3-68f5e70314d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:41.941552 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890124c6-477f-4be3-bef3-68f5e70314d4 admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:41.942608 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890124c6-477f-4be3-bef3-68f5e70314d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:41.947209 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890124c6-477f-4be3-bef3-68f5e70314d4 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:42.008171 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 832/1687] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:29:41 2022] POST /identity/v3/users => generated 293 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:29:42.009213 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae14307-3a3a-49b7-87ef-b030247154c9 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:42.009804 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae14307-3a3a-49b7-87ef-b030247154c9 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:42.010084 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae14307-3a3a-49b7-87ef-b030247154c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:42.064593 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-bae14307-3a3a-49b7-87ef-b030247154c9 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:29:42.066424 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-bae14307-3a3a-49b7-87ef-b030247154c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:42.078599 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 833/1688] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:29:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:29:42.086870 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae14307-3a3a-49b7-87ef-b030247154c9 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:42.088554 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-bae14307-3a3a-49b7-87ef-b030247154c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:42.104910 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 856/1689] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:29:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:29:42.107438 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae14307-3a3a-49b7-87ef-b030247154c9 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:42.115798 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccec236-1c7b-4e5c-931d-f0a17cfe6d3e None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:42.116132 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccec236-1c7b-4e5c-931d-f0a17cfe6d3e None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:42.116540 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccec236-1c7b-4e5c-931d-f0a17cfe6d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:42.121149 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05345f64-5cd1-4bdc-9763-1960f373555c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:42.122081 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05345f64-5cd1-4bdc-9763-1960f373555c admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:42.126002 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05345f64-5cd1-4bdc-9763-1960f373555c admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:42.126759 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05345f64-5cd1-4bdc-9763-1960f373555c admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:42.128046 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05345f64-5cd1-4bdc-9763-1960f373555c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:42.129892 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05345f64-5cd1-4bdc-9763-1960f373555c admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:42.157558 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 834/1690] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:29:42 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:29:42.159533 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6db99a0-1be1-40e9-b197-bbfeb32abce8 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:42.159923 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6db99a0-1be1-40e9-b197-bbfeb32abce8 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:42.160330 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6db99a0-1be1-40e9-b197-bbfeb32abce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:42.174521 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-1ccec236-1c7b-4e5c-931d-f0a17cfe6d3e None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:29:42.179228 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-1ccec236-1c7b-4e5c-931d-f0a17cfe6d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:42.188195 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-a6db99a0-1be1-40e9-b197-bbfeb32abce8 None None] MFA Rules not processed for user `3e1b3303d5ca4f5e90176c05f35e70cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:29:42.192117 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-a6db99a0-1be1-40e9-b197-bbfeb32abce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:42.217149 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 857/1691] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:29:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:29:42.217992 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccec236-1c7b-4e5c-931d-f0a17cfe6d3e None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:42.225688 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 835/1692] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:29:42 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:29:42.226542 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6db99a0-1be1-40e9-b197-bbfeb32abce8 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:42.239824 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6db99a0-1be1-40e9-b197-bbfeb32abce8 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:42.245007 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccec236-1c7b-4e5c-931d-f0a17cfe6d3e None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:42.255403 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cefef13-b017-48c3-bf39-375b0a63ef8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:42.255403 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cefef13-b017-48c3-bf39-375b0a63ef8e admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:42.255403 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cefef13-b017-48c3-bf39-375b0a63ef8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:42.255403 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cefef13-b017-48c3-bf39-375b0a63ef8e admin admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:42.259888 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cefef13-b017-48c3-bf39-375b0a63ef8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:29:42.260348 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cefef13-b017-48c3-bf39-375b0a63ef8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:42.262225 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cefef13-b017-48c3-bf39-375b0a63ef8e admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:42.267515 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ac3ab-0775-4b94-b3c3-bcab9c084f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:42.268173 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ac3ab-0775-4b94-b3c3-bcab9c084f4d admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:42.268461 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ac3ab-0775-4b94-b3c3-bcab9c084f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:42.268740 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ac3ab-0775-4b94-b3c3-bcab9c084f4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:42.269398 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3ac3ab-0775-4b94-b3c3-bcab9c084f4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:42.271007 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3ac3ab-0775-4b94-b3c3-bcab9c084f4d admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:42.294570 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 836/1693] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 03:29:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:29:42.298992 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cefef13-b017-48c3-bf39-375b0a63ef8e admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:42.301429 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 858/1694] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:29:42 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:29:42.302748 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535636e0-2720-44c9-9a47-5102b62be805 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:42.303181 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535636e0-2720-44c9-9a47-5102b62be805 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:42.303478 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535636e0-2720-44c9-9a47-5102b62be805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:42.306087 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-5cefef13-b017-48c3-bf39-375b0a63ef8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:42.364893 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-535636e0-2720-44c9-9a47-5102b62be805 None None] MFA Rules not processed for user `02f76bc3ab354c4a8e9941e1403274ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:29:42.366323 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-535636e0-2720-44c9-9a47-5102b62be805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:42.408848 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:29:42.464321 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cefef13-b017-48c3-bf39-375b0a63ef8e admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:42.473314 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1284769d-8d9f-411d-aeea-6b22b560e648 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1f412befb9418fa66a2aabf475aa90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:42.474730 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1284769d-8d9f-411d-aeea-6b22b560e648 service nova] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:42.475177 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1284769d-8d9f-411d-aeea-6b22b560e648 service nova] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:42.475606 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1284769d-8d9f-411d-aeea-6b22b560e648 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:42.486795 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1284769d-8d9f-411d-aeea-6b22b560e648 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:42.489665 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1284769d-8d9f-411d-aeea-6b22b560e648 service nova] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:42.506757 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 837/1695] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:29:42 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:29:42.508017 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1284769d-8d9f-411d-aeea-6b22b560e648 service nova] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:42.524692 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1284769d-8d9f-411d-aeea-6b22b560e648 service nova] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:42.531816 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c06fa5-3f3e-4364-a4b3-126428b1381b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:42.533083 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c06fa5-3f3e-4364-a4b3-126428b1381b admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:42.533831 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c06fa5-3f3e-4364-a4b3-126428b1381b admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:42.534517 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c06fa5-3f3e-4364-a4b3-126428b1381b admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:42.535270 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c06fa5-3f3e-4364-a4b3-126428b1381b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:42.538259 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c06fa5-3f3e-4364-a4b3-126428b1381b admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:42.577179 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 859/1696] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:29:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:29:42.578493 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535636e0-2720-44c9-9a47-5102b62be805 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:42.587901 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 838/1697] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:29:42 2022] POST /identity/v3/projects => generated 373 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:29:42.589465 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a83fa2-32c7-4e67-b21c-f86a211d9114 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:42.590896 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a83fa2-32c7-4e67-b21c-f86a211d9114 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:42.591703 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a83fa2-32c7-4e67-b21c-f86a211d9114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:42.605565 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535636e0-2720-44c9-9a47-5102b62be805 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:42.656909 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-d6a83fa2-32c7-4e67-b21c-f86a211d9114 None None] MFA Rules not processed for user `c9521db74a4b4492b1453236d7e9d2ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:29:42.658259 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-d6a83fa2-32c7-4e67-b21c-f86a211d9114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:42.736421 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4d0fe5-34ed-433c-ba38-6d1ec544c561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:42.737304 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4d0fe5-34ed-433c-ba38-6d1ec544c561 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:42.737920 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4d0fe5-34ed-433c-ba38-6d1ec544c561 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:42.738381 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4d0fe5-34ed-433c-ba38-6d1ec544c561 admin admin] PATH_INFO: `/v3/projects/8541198a043e43dbbe3c3e70a8090deb/users/af7b5ed23f674fe7859fcf1afa78c425/roles/04d0e4575a28440eb4349b4a6565e8b8` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:42.782145 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:29:42.804027 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4d0fe5-34ed-433c-ba38-6d1ec544c561 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8541198a043e43dbbe3c3e70a8090deb, user_id=af7b5ed23f674fe7859fcf1afa78c425, role_id=04d0e4575a28440eb4349b4a6565e8b8)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:42.815570 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4d0fe5-34ed-433c-ba38-6d1ec544c561 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:42.833289 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 839/1698] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:29:42 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:29:42.836857 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a83fa2-32c7-4e67-b21c-f86a211d9114 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:42.856226 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a83fa2-32c7-4e67-b21c-f86a211d9114 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:42.858242 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 860/1699] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:29:42 2022] PUT /identity/v3/projects/8541198a043e43dbbe3c3e70a8090deb/users/af7b5ed23f674fe7859fcf1afa78c425/roles/04d0e4575a28440eb4349b4a6565e8b8 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:29:42.866680 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4d0fe5-34ed-433c-ba38-6d1ec544c561 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:42.868875 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-8f4d0fe5-34ed-433c-ba38-6d1ec544c561 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:42.970682 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76b586a-da53-41c2-bcd9-d4a264adf718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:42.971312 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b586a-da53-41c2-bcd9-d4a264adf718 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:42.971635 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b586a-da53-41c2-bcd9-d4a264adf718 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:42.971911 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b586a-da53-41c2-bcd9-d4a264adf718 admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:42.972555 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76b586a-da53-41c2-bcd9-d4a264adf718 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:42.974544 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76b586a-da53-41c2-bcd9-d4a264adf718 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:43.020329 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 840/1700] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:29:42 2022] POST /identity/v3/users => generated 287 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:29:43.021297 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76b586a-da53-41c2-bcd9-d4a264adf718 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:43.024392 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-c76b586a-da53-41c2-bcd9-d4a264adf718 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:43.038927 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76b586a-da53-41c2-bcd9-d4a264adf718 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:43.051359 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0a6bcc-a6fa-47c6-9517-7f7183a2be89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:43.052839 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a6bcc-a6fa-47c6-9517-7f7183a2be89 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:43.053127 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a6bcc-a6fa-47c6-9517-7f7183a2be89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:43.053560 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a6bcc-a6fa-47c6-9517-7f7183a2be89 admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:43.054274 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0a6bcc-a6fa-47c6-9517-7f7183a2be89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:43.056253 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0a6bcc-a6fa-47c6-9517-7f7183a2be89 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:43.079768 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4d0fe5-34ed-433c-ba38-6d1ec544c561 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:43.089125 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c1ce35-0a2e-401f-a7b4-2990a216d818 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1f412befb9418fa66a2aabf475aa90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:43.091193 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c1ce35-0a2e-401f-a7b4-2990a216d818 service nova] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:43.091475 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c1ce35-0a2e-401f-a7b4-2990a216d818 service nova] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:43.091848 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c1ce35-0a2e-401f-a7b4-2990a216d818 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:43.130278 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 841/1701] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:29:43 2022] POST /identity/v3/projects => generated 403 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:29:43.132640 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed01ab7d-68ee-4b98-a002-ce9532065b32 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:43.133077 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed01ab7d-68ee-4b98-a002-ce9532065b32 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:43.133699 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed01ab7d-68ee-4b98-a002-ce9532065b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:43.158618 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:29:43.195606 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-ed01ab7d-68ee-4b98-a002-ce9532065b32 None None] MFA Rules not processed for user `af7b5ed23f674fe7859fcf1afa78c425`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:29:43.196834 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-ed01ab7d-68ee-4b98-a002-ce9532065b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:43.205310 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c1ce35-0a2e-401f-a7b4-2990a216d818 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:43.207320 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c1ce35-0a2e-401f-a7b4-2990a216d818 service nova] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:43.223335 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 861/1702] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:29:42 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:29:43.225015 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c1ce35-0a2e-401f-a7b4-2990a216d818 service nova] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:43.240352 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c1ce35-0a2e-401f-a7b4-2990a216d818 service nova] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:43.404546 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 842/1703] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:29:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:29:43.405539 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed01ab7d-68ee-4b98-a002-ce9532065b32 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:43.416891 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09af689d-3161-476c-9b07-5b00ea779481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:43.417530 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af689d-3161-476c-9b07-5b00ea779481 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:43.417842 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af689d-3161-476c-9b07-5b00ea779481 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:43.418116 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af689d-3161-476c-9b07-5b00ea779481 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:43.428110 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09af689d-3161-476c-9b07-5b00ea779481 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:43.428110 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09af689d-3161-476c-9b07-5b00ea779481 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:43.452080 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 862/1704] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:29:43 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:29:43.459272 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09af689d-3161-476c-9b07-5b00ea779481 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:43.482421 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09af689d-3161-476c-9b07-5b00ea779481 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:43.495189 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029aedac-2519-4618-a133-d887789c5fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:43.495857 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029aedac-2519-4618-a133-d887789c5fc5 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:43.496713 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029aedac-2519-4618-a133-d887789c5fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:43.497007 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029aedac-2519-4618-a133-d887789c5fc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:43.497666 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029aedac-2519-4618-a133-d887789c5fc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:43.503069 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029aedac-2519-4618-a133-d887789c5fc5 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:43.543470 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:29:43.580239 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed01ab7d-68ee-4b98-a002-ce9532065b32 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:43.581803 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 863/1705] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:29:43 2022] POST /identity/v3/projects => generated 383 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:29:43.588592 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029aedac-2519-4618-a133-d887789c5fc5 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:43.685189 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4b42cd-8a18-42f6-be49-96b2caf6c6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:43.685826 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b42cd-8a18-42f6-be49-96b2caf6c6b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:43.686114 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b42cd-8a18-42f6-be49-96b2caf6c6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:43.686389 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b42cd-8a18-42f6-be49-96b2caf6c6b3 admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:43.689063 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4b42cd-8a18-42f6-be49-96b2caf6c6b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:43.691016 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4b42cd-8a18-42f6-be49-96b2caf6c6b3 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:43.734922 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 843/1706] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:29:43 2022] POST /identity/v3/users => generated 308 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:29:43.736206 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4b42cd-8a18-42f6-be49-96b2caf6c6b3 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:43.753294 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4b42cd-8a18-42f6-be49-96b2caf6c6b3 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:43.754959 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029aedac-2519-4618-a133-d887789c5fc5 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:43.760803 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa20f5ed-d59e-40f1-9351-76c989c7f8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:43.761757 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20f5ed-d59e-40f1-9351-76c989c7f8f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:43.762208 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20f5ed-d59e-40f1-9351-76c989c7f8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:43.762636 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20f5ed-d59e-40f1-9351-76c989c7f8f0 admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:43.763556 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa20f5ed-d59e-40f1-9351-76c989c7f8f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:43.765754 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa20f5ed-d59e-40f1-9351-76c989c7f8f0 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:43.771249 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635b1ebd-6d79-436d-84de-4e49c62a9908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:43.772076 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b1ebd-6d79-436d-84de-4e49c62a9908 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:43.772364 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b1ebd-6d79-436d-84de-4e49c62a9908 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:43.772642 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b1ebd-6d79-436d-84de-4e49c62a9908 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:43.773301 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635b1ebd-6d79-436d-84de-4e49c62a9908 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:43.774897 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635b1ebd-6d79-436d-84de-4e49c62a9908 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:43.802237 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 844/1707] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:29:43 2022] POST /identity/v3/users => generated 298 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:29:43.804505 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 864/1708] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:29:43 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:29:43.805636 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab54b99-73e8-4e72-b54c-627028de0aa6 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:43.806103 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab54b99-73e8-4e72-b54c-627028de0aa6 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:43.806569 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab54b99-73e8-4e72-b54c-627028de0aa6 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:43.808494 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635b1ebd-6d79-436d-84de-4e49c62a9908 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:43.809589 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 845/1709] 10.222.0.25 () {54 vars in 912 bytes} [Tue Oct 4 03:29:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:29:43.815877 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab54b99-73e8-4e72-b54c-627028de0aa6 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:43.825871 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635b1ebd-6d79-436d-84de-4e49c62a9908 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:43.846458 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee6cb2a-aa7f-49eb-aa47-cf31994f9a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:43.847139 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee6cb2a-aa7f-49eb-aa47-cf31994f9a59 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:43.847550 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee6cb2a-aa7f-49eb-aa47-cf31994f9a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:43.847944 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee6cb2a-aa7f-49eb-aa47-cf31994f9a59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:43.848365 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab54b99-73e8-4e72-b54c-627028de0aa6 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:43.848829 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee6cb2a-aa7f-49eb-aa47-cf31994f9a59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:43.851348 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee6cb2a-aa7f-49eb-aa47-cf31994f9a59 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:43.862902 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd61051-07ee-4ebb-aa39-4bd317f49f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:43.864645 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd61051-07ee-4ebb-aa39-4bd317f49f2e admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:43.865051 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd61051-07ee-4ebb-aa39-4bd317f49f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:43.865333 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd61051-07ee-4ebb-aa39-4bd317f49f2e admin admin] PATH_INFO: `/v3/projects/bdb41ec3884f4830b77032e89a803df2/users/e24cc1cfd8b74b28b9bef2e20bd526ea/roles/04d0e4575a28440eb4349b4a6565e8b8` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:43.877684 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 865/1710] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:29:43 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:29:43.878713 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee6cb2a-aa7f-49eb-aa47-cf31994f9a59 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:43.906243 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee6cb2a-aa7f-49eb-aa47-cf31994f9a59 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:43.915524 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd61051-07ee-4ebb-aa39-4bd317f49f2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdb41ec3884f4830b77032e89a803df2, user_id=e24cc1cfd8b74b28b9bef2e20bd526ea, role_id=04d0e4575a28440eb4349b4a6565e8b8)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:43.916439 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee01344-fc97-44a6-aa91-129e400b24cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:43.917427 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee01344-fc97-44a6-aa91-129e400b24cd admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:43.917600 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee01344-fc97-44a6-aa91-129e400b24cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:43.917985 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee01344-fc97-44a6-aa91-129e400b24cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:43.918097 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd61051-07ee-4ebb-aa39-4bd317f49f2e admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:43.918842 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee01344-fc97-44a6-aa91-129e400b24cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:43.923514 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee01344-fc97-44a6-aa91-129e400b24cd admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:43.940473 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 846/1711] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:29:43 2022] PUT /identity/v3/projects/bdb41ec3884f4830b77032e89a803df2/users/e24cc1cfd8b74b28b9bef2e20bd526ea/roles/04d0e4575a28440eb4349b4a6565e8b8 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:29:43.941687 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 866/1712] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:29:43 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:29:43.941812 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc3c530-d701-4206-8396-c351877d7084 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:43.942015 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc3c530-d701-4206-8396-c351877d7084 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:43.942288 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc3c530-d701-4206-8396-c351877d7084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:43.943195 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee01344-fc97-44a6-aa91-129e400b24cd admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:43.962448 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee01344-fc97-44a6-aa91-129e400b24cd admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:44.018223 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:29:44.066312 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-ddc3c530-d701-4206-8396-c351877d7084 None None] MFA Rules not processed for user `5e43cc9523d949a1bfa3dec882f2824f`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:29:44.069719 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-ddc3c530-d701-4206-8396-c351877d7084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:44.100479 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f8302b-7b67-4424-9385-3bf7595816d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:44.101029 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8302b-7b67-4424-9385-3bf7595816d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:44.101413 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8302b-7b67-4424-9385-3bf7595816d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:44.101696 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8302b-7b67-4424-9385-3bf7595816d2 admin admin] PATH_INFO: `/v3/projects/8e7dff9890d94f8c94556cd044008cb4/users/80d1dbeb9aee4764ac8c4dc7f00f71f0/roles/fe9379cda35c4ff78576fe48b60bea3c` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:44.119795 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f8302b-7b67-4424-9385-3bf7595816d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e7dff9890d94f8c94556cd044008cb4, user_id=80d1dbeb9aee4764ac8c4dc7f00f71f0, role_id=fe9379cda35c4ff78576fe48b60bea3c)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:44.123157 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f8302b-7b67-4424-9385-3bf7595816d2 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:44.157891 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 867/1713] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:29:43 2022] PUT /identity/v3/projects/8e7dff9890d94f8c94556cd044008cb4/users/80d1dbeb9aee4764ac8c4dc7f00f71f0/roles/fe9379cda35c4ff78576fe48b60bea3c => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:29:44.162950 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55124f5-686d-4df2-9126-e8c81cd83b6a None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:44.163900 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55124f5-686d-4df2-9126-e8c81cd83b6a None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:44.165247 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55124f5-686d-4df2-9126-e8c81cd83b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:44.205488 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 847/1714] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Oct 4 03:29:43 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:29:44.206277 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc3c530-d701-4206-8396-c351877d7084 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:44.229529 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-e55124f5-686d-4df2-9126-e8c81cd83b6a None None] MFA Rules not processed for user `e24cc1cfd8b74b28b9bef2e20bd526ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:29:44.233537 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-e55124f5-686d-4df2-9126-e8c81cd83b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:44.234654 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc3c530-d701-4206-8396-c351877d7084 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:44.330645 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:29:44.371871 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3effb0d-b611-4411-b6e4-e604603dfb15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:44.372870 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3effb0d-b611-4411-b6e4-e604603dfb15 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:44.373270 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3effb0d-b611-4411-b6e4-e604603dfb15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:44.373675 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3effb0d-b611-4411-b6e4-e604603dfb15 admin admin] PATH_INFO: `/v3/projects/dcaf6960039848ca9baefc077f86d9bd/users/fef1ef876b6b434ca2a0704eeb10d7aa/roles/fe9379cda35c4ff78576fe48b60bea3c` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:44.408050 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3effb0d-b611-4411-b6e4-e604603dfb15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcaf6960039848ca9baefc077f86d9bd, user_id=fef1ef876b6b434ca2a0704eeb10d7aa, role_id=fe9379cda35c4ff78576fe48b60bea3c)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:44.411327 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3effb0d-b611-4411-b6e4-e604603dfb15 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:44.440564 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 848/1715] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:29:44 2022] PUT /identity/v3/projects/dcaf6960039848ca9baefc077f86d9bd/users/fef1ef876b6b434ca2a0704eeb10d7aa/roles/fe9379cda35c4ff78576fe48b60bea3c => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:29:44.441683 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3effb0d-b611-4411-b6e4-e604603dfb15 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:44.452513 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 868/1716] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:29:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:29:44.452513 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55124f5-686d-4df2-9126-e8c81cd83b6a None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:44.452513 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-e55124f5-686d-4df2-9126-e8c81cd83b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:44.582618 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55124f5-686d-4df2-9126-e8c81cd83b6a None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:44.585390 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3effb0d-b611-4411-b6e4-e604603dfb15 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:44.597313 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a547cb-294d-472d-ba65-0c4298962f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:44.597961 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a547cb-294d-472d-ba65-0c4298962f98 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:44.598249 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a547cb-294d-472d-ba65-0c4298962f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:44.598581 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a547cb-294d-472d-ba65-0c4298962f98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:44.599993 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a547cb-294d-472d-ba65-0c4298962f98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:44.602537 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a547cb-294d-472d-ba65-0c4298962f98 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:44.621602 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 849/1717] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:29:44 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:29:44.622737 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a547cb-294d-472d-ba65-0c4298962f98 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:44.661060 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a547cb-294d-472d-ba65-0c4298962f98 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:44.666954 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46907249-188f-48e5-a514-7d6608d0a487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:44.667657 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46907249-188f-48e5-a514-7d6608d0a487 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:44.668909 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46907249-188f-48e5-a514-7d6608d0a487 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:44.669263 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46907249-188f-48e5-a514-7d6608d0a487 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:44.669940 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46907249-188f-48e5-a514-7d6608d0a487 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:44.671908 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46907249-188f-48e5-a514-7d6608d0a487 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:44.684501 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 850/1718] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:29:44 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:29:44.685697 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46907249-188f-48e5-a514-7d6608d0a487 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:44.697422 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:29:44.699957 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46907249-188f-48e5-a514-7d6608d0a487 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:44.712833 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc1ccce-c84f-4f21-9391-f639e995652f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:44.713694 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc1ccce-c84f-4f21-9391-f639e995652f admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:44.713966 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ddf6ba-a1b5-4e1b-8a4c-3a1ec84be671 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:44.714452 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc1ccce-c84f-4f21-9391-f639e995652f admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:44.714815 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ddf6ba-a1b5-4e1b-8a4c-3a1ec84be671 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:44.715334 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ddf6ba-a1b5-4e1b-8a4c-3a1ec84be671 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:44.715988 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc1ccce-c84f-4f21-9391-f639e995652f admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:44.716371 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ddf6ba-a1b5-4e1b-8a4c-3a1ec84be671 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:44.720218 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc1ccce-c84f-4f21-9391-f639e995652f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:44.726991 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc1ccce-c84f-4f21-9391-f639e995652f admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:44.737799 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ddf6ba-a1b5-4e1b-8a4c-3a1ec84be671 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:44.739618 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ddf6ba-a1b5-4e1b-8a4c-3a1ec84be671 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:44.770119 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 869/1719] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:29:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:29:44.771927 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ddf6ba-a1b5-4e1b-8a4c-3a1ec84be671 service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:44.799757 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ddf6ba-a1b5-4e1b-8a4c-3a1ec84be671 service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:44.805448 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 851/1720] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:29:44 2022] POST /identity/v3/projects => generated 373 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:29:44.806719 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc1ccce-c84f-4f21-9391-f639e995652f admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:44.937505 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc1ccce-c84f-4f21-9391-f639e995652f admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:44.946111 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2806fa91-2501-4d1c-9aa3-ae1cba0b1837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:44.948336 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2806fa91-2501-4d1c-9aa3-ae1cba0b1837 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:44.950191 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2806fa91-2501-4d1c-9aa3-ae1cba0b1837 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:44.950472 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2806fa91-2501-4d1c-9aa3-ae1cba0b1837 admin admin] PATH_INFO: `/v3/projects/dcaf6960039848ca9baefc077f86d9bd/users/fef1ef876b6b434ca2a0704eeb10d7aa/roles/fe9379cda35c4ff78576fe48b60bea3c` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:44.953124 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a279f-c326-419b-9897-bad14f971f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:44.953847 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a279f-c326-419b-9897-bad14f971f58 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:44.954133 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a279f-c326-419b-9897-bad14f971f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:44.954407 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a279f-c326-419b-9897-bad14f971f58 admin admin] PATH_INFO: `/v3/projects/8e7dff9890d94f8c94556cd044008cb4/users/80d1dbeb9aee4764ac8c4dc7f00f71f0/roles/fe9379cda35c4ff78576fe48b60bea3c` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:44.956344 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2806fa91-2501-4d1c-9aa3-ae1cba0b1837 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcaf6960039848ca9baefc077f86d9bd, user_id=fef1ef876b6b434ca2a0704eeb10d7aa, role_id=fe9379cda35c4ff78576fe48b60bea3c)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:44.959714 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0a279f-c326-419b-9897-bad14f971f58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e7dff9890d94f8c94556cd044008cb4, user_id=80d1dbeb9aee4764ac8c4dc7f00f71f0, role_id=fe9379cda35c4ff78576fe48b60bea3c)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:44.964640 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2806fa91-2501-4d1c-9aa3-ae1cba0b1837 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:44.968788 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0a279f-c326-419b-9897-bad14f971f58 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:45.002149 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 852/1721] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:29:44 2022] PUT /identity/v3/projects/dcaf6960039848ca9baefc077f86d9bd/users/fef1ef876b6b434ca2a0704eeb10d7aa/roles/fe9379cda35c4ff78576fe48b60bea3c => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:29:45.007298 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2806fa91-2501-4d1c-9aa3-ae1cba0b1837 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:45.014441 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 870/1722] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:29:44 2022] PUT /identity/v3/projects/8e7dff9890d94f8c94556cd044008cb4/users/80d1dbeb9aee4764ac8c4dc7f00f71f0/roles/fe9379cda35c4ff78576fe48b60bea3c => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:29:45.017158 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f71ce5a-ce9c-485a-98ec-d514cdc0cb41 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:45.017435 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f71ce5a-ce9c-485a-98ec-d514cdc0cb41 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:45.017707 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f71ce5a-ce9c-485a-98ec-d514cdc0cb41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:45.071073 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:29:45.082999 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-4f71ce5a-ce9c-485a-98ec-d514cdc0cb41 None None] MFA Rules not processed for user `fef1ef876b6b434ca2a0704eeb10d7aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:29:45.093792 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-4f71ce5a-ce9c-485a-98ec-d514cdc0cb41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:45.178962 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2806fa91-2501-4d1c-9aa3-ae1cba0b1837 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:45.294178 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 871/1723] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:29:45 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:29:45.303842 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f71ce5a-ce9c-485a-98ec-d514cdc0cb41 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:45.305956 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-4f71ce5a-ce9c-485a-98ec-d514cdc0cb41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:45.328681 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e7da7b-0bd2-4e4c-a241-8837c66f9b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:45.329601 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e7da7b-0bd2-4e4c-a241-8837c66f9b90 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:45.329997 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e7da7b-0bd2-4e4c-a241-8837c66f9b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:45.330381 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e7da7b-0bd2-4e4c-a241-8837c66f9b90 admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:45.331354 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e7da7b-0bd2-4e4c-a241-8837c66f9b90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:45.335221 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e7da7b-0bd2-4e4c-a241-8837c66f9b90 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:45.391633 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 853/1724] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:29:45 2022] POST /identity/v3/users => generated 293 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:29:45.392933 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e7da7b-0bd2-4e4c-a241-8837c66f9b90 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:45.421058 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e7da7b-0bd2-4e4c-a241-8837c66f9b90 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:45.437986 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d820a6c5-ccb6-4dba-9795-d94abece19ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:45.437986 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d820a6c5-ccb6-4dba-9795-d94abece19ee admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:45.438703 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d820a6c5-ccb6-4dba-9795-d94abece19ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:45.440571 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d820a6c5-ccb6-4dba-9795-d94abece19ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:45.441528 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d820a6c5-ccb6-4dba-9795-d94abece19ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:45.447404 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d820a6c5-ccb6-4dba-9795-d94abece19ee admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:45.479101 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f71ce5a-ce9c-485a-98ec-d514cdc0cb41 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:45.483907 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 854/1725] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:29:45 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:29:45.485144 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d820a6c5-ccb6-4dba-9795-d94abece19ee admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:45.488588 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee7a32d-3224-423c-8858-6ddc5de68d73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f537aabf3d1040ff840b02616f839975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:45.489230 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee7a32d-3224-423c-8858-6ddc5de68d73 service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:45.489507 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee7a32d-3224-423c-8858-6ddc5de68d73 service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:45.490575 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee7a32d-3224-423c-8858-6ddc5de68d73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:45.516025 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d820a6c5-ccb6-4dba-9795-d94abece19ee admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:45.519230 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee7a32d-3224-423c-8858-6ddc5de68d73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:45.524009 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee7a32d-3224-423c-8858-6ddc5de68d73 service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:45.531819 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f25cf4-f7d6-41ca-8dac-c0935d2a187d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:45.537980 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f25cf4-f7d6-41ca-8dac-c0935d2a187d admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:45.541471 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f25cf4-f7d6-41ca-8dac-c0935d2a187d admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:45.543465 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f25cf4-f7d6-41ca-8dac-c0935d2a187d admin admin] PATH_INFO: `/v3/projects/b685b2159b004251826e88a526779879/users/61131a9fd4344b0397d63fd21881a652/roles/fe9379cda35c4ff78576fe48b60bea3c` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:45.569842 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 872/1726] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:29:45 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:29:45.602241 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f25cf4-f7d6-41ca-8dac-c0935d2a187d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b685b2159b004251826e88a526779879, user_id=61131a9fd4344b0397d63fd21881a652, role_id=fe9379cda35c4ff78576fe48b60bea3c)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:45.609053 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f25cf4-f7d6-41ca-8dac-c0935d2a187d admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:45.652484 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 855/1727] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:29:45 2022] PUT /identity/v3/projects/b685b2159b004251826e88a526779879/users/61131a9fd4344b0397d63fd21881a652/roles/fe9379cda35c4ff78576fe48b60bea3c => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:29:45.656645 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee7a32d-3224-423c-8858-6ddc5de68d73 service cinder] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:45.688575 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee7a32d-3224-423c-8858-6ddc5de68d73 service cinder] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:45.715397 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:29:45.923942 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6074bcb-b90d-4629-93bd-e73c88b1fc5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:45.930159 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6074bcb-b90d-4629-93bd-e73c88b1fc5d admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:45.932005 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6074bcb-b90d-4629-93bd-e73c88b1fc5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:45.934405 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6074bcb-b90d-4629-93bd-e73c88b1fc5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:45.937753 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6074bcb-b90d-4629-93bd-e73c88b1fc5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:45.945142 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6074bcb-b90d-4629-93bd-e73c88b1fc5d admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:45.983593 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 873/1728] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:29:45 2022] GET /identity/v3/roles => generated 1420 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:29:45.985189 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f25cf4-f7d6-41ca-8dac-c0935d2a187d admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:46.005554 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f25cf4-f7d6-41ca-8dac-c0935d2a187d admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:46.037568 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5b4ee6-2326-4b1a-a3ea-78b81e2887db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:46.039786 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b4ee6-2326-4b1a-a3ea-78b81e2887db admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:46.040079 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b4ee6-2326-4b1a-a3ea-78b81e2887db admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:46.040367 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b4ee6-2326-4b1a-a3ea-78b81e2887db admin admin] PATH_INFO: `/v3/projects/b685b2159b004251826e88a526779879/users/61131a9fd4344b0397d63fd21881a652/roles/fe9379cda35c4ff78576fe48b60bea3c` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:46.046289 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5b4ee6-2326-4b1a-a3ea-78b81e2887db admin admin] RBAC: Authorizing `identity:create_grant(project_id=b685b2159b004251826e88a526779879, user_id=61131a9fd4344b0397d63fd21881a652, role_id=fe9379cda35c4ff78576fe48b60bea3c)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:46.065933 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5b4ee6-2326-4b1a-a3ea-78b81e2887db admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:46.143183 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 856/1729] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:29:45 2022] PUT /identity/v3/projects/b685b2159b004251826e88a526779879/users/61131a9fd4344b0397d63fd21881a652/roles/fe9379cda35c4ff78576fe48b60bea3c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:29:46.146846 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fcead1-6732-4af3-b245-cf3ad6efdc63 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:46.147174 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fcead1-6732-4af3-b245-cf3ad6efdc63 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:46.147774 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fcead1-6732-4af3-b245-cf3ad6efdc63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:46.234849 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5b4ee6-2326-4b1a-a3ea-78b81e2887db admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:46.236799 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-b8fcead1-6732-4af3-b245-cf3ad6efdc63 None None] MFA Rules not processed for user `61131a9fd4344b0397d63fd21881a652`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:29:46.236953 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-5d5b4ee6-2326-4b1a-a3ea-78b81e2887db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:46.241034 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-b8fcead1-6732-4af3-b245-cf3ad6efdc63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:46.476825 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5b4ee6-2326-4b1a-a3ea-78b81e2887db admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:46.489084 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5787c68d-4643-45df-8db3-fae881acae68 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94513f6cd19f495e842deb3c13c3e4d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:46.489792 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787c68d-4643-45df-8db3-fae881acae68 service placement] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:46.490962 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787c68d-4643-45df-8db3-fae881acae68 service placement] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:46.490962 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787c68d-4643-45df-8db3-fae881acae68 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:46.497433 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-5787c68d-4643-45df-8db3-fae881acae68 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:46.524952 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5787c68d-4643-45df-8db3-fae881acae68 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:46.534237 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5787c68d-4643-45df-8db3-fae881acae68 service placement] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:46.537371 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 874/1730] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:29:46 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:29:46.540215 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:29:46.550430 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fcead1-6732-4af3-b245-cf3ad6efdc63 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:46.568469 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 857/1731] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:29:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 03:29:46.760647 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ffff33-4807-4432-871c-6a3082c33f4a None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:46.760930 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ffff33-4807-4432-871c-6a3082c33f4a None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:46.761207 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ffff33-4807-4432-871c-6a3082c33f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:46.808191 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-05ffff33-4807-4432-871c-6a3082c33f4a None None] MFA Rules not processed for user `542b137fb8cd4d25867d95a13d2cb651`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:29:46.811017 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-05ffff33-4807-4432-871c-6a3082c33f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:46.825194 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fcead1-6732-4af3-b245-cf3ad6efdc63 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:46.857147 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d09641-82d3-4652-b277-8690629d5c15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f537aabf3d1040ff840b02616f839975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:46.858706 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d09641-82d3-4652-b277-8690629d5c15 service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:46.860462 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d09641-82d3-4652-b277-8690629d5c15 service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:46.862268 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d09641-82d3-4652-b277-8690629d5c15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:46.899793 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d09641-82d3-4652-b277-8690629d5c15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:46.902138 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d09641-82d3-4652-b277-8690629d5c15 service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:46.930354 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 875/1732] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:29:46 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:29:46.932429 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d09641-82d3-4652-b277-8690629d5c15 service cinder] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:46.939387 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-d3d09641-82d3-4652-b277-8690629d5c15 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:46.992504 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 858/1733] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:29:46 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 03:29:47.007875 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d09641-82d3-4652-b277-8690629d5c15 service cinder] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:47.021403 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7790f3f0-68ca-4b9f-ba0d-88b081861c92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f537aabf3d1040ff840b02616f839975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:47.024351 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7790f3f0-68ca-4b9f-ba0d-88b081861c92 service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:47.025614 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7790f3f0-68ca-4b9f-ba0d-88b081861c92 service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:47.026030 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7790f3f0-68ca-4b9f-ba0d-88b081861c92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:47.032573 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-7790f3f0-68ca-4b9f-ba0d-88b081861c92 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:47.143239 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:29:47.247611 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7790f3f0-68ca-4b9f-ba0d-88b081861c92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:47.259785 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7790f3f0-68ca-4b9f-ba0d-88b081861c92 service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:47.293343 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 876/1734] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:29:46 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:29:47.867615 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ffff33-4807-4432-871c-6a3082c33f4a None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:48.076611 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ffff33-4807-4432-871c-6a3082c33f4a None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:48.095861 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8759e4cb-f4bc-42ac-8c9a-fdcc5cc3cfe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:48.097274 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8759e4cb-f4bc-42ac-8c9a-fdcc5cc3cfe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:48.097809 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8759e4cb-f4bc-42ac-8c9a-fdcc5cc3cfe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:48.098495 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8759e4cb-f4bc-42ac-8c9a-fdcc5cc3cfe2 admin admin] PATH_INFO: `/v3/users/e24cc1cfd8b74b28b9bef2e20bd526ea` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:48.101062 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8759e4cb-f4bc-42ac-8c9a-fdcc5cc3cfe2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e24cc1cfd8b74b28b9bef2e20bd526ea)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:48.105087 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8759e4cb-f4bc-42ac-8c9a-fdcc5cc3cfe2 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:48.223116 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-8759e4cb-f4bc-42ac-8c9a-fdcc5cc3cfe2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e24cc1cfd8b74b28b9bef2e20bd526ea'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:29:48.243041 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-8759e4cb-f4bc-42ac-8c9a-fdcc5cc3cfe2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e24cc1cfd8b74b28b9bef2e20bd526ea'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:29:48.260980 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-8759e4cb-f4bc-42ac-8c9a-fdcc5cc3cfe2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e24cc1cfd8b74b28b9bef2e20bd526ea'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:29:48.262249 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-8759e4cb-f4bc-42ac-8c9a-fdcc5cc3cfe2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e24cc1cfd8b74b28b9bef2e20bd526ea'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:29:48.291235 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-8759e4cb-f4bc-42ac-8c9a-fdcc5cc3cfe2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e24cc1cfd8b74b28b9bef2e20bd526ea'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:29:48.310291 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 859/1735] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:29:47 2022] DELETE /identity/v3/users/e24cc1cfd8b74b28b9bef2e20bd526ea => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:29:48.316225 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ae0ae-9439-4c66-9ea6-a6aaa14d266d None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:48.316225 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ae0ae-9439-4c66-9ea6-a6aaa14d266d None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:48.316225 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ae0ae-9439-4c66-9ea6-a6aaa14d266d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:48.328241 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e786bb-341b-422f-8cde-a4b1a1cf3999 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:48.328979 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e786bb-341b-422f-8cde-a4b1a1cf3999 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:48.329292 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e786bb-341b-422f-8cde-a4b1a1cf3999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:48.382346 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-54e786bb-341b-422f-8cde-a4b1a1cf3999 None None] MFA Rules not processed for user `b8795829c34046628cae345dd4d45e75`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:29:48.383726 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-54e786bb-341b-422f-8cde-a4b1a1cf3999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:48.388616 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-473ae0ae-9439-4c66-9ea6-a6aaa14d266d None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:29:48.393815 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-473ae0ae-9439-4c66-9ea6-a6aaa14d266d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:48.406140 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:29:48.513079 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 860/1736] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:29:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:29:48.520075 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e786bb-341b-422f-8cde-a4b1a1cf3999 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:48.524231 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-54e786bb-341b-422f-8cde-a4b1a1cf3999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:48.607649 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 877/1737] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:29:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:29:48.631344 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473ae0ae-9439-4c66-9ea6-a6aaa14d266d None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:48.635784 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-473ae0ae-9439-4c66-9ea6-a6aaa14d266d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:48.732249 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e786bb-341b-422f-8cde-a4b1a1cf3999 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:48.753438 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c413865-9a05-4c6d-96aa-378e7b4fc304 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1f412befb9418fa66a2aabf475aa90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:48.756444 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c413865-9a05-4c6d-96aa-378e7b4fc304 service nova] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:48.757207 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c413865-9a05-4c6d-96aa-378e7b4fc304 service nova] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:48.757487 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c413865-9a05-4c6d-96aa-378e7b4fc304 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:48.779423 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c413865-9a05-4c6d-96aa-378e7b4fc304 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:48.781479 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c413865-9a05-4c6d-96aa-378e7b4fc304 service nova] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:48.819158 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473ae0ae-9439-4c66-9ea6-a6aaa14d266d None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:48.826663 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 861/1738] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:29:48 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 03:29:48.850830 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b0fcd5-f235-4326-af94-85ac4b274930 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:48.853522 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0fcd5-f235-4326-af94-85ac4b274930 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:48.854505 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0fcd5-f235-4326-af94-85ac4b274930 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:48.855800 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0fcd5-f235-4326-af94-85ac4b274930 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:48.878726 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b0fcd5-f235-4326-af94-85ac4b274930 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:48.880733 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b0fcd5-f235-4326-af94-85ac4b274930 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:48.912635 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 878/1739] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:29:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 03:29:49.637479 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c5541d-409d-40cc-a8b0-99b8c74c3759 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:49.637479 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c5541d-409d-40cc-a8b0-99b8c74c3759 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:49.638207 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c5541d-409d-40cc-a8b0-99b8c74c3759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:49.730280 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-86c5541d-409d-40cc-a8b0-99b8c74c3759 None None] MFA Rules not processed for user `80d1dbeb9aee4764ac8c4dc7f00f71f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:29:49.732628 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-86c5541d-409d-40cc-a8b0-99b8c74c3759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:49.981908 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 862/1740] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:29:49 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:29:50.054265 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b4609-06dd-44cc-9936-579a07ca2ab2 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:50.054789 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b4609-06dd-44cc-9936-579a07ca2ab2 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:50.054789 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b4609-06dd-44cc-9936-579a07ca2ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:50.118767 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-f10b4609-06dd-44cc-9936-579a07ca2ab2 None None] MFA Rules not processed for user `a267cf7109c64f538824c162fedd084b`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:29:50.120194 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-f10b4609-06dd-44cc-9936-579a07ca2ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:50.339652 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eefd30-7e9b-4278-80f3-6d554f942911 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:50.341174 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eefd30-7e9b-4278-80f3-6d554f942911 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:50.341450 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eefd30-7e9b-4278-80f3-6d554f942911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:50.387901 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 879/1741] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:29:50 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 03:29:50.406916 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b71f5-49f9-477c-b0fd-ce1202882a2d None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:50.407651 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b71f5-49f9-477c-b0fd-ce1202882a2d None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:50.407651 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b71f5-49f9-477c-b0fd-ce1202882a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:50.448277 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-1c3b71f5-49f9-477c-b0fd-ce1202882a2d None None] MFA Rules not processed for user `a267cf7109c64f538824c162fedd084b`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:29:50.452983 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-1c3b71f5-49f9-477c-b0fd-ce1202882a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:50.470251 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:29:50.472972 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 880/1742] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:29:50 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:29:50.484549 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3b71f5-49f9-477c-b0fd-ce1202882a2d None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:50.486260 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-1c3b71f5-49f9-477c-b0fd-ce1202882a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:50.514148 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:29:50.535521 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3b71f5-49f9-477c-b0fd-ce1202882a2d None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:50.557130 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-52eefd30-7e9b-4278-80f3-6d554f942911 None None] MFA Rules not processed for user `bef61ef12079495ba72b7fcd2717aca2`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:29:50.558386 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-52eefd30-7e9b-4278-80f3-6d554f942911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:50.561582 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54b73da-9cc8-47fd-8e0f-27223f5d5180 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1f412befb9418fa66a2aabf475aa90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:50.562230 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b73da-9cc8-47fd-8e0f-27223f5d5180 service nova] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:50.562516 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b73da-9cc8-47fd-8e0f-27223f5d5180 service nova] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:50.565103 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b73da-9cc8-47fd-8e0f-27223f5d5180 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:50.595355 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54b73da-9cc8-47fd-8e0f-27223f5d5180 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:50.604047 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54b73da-9cc8-47fd-8e0f-27223f5d5180 service nova] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:50.647887 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 881/1743] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:29:50 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:29:50.831390 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 863/1744] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Oct 4 03:29:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 493 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:29:51.183468 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54b73da-9cc8-47fd-8e0f-27223f5d5180 service nova] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:51.185321 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-f54b73da-9cc8-47fd-8e0f-27223f5d5180 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:51.399529 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54b73da-9cc8-47fd-8e0f-27223f5d5180 service nova] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:51.415407 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa63d1ad-9eec-4dd1-9b13-ebd462f5cbfb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8da6bacc8f432e8f48bb99c7aede11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:51.416053 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63d1ad-9eec-4dd1-9b13-ebd462f5cbfb service swift] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:51.416345 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63d1ad-9eec-4dd1-9b13-ebd462f5cbfb service swift] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:51.416672 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63d1ad-9eec-4dd1-9b13-ebd462f5cbfb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:51.442269 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa63d1ad-9eec-4dd1-9b13-ebd462f5cbfb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:51.444327 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa63d1ad-9eec-4dd1-9b13-ebd462f5cbfb service swift] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:51.470660 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 882/1745] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Oct 4 03:29:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 03:29:51.826267 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eefd30-7e9b-4278-80f3-6d554f942911 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:51.829679 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-52eefd30-7e9b-4278-80f3-6d554f942911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:51.862540 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eefd30-7e9b-4278-80f3-6d554f942911 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:51.885539 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e64fc29-0a34-4e3f-bb08-63cacac4776c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:51.887298 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e64fc29-0a34-4e3f-bb08-63cacac4776c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:51.890493 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e64fc29-0a34-4e3f-bb08-63cacac4776c admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:51.891063 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e64fc29-0a34-4e3f-bb08-63cacac4776c admin admin] PATH_INFO: `/v3/projects/bdb41ec3884f4830b77032e89a803df2` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:51.895688 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e64fc29-0a34-4e3f-bb08-63cacac4776c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdb41ec3884f4830b77032e89a803df2)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:51.898410 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e64fc29-0a34-4e3f-bb08-63cacac4776c admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:52.065071 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-1e64fc29-0a34-4e3f-bb08-63cacac4776c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdb41ec3884f4830b77032e89a803df2', 'request_id': 'req-1e64fc29-0a34-4e3f-bb08-63cacac4776c'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:29:52.093916 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-1e64fc29-0a34-4e3f-bb08-63cacac4776c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdb41ec3884f4830b77032e89a803df2', 'request_id': 'req-1e64fc29-0a34-4e3f-bb08-63cacac4776c'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:29:52.118251 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-1e64fc29-0a34-4e3f-bb08-63cacac4776c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdb41ec3884f4830b77032e89a803df2', 'request_id': 'req-1e64fc29-0a34-4e3f-bb08-63cacac4776c'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:29:52.150730 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-1e64fc29-0a34-4e3f-bb08-63cacac4776c admin admin] The token cache is being invalidate because project bdb41ec3884f4830b77032e89a803df2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:29:52.151738 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-1e64fc29-0a34-4e3f-bb08-63cacac4776c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:29:52.152550 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-1e64fc29-0a34-4e3f-bb08-63cacac4776c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:29:52.163239 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 864/1746] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:29:51 2022] DELETE /identity/v3/projects/bdb41ec3884f4830b77032e89a803df2 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:29:52.164469 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa63d1ad-9eec-4dd1-9b13-ebd462f5cbfb service swift] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:52.199646 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa63d1ad-9eec-4dd1-9b13-ebd462f5cbfb service swift] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:52.562035 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79db553-f4a0-4e84-9172-062b27e25ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:52.565105 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79db553-f4a0-4e84-9172-062b27e25ac8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:52.567764 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79db553-f4a0-4e84-9172-062b27e25ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:52.569061 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79db553-f4a0-4e84-9172-062b27e25ac8 admin admin] PATH_INFO: `/v3/users/61131a9fd4344b0397d63fd21881a652` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:52.572845 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79db553-f4a0-4e84-9172-062b27e25ac8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61131a9fd4344b0397d63fd21881a652)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:52.579417 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79db553-f4a0-4e84-9172-062b27e25ac8 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:52.727273 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-c79db553-f4a0-4e84-9172-062b27e25ac8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61131a9fd4344b0397d63fd21881a652'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:29:52.728981 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-c79db553-f4a0-4e84-9172-062b27e25ac8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61131a9fd4344b0397d63fd21881a652'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:29:52.754678 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-c79db553-f4a0-4e84-9172-062b27e25ac8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61131a9fd4344b0397d63fd21881a652'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:29:52.756132 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-c79db553-f4a0-4e84-9172-062b27e25ac8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61131a9fd4344b0397d63fd21881a652'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:29:52.772515 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:29:52.794105 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-c79db553-f4a0-4e84-9172-062b27e25ac8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61131a9fd4344b0397d63fd21881a652'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:29:52.826086 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 883/1747] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:29:52 2022] DELETE /identity/v3/users/61131a9fd4344b0397d63fd21881a652 => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:29:52.890122 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e64fc29-0a34-4e3f-bb08-63cacac4776c admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:52.892242 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-1e64fc29-0a34-4e3f-bb08-63cacac4776c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:53.088042 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e64fc29-0a34-4e3f-bb08-63cacac4776c admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:53.196092 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:29:53.280229 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdfa569-6e2f-4f8b-a678-a5b1dadc6309 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f537aabf3d1040ff840b02616f839975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:53.282542 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdfa569-6e2f-4f8b-a678-a5b1dadc6309 service cinder] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:53.283686 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdfa569-6e2f-4f8b-a678-a5b1dadc6309 service cinder] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:53.284061 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdfa569-6e2f-4f8b-a678-a5b1dadc6309 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:53.290829 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-5cdfa569-6e2f-4f8b-a678-a5b1dadc6309 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:53.432958 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdfa569-6e2f-4f8b-a678-a5b1dadc6309 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:53.435599 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdfa569-6e2f-4f8b-a678-a5b1dadc6309 service cinder] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:53.450074 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 865/1748] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:29:52 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:29:53.758592 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b8c55-d158-48bf-9478-0e78f7a124fc None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:53.759193 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b8c55-d158-48bf-9478-0e78f7a124fc None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:53.759193 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b8c55-d158-48bf-9478-0e78f7a124fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:53.857240 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-245b8c55-d158-48bf-9478-0e78f7a124fc None None] MFA Rules not processed for user `5e43cc9523d949a1bfa3dec882f2824f`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:29:53.867404 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-245b8c55-d158-48bf-9478-0e78f7a124fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:54.043237 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 884/1749] 10.222.0.33 () {58 vars in 1015 bytes} [Tue Oct 4 03:29:53 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:29:54.320827 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdfa569-6e2f-4f8b-a678-a5b1dadc6309 service cinder] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:54.322458 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-5cdfa569-6e2f-4f8b-a678-a5b1dadc6309 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:54.342229 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdfa569-6e2f-4f8b-a678-a5b1dadc6309 service cinder] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:54.351945 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e4719-83fe-4d31-81f4-5189f3bfdd40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:54.352581 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e4719-83fe-4d31-81f4-5189f3bfdd40 service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:54.354573 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e4719-83fe-4d31-81f4-5189f3bfdd40 service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:54.354695 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e4719-83fe-4d31-81f4-5189f3bfdd40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:54.375309 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955e4719-83fe-4d31-81f4-5189f3bfdd40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:54.376869 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955e4719-83fe-4d31-81f4-5189f3bfdd40 service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:54.399230 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 866/1750] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:29:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:29:54.541300 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245b8c55-d158-48bf-9478-0e78f7a124fc None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:54.543011 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-245b8c55-d158-48bf-9478-0e78f7a124fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:54.725535 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de64eb8-df3d-460c-8b4d-24a10e024fd1 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:54.725686 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de64eb8-df3d-460c-8b4d-24a10e024fd1 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:54.726886 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de64eb8-df3d-460c-8b4d-24a10e024fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:54.732411 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245b8c55-d158-48bf-9478-0e78f7a124fc None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:54.743156 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb94667-24cd-4137-a639-d97e54f9a0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:54.744828 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb94667-24cd-4137-a639-d97e54f9a0d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:54.745354 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb94667-24cd-4137-a639-d97e54f9a0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:54.745944 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb94667-24cd-4137-a639-d97e54f9a0d0 admin admin] PATH_INFO: `/v3/projects/b685b2159b004251826e88a526779879` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:54.760179 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb94667-24cd-4137-a639-d97e54f9a0d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b685b2159b004251826e88a526779879)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:54.767039 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb94667-24cd-4137-a639-d97e54f9a0d0 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:54.806195 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-0de64eb8-df3d-460c-8b4d-24a10e024fd1 None None] MFA Rules not processed for user `02f76bc3ab354c4a8e9941e1403274ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:29:54.807562 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-0de64eb8-df3d-460c-8b4d-24a10e024fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:54.957499 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-feb94667-24cd-4137-a639-d97e54f9a0d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b685b2159b004251826e88a526779879', 'request_id': 'req-feb94667-24cd-4137-a639-d97e54f9a0d0'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:29:54.964654 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 867/1751] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:29:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:29:54.982171 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-feb94667-24cd-4137-a639-d97e54f9a0d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b685b2159b004251826e88a526779879', 'request_id': 'req-feb94667-24cd-4137-a639-d97e54f9a0d0'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:29:55.005709 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-feb94667-24cd-4137-a639-d97e54f9a0d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b685b2159b004251826e88a526779879', 'request_id': 'req-feb94667-24cd-4137-a639-d97e54f9a0d0'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:29:55.034449 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-feb94667-24cd-4137-a639-d97e54f9a0d0 admin admin] The token cache is being invalidate because project b685b2159b004251826e88a526779879 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:29:55.034772 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-feb94667-24cd-4137-a639-d97e54f9a0d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:29:55.037578 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-feb94667-24cd-4137-a639-d97e54f9a0d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:29:55.042197 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 885/1752] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:29:54 2022] DELETE /identity/v3/projects/b685b2159b004251826e88a526779879 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:29:55.049200 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728dbd0-06a5-46c8-a25b-d7c755819220 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:55.049666 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728dbd0-06a5-46c8-a25b-d7c755819220 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:55.050485 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728dbd0-06a5-46c8-a25b-d7c755819220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:55.096182 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-6728dbd0-06a5-46c8-a25b-d7c755819220 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:29:55.097368 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-6728dbd0-06a5-46c8-a25b-d7c755819220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:55.314218 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b058ce9-5bce-4da0-b7f9-d689211ffde0 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:55.314512 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b058ce9-5bce-4da0-b7f9-d689211ffde0 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:55.314788 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b058ce9-5bce-4da0-b7f9-d689211ffde0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:55.320459 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 868/1753] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:29:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:29:55.347750 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-1b058ce9-5bce-4da0-b7f9-d689211ffde0 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:29:55.350449 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-1b058ce9-5bce-4da0-b7f9-d689211ffde0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:55.370150 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 886/1754] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:29:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 03:29:55.375665 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6728dbd0-06a5-46c8-a25b-d7c755819220 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:55.391209 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6728dbd0-06a5-46c8-a25b-d7c755819220 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:55.400539 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dfd596-c0a7-4638-851e-05877f335151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:55.401566 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dfd596-c0a7-4638-851e-05877f335151 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:55.402311 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dfd596-c0a7-4638-851e-05877f335151 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:55.403167 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dfd596-c0a7-4638-851e-05877f335151 admin admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:55.404090 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dfd596-c0a7-4638-851e-05877f335151 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:29:55.404682 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dfd596-c0a7-4638-851e-05877f335151 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:55.407160 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dfd596-c0a7-4638-851e-05877f335151 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:55.453581 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b058ce9-5bce-4da0-b7f9-d689211ffde0 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:55.461456 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 869/1755] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 03:29:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:29:55.469972 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b058ce9-5bce-4da0-b7f9-d689211ffde0 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:55.483828 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea00898-22de-4cb3-9ff5-df68dcdf9caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:55.485496 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea00898-22de-4cb3-9ff5-df68dcdf9caa admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:55.486515 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea00898-22de-4cb3-9ff5-df68dcdf9caa admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:55.487727 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea00898-22de-4cb3-9ff5-df68dcdf9caa admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:55.490699 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea00898-22de-4cb3-9ff5-df68dcdf9caa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:55.496278 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea00898-22de-4cb3-9ff5-df68dcdf9caa admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:55.525704 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:29:55.565543 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 887/1756] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:29:55 2022] POST /identity/v3/projects => generated 357 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:29:55.570946 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dfd596-c0a7-4638-851e-05877f335151 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:55.588522 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dfd596-c0a7-4638-851e-05877f335151 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:55.598506 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:29:55.756807 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff18e74-215b-4e60-b75d-94e22d49b7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:55.757432 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff18e74-215b-4e60-b75d-94e22d49b7a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:55.757716 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff18e74-215b-4e60-b75d-94e22d49b7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:55.757992 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff18e74-215b-4e60-b75d-94e22d49b7a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:55.758811 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff18e74-215b-4e60-b75d-94e22d49b7a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:55.760798 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff18e74-215b-4e60-b75d-94e22d49b7a0 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:55.811230 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 870/1757] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:29:55 2022] POST /identity/v3/users => generated 279 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:29:55.815089 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea00898-22de-4cb3-9ff5-df68dcdf9caa admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:55.832967 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea00898-22de-4cb3-9ff5-df68dcdf9caa admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:55.850064 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939973b8-07cd-4db7-b1ef-ff2325211e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:55.850912 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939973b8-07cd-4db7-b1ef-ff2325211e89 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:55.851259 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939973b8-07cd-4db7-b1ef-ff2325211e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:55.851628 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939973b8-07cd-4db7-b1ef-ff2325211e89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:55.852352 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939973b8-07cd-4db7-b1ef-ff2325211e89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:55.853962 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939973b8-07cd-4db7-b1ef-ff2325211e89 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:55.879858 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 888/1758] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:29:55 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:29:55.884917 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff18e74-215b-4e60-b75d-94e22d49b7a0 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:55.895639 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff18e74-215b-4e60-b75d-94e22d49b7a0 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:55.922441 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a2c91d-75fb-4e48-8693-c638e28932b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:55.923541 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2c91d-75fb-4e48-8693-c638e28932b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:55.923541 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2c91d-75fb-4e48-8693-c638e28932b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:55.923745 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2c91d-75fb-4e48-8693-c638e28932b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:55.924345 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a2c91d-75fb-4e48-8693-c638e28932b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:55.925964 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a2c91d-75fb-4e48-8693-c638e28932b5 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:55.977907 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939973b8-07cd-4db7-b1ef-ff2325211e89 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:55.983089 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 871/1759] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:29:55 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:29:55.997719 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939973b8-07cd-4db7-b1ef-ff2325211e89 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:56.030198 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76743880-2227-4e6f-8454-4ffc287326fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:56.030893 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76743880-2227-4e6f-8454-4ffc287326fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:56.031176 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76743880-2227-4e6f-8454-4ffc287326fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:56.031454 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76743880-2227-4e6f-8454-4ffc287326fb admin admin] PATH_INFO: `/v3/projects/d100880a25134e3cbe298d9f83b063a6/users/4c7416d6e5e045468c3cfba1e20ec354/roles/04d0e4575a28440eb4349b4a6565e8b8` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:56.088514 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76743880-2227-4e6f-8454-4ffc287326fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d100880a25134e3cbe298d9f83b063a6, user_id=4c7416d6e5e045468c3cfba1e20ec354, role_id=04d0e4575a28440eb4349b4a6565e8b8)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:56.091456 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76743880-2227-4e6f-8454-4ffc287326fb admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:56.124194 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 889/1760] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:29:55 2022] PUT /identity/v3/projects/d100880a25134e3cbe298d9f83b063a6/users/4c7416d6e5e045468c3cfba1e20ec354/roles/04d0e4575a28440eb4349b4a6565e8b8 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 03:29:56.149075 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0156c-982d-4a8a-805a-aa7852668ed7 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:56.149546 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0156c-982d-4a8a-805a-aa7852668ed7 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:56.149974 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0156c-982d-4a8a-805a-aa7852668ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:56.264819 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-18b0156c-982d-4a8a-805a-aa7852668ed7 None None] MFA Rules not processed for user `4c7416d6e5e045468c3cfba1e20ec354`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:29:56.266017 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-18b0156c-982d-4a8a-805a-aa7852668ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:56.357407 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c629cfe-c1f1-4682-baf2-915fbb44d33a None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:56.357711 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c629cfe-c1f1-4682-baf2-915fbb44d33a None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:56.357979 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c629cfe-c1f1-4682-baf2-915fbb44d33a None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:56.376001 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 890/1761] 10.222.0.25 () {54 vars in 921 bytes} [Tue Oct 4 03:29:56 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:29:56.381841 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9afcc0-e51a-4635-b2bb-9fdd35586447 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:56.386227 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9afcc0-e51a-4635-b2bb-9fdd35586447 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:56.386709 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9afcc0-e51a-4635-b2bb-9fdd35586447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:56.506082 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-ad9afcc0-e51a-4635-b2bb-9fdd35586447 None None] MFA Rules not processed for user `94513f6cd19f495e842deb3c13c3e4d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:29:56.510168 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-ad9afcc0-e51a-4635-b2bb-9fdd35586447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:56.653804 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 872/1762] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:29:56 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 506 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:29:56.660981 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b0156c-982d-4a8a-805a-aa7852668ed7 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:56.856503 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b0156c-982d-4a8a-805a-aa7852668ed7 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:56.873494 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc862783-26bc-4566-bb57-6997ce23389a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:56.874478 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc862783-26bc-4566-bb57-6997ce23389a admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:56.874936 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc862783-26bc-4566-bb57-6997ce23389a admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:56.875305 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc862783-26bc-4566-bb57-6997ce23389a admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:56.876199 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc862783-26bc-4566-bb57-6997ce23389a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:56.880587 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc862783-26bc-4566-bb57-6997ce23389a admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:56.910148 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 891/1763] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Oct 4 03:29:56 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 529 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 03:29:56.923389 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9afcc0-e51a-4635-b2bb-9fdd35586447 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:56.925695 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-ad9afcc0-e51a-4635-b2bb-9fdd35586447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:56.938416 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:29:56.953074 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 873/1764] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:29:56 2022] POST /identity/v3/projects => generated 357 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:29:56.957177 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc862783-26bc-4566-bb57-6997ce23389a admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:56.965615 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9afcc0-e51a-4635-b2bb-9fdd35586447 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:57.174534 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc862783-26bc-4566-bb57-6997ce23389a admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:57.191587 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92ca1b0-e039-411c-9361-893738901c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:57.193163 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92ca1b0-e039-411c-9361-893738901c04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:57.193689 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92ca1b0-e039-411c-9361-893738901c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:57.193936 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92ca1b0-e039-411c-9361-893738901c04 admin admin] PATH_INFO: `/v3/users/8e2f574100454ebd9e750061ba79b0fd` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:57.194586 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb62de49-1a1d-4461-8029-bb9e8843283a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:57.195384 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb62de49-1a1d-4461-8029-bb9e8843283a admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:57.195956 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb62de49-1a1d-4461-8029-bb9e8843283a admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:57.196464 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb62de49-1a1d-4461-8029-bb9e8843283a admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:57.197211 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb62de49-1a1d-4461-8029-bb9e8843283a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:57.203247 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92ca1b0-e039-411c-9361-893738901c04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e2f574100454ebd9e750061ba79b0fd)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:57.209688 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb62de49-1a1d-4461-8029-bb9e8843283a admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:57.219216 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92ca1b0-e039-411c-9361-893738901c04 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:57.262174 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 874/1765] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:29:56 2022] POST /identity/v3/users => generated 285 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:29:57.263314 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb62de49-1a1d-4461-8029-bb9e8843283a admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:57.269291 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-bb62de49-1a1d-4461-8029-bb9e8843283a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:57.394607 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-f92ca1b0-e039-411c-9361-893738901c04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e2f574100454ebd9e750061ba79b0fd'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:29:57.395978 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-f92ca1b0-e039-411c-9361-893738901c04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e2f574100454ebd9e750061ba79b0fd'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:29:57.405008 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:29:57.419089 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-f92ca1b0-e039-411c-9361-893738901c04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e2f574100454ebd9e750061ba79b0fd'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:29:57.420862 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-f92ca1b0-e039-411c-9361-893738901c04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e2f574100454ebd9e750061ba79b0fd'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:29:57.441411 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-f92ca1b0-e039-411c-9361-893738901c04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e2f574100454ebd9e750061ba79b0fd'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:29:57.463402 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb62de49-1a1d-4461-8029-bb9e8843283a admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:57.484116 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 892/1766] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:29:56 2022] DELETE /identity/v3/users/8e2f574100454ebd9e750061ba79b0fd => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:29:57.485225 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92ca1b0-e039-411c-9361-893738901c04 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:57.487681 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-f92ca1b0-e039-411c-9361-893738901c04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:57.502582 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0819739b-04bc-4d06-b10b-cf0b5eaef980 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94513f6cd19f495e842deb3c13c3e4d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:57.508787 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0819739b-04bc-4d06-b10b-cf0b5eaef980 service placement] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:57.511302 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0819739b-04bc-4d06-b10b-cf0b5eaef980 service placement] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:57.513717 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0819739b-04bc-4d06-b10b-cf0b5eaef980 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:57.526860 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-0819739b-04bc-4d06-b10b-cf0b5eaef980 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:57.567377 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0819739b-04bc-4d06-b10b-cf0b5eaef980 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:57.572710 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0819739b-04bc-4d06-b10b-cf0b5eaef980 service placement] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:57.621425 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 875/1767] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:29:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:29:57.623222 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3caa3b5-de25-4154-aa32-a26ad8d08aa1 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:57.623700 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3caa3b5-de25-4154-aa32-a26ad8d08aa1 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:57.624188 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3caa3b5-de25-4154-aa32-a26ad8d08aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:57.697181 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92ca1b0-e039-411c-9361-893738901c04 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:57.701139 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-e3caa3b5-de25-4154-aa32-a26ad8d08aa1 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:29:57.705756 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-e3caa3b5-de25-4154-aa32-a26ad8d08aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:57.711888 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3abca0c-d0d7-4c42-8c5e-1d394f754537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:57.712523 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3abca0c-d0d7-4c42-8c5e-1d394f754537 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:57.712826 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3abca0c-d0d7-4c42-8c5e-1d394f754537 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:57.713192 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3abca0c-d0d7-4c42-8c5e-1d394f754537 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:57.713932 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3abca0c-d0d7-4c42-8c5e-1d394f754537 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:57.717898 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3abca0c-d0d7-4c42-8c5e-1d394f754537 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:57.728826 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 876/1768] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:29:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:29:57.735218 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d8c892-82b1-43b7-8345-42340652c56f None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:57.736162 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d8c892-82b1-43b7-8345-42340652c56f None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:57.736572 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d8c892-82b1-43b7-8345-42340652c56f None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:57.738984 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 877/1769] 10.222.0.25 () {54 vars in 912 bytes} [Tue Oct 4 03:29:57 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:29:57.739422 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 893/1770] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:29:57 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:29:57.748209 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742bc6c8-bb6b-4adb-82d6-06f41cd0bfa3 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:57.748209 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742bc6c8-bb6b-4adb-82d6-06f41cd0bfa3 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:57.748209 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742bc6c8-bb6b-4adb-82d6-06f41cd0bfa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:57.751029 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3abca0c-d0d7-4c42-8c5e-1d394f754537 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:57.773006 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3abca0c-d0d7-4c42-8c5e-1d394f754537 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:57.812618 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2f29ef-82d0-478c-b200-8f0c1b6b38d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:57.813380 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f29ef-82d0-478c-b200-8f0c1b6b38d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:57.818923 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f29ef-82d0-478c-b200-8f0c1b6b38d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:57.819306 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f29ef-82d0-478c-b200-8f0c1b6b38d3 admin admin] PATH_INFO: `/v3/projects/31fd39fe626e4a389747c316388a5078/users/37ba2f4a66cb49f4ad9ab4c8c2cad6a3/roles/fe9379cda35c4ff78576fe48b60bea3c` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:57.836249 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-742bc6c8-bb6b-4adb-82d6-06f41cd0bfa3 None None] MFA Rules not processed for user `5e43cc9523d949a1bfa3dec882f2824f`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:29:57.837487 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-742bc6c8-bb6b-4adb-82d6-06f41cd0bfa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:57.872614 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2f29ef-82d0-478c-b200-8f0c1b6b38d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31fd39fe626e4a389747c316388a5078, user_id=37ba2f4a66cb49f4ad9ab4c8c2cad6a3, role_id=fe9379cda35c4ff78576fe48b60bea3c)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:57.875443 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2f29ef-82d0-478c-b200-8f0c1b6b38d3 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:57.965520 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 894/1771] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:29:57 2022] PUT /identity/v3/projects/31fd39fe626e4a389747c316388a5078/users/37ba2f4a66cb49f4ad9ab4c8c2cad6a3/roles/fe9379cda35c4ff78576fe48b60bea3c => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:29:57.973712 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2f29ef-82d0-478c-b200-8f0c1b6b38d3 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:57.984157 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-3c2f29ef-82d0-478c-b200-8f0c1b6b38d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:58.094702 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 878/1772] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Oct 4 03:29:57 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 03:29:58.098303 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742bc6c8-bb6b-4adb-82d6-06f41cd0bfa3 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:58.130557 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742bc6c8-bb6b-4adb-82d6-06f41cd0bfa3 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:58.154711 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2f29ef-82d0-478c-b200-8f0c1b6b38d3 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:58.163228 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e1a72a-8154-4369-9ed7-993d88653bac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:58.164775 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1a72a-8154-4369-9ed7-993d88653bac service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:58.165864 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1a72a-8154-4369-9ed7-993d88653bac service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:58.166402 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1a72a-8154-4369-9ed7-993d88653bac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:58.197311 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:29:58.313439 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96530fca-7cb2-4166-afb7-0754292459b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:58.314069 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96530fca-7cb2-4166-afb7-0754292459b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:58.314353 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96530fca-7cb2-4166-afb7-0754292459b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:58.314625 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96530fca-7cb2-4166-afb7-0754292459b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:58.315282 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96530fca-7cb2-4166-afb7-0754292459b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:58.316923 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96530fca-7cb2-4166-afb7-0754292459b9 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:58.338147 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 879/1773] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:29:58 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:29:58.338902 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96530fca-7cb2-4166-afb7-0754292459b9 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:58.363592 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96530fca-7cb2-4166-afb7-0754292459b9 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:58.380484 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277773d5-1d10-4ba9-936f-f4f94c726ad0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:58.380484 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277773d5-1d10-4ba9-936f-f4f94c726ad0 service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:58.381148 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277773d5-1d10-4ba9-936f-f4f94c726ad0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:58.381227 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277773d5-1d10-4ba9-936f-f4f94c726ad0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:58.399626 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277773d5-1d10-4ba9-936f-f4f94c726ad0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:58.401119 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277773d5-1d10-4ba9-936f-f4f94c726ad0 service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:58.420953 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 880/1774] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:29:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:29:58.421915 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0753e3c-3981-4e75-99d6-817feda65d6d None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:58.422200 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0753e3c-3981-4e75-99d6-817feda65d6d None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:58.422476 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0753e3c-3981-4e75-99d6-817feda65d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:58.436757 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:29:58.468249 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-b0753e3c-3981-4e75-99d6-817feda65d6d None None] MFA Rules not processed for user `a267cf7109c64f538824c162fedd084b`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:29:58.469491 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-b0753e3c-3981-4e75-99d6-817feda65d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:58.491122 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e1a72a-8154-4369-9ed7-993d88653bac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:58.500573 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e1a72a-8154-4369-9ed7-993d88653bac service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:58.549083 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 895/1775] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:29:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 583 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:29:58.550056 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e1a72a-8154-4369-9ed7-993d88653bac service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:58.578850 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e1a72a-8154-4369-9ed7-993d88653bac service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:58.595916 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fe3459-4581-4174-b803-08d4ae9ba3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:58.596749 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fe3459-4581-4174-b803-08d4ae9ba3ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:58.597077 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fe3459-4581-4174-b803-08d4ae9ba3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:58.597352 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fe3459-4581-4174-b803-08d4ae9ba3ec admin admin] PATH_INFO: `/v3/projects/31fd39fe626e4a389747c316388a5078/users/37ba2f4a66cb49f4ad9ab4c8c2cad6a3/roles/fe9379cda35c4ff78576fe48b60bea3c` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:58.608171 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fe3459-4581-4174-b803-08d4ae9ba3ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=31fd39fe626e4a389747c316388a5078, user_id=37ba2f4a66cb49f4ad9ab4c8c2cad6a3, role_id=fe9379cda35c4ff78576fe48b60bea3c)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:58.611039 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fe3459-4581-4174-b803-08d4ae9ba3ec admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:58.653236 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 881/1776] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:29:58 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:29:58.658947 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 896/1777] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:29:58 2022] PUT /identity/v3/projects/31fd39fe626e4a389747c316388a5078/users/37ba2f4a66cb49f4ad9ab4c8c2cad6a3/roles/fe9379cda35c4ff78576fe48b60bea3c => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:29:58.669598 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390e3e5-184b-4822-968b-c2c54d3b8bdb None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:58.669885 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390e3e5-184b-4822-968b-c2c54d3b8bdb None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:58.670159 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390e3e5-184b-4822-968b-c2c54d3b8bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:58.745433 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-5390e3e5-184b-4822-968b-c2c54d3b8bdb None None] MFA Rules not processed for user `37ba2f4a66cb49f4ad9ab4c8c2cad6a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:29:58.746665 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-5390e3e5-184b-4822-968b-c2c54d3b8bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:58.897593 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 882/1778] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:29:58 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:29:58.909104 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fe3459-4581-4174-b803-08d4ae9ba3ec admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:58.912564 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-f6fe3459-4581-4174-b803-08d4ae9ba3ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:59.145400 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fe3459-4581-4174-b803-08d4ae9ba3ec admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:59.164140 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce81bb25-3cc6-4ce1-a534-f9d6842782b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f537aabf3d1040ff840b02616f839975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:59.165272 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81bb25-3cc6-4ce1-a534-f9d6842782b5 service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:59.165673 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81bb25-3cc6-4ce1-a534-f9d6842782b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:59.166092 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81bb25-3cc6-4ce1-a534-f9d6842782b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:59.180127 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce81bb25-3cc6-4ce1-a534-f9d6842782b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:59.182194 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce81bb25-3cc6-4ce1-a534-f9d6842782b5 service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:59.203743 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 897/1779] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:29:58 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:29:59.300910 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de8276-5874-47a8-8d42-c62fc5155d63 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:59.301720 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de8276-5874-47a8-8d42-c62fc5155d63 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:59.302215 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de8276-5874-47a8-8d42-c62fc5155d63 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:59.304325 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 883/1780] 10.222.0.25 () {54 vars in 921 bytes} [Tue Oct 4 03:29:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:29:59.361695 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce81bb25-3cc6-4ce1-a534-f9d6842782b5 service cinder] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:59.386242 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce81bb25-3cc6-4ce1-a534-f9d6842782b5 service cinder] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:29:59.413583 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397cb282-614c-4fb1-93e4-bab4ffe1e2f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f537aabf3d1040ff840b02616f839975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:29:59.415604 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397cb282-614c-4fb1-93e4-bab4ffe1e2f3 service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:59.415604 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397cb282-614c-4fb1-93e4-bab4ffe1e2f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:59.415604 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397cb282-614c-4fb1-93e4-bab4ffe1e2f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:59.425743 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-397cb282-614c-4fb1-93e4-bab4ffe1e2f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:59.592936 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397cb282-614c-4fb1-93e4-bab4ffe1e2f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:29:59.594540 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397cb282-614c-4fb1-93e4-bab4ffe1e2f3 service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:29:59.594925 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c98b25-1af2-4875-8d29-e0517dd035f3 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:29:59.595414 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c98b25-1af2-4875-8d29-e0517dd035f3 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:29:59.595870 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c98b25-1af2-4875-8d29-e0517dd035f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:29:59.614211 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 898/1781] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:29:59 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:29:59.656265 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-63c98b25-1af2-4875-8d29-e0517dd035f3 None None] MFA Rules not processed for user `2c1f412befb9418fa66a2aabf475aa90`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:29:59.659749 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-63c98b25-1af2-4875-8d29-e0517dd035f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:29:59.725281 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:29:59.773804 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 884/1782] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Oct 4 03:29:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:29:59.930338 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397cb282-614c-4fb1-93e4-bab4ffe1e2f3 service cinder] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:29:59.932949 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-397cb282-614c-4fb1-93e4-bab4ffe1e2f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:00.179083 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397cb282-614c-4fb1-93e4-bab4ffe1e2f3 service cinder] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:00.222461 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f0b84-d952-4674-9436-fdb0b8bfee51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:00.223117 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f0b84-d952-4674-9436-fdb0b8bfee51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:00.223473 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f0b84-d952-4674-9436-fdb0b8bfee51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:00.223738 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f0b84-d952-4674-9436-fdb0b8bfee51 admin admin] PATH_INFO: `/v3/users/c9521db74a4b4492b1453236d7e9d2ca` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:00.227357 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98f0b84-d952-4674-9436-fdb0b8bfee51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9521db74a4b4492b1453236d7e9d2ca)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:00.229536 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98f0b84-d952-4674-9436-fdb0b8bfee51 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:00.311711 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:00.380729 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-e98f0b84-d952-4674-9436-fdb0b8bfee51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9521db74a4b4492b1453236d7e9d2ca'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:00.386698 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-e98f0b84-d952-4674-9436-fdb0b8bfee51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9521db74a4b4492b1453236d7e9d2ca'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:00.410435 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-e98f0b84-d952-4674-9436-fdb0b8bfee51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9521db74a4b4492b1453236d7e9d2ca'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:00.412490 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-e98f0b84-d952-4674-9436-fdb0b8bfee51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9521db74a4b4492b1453236d7e9d2ca'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:00.445481 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-e98f0b84-d952-4674-9436-fdb0b8bfee51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9521db74a4b4492b1453236d7e9d2ca'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:00.475304 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 899/1783] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:29:59 2022] DELETE /identity/v3/users/c9521db74a4b4492b1453236d7e9d2ca => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:30:00.896517 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c98b25-1af2-4875-8d29-e0517dd035f3 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:00.898250 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-63c98b25-1af2-4875-8d29-e0517dd035f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:00.925447 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c98b25-1af2-4875-8d29-e0517dd035f3 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:01.064749 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f0b84-d952-4674-9436-fdb0b8bfee51 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:01.066365 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-e98f0b84-d952-4674-9436-fdb0b8bfee51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:01.285868 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f6a6b6-c6da-4eba-9d69-d6ddd0753a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:01.287005 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f6a6b6-c6da-4eba-9d69-d6ddd0753a3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:01.288129 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f6a6b6-c6da-4eba-9d69-d6ddd0753a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:01.289028 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f6a6b6-c6da-4eba-9d69-d6ddd0753a3e admin admin] PATH_INFO: `/v3/projects/1933ab78b11d4e0b84d7bc038a54084f` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:01.292556 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f6a6b6-c6da-4eba-9d69-d6ddd0753a3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1933ab78b11d4e0b84d7bc038a54084f)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:01.328205 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f6a6b6-c6da-4eba-9d69-d6ddd0753a3e admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:01.388906 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f0b84-d952-4674-9436-fdb0b8bfee51 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:01.423083 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63dc904-f51b-495b-b634-b89590dc32a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1f412befb9418fa66a2aabf475aa90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:01.425291 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63dc904-f51b-495b-b634-b89590dc32a6 service nova] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:01.425795 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63dc904-f51b-495b-b634-b89590dc32a6 service nova] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:01.427891 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63dc904-f51b-495b-b634-b89590dc32a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:01.432133 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-c63dc904-f51b-495b-b634-b89590dc32a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:01.467166 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63dc904-f51b-495b-b634-b89590dc32a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:01.472856 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63dc904-f51b-495b-b634-b89590dc32a6 service nova] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:01.504472 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 900/1784] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:30:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:30:01.658545 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-d6f6a6b6-c6da-4eba-9d69-d6ddd0753a3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1933ab78b11d4e0b84d7bc038a54084f', 'request_id': 'req-d6f6a6b6-c6da-4eba-9d69-d6ddd0753a3e'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:01.679129 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-d6f6a6b6-c6da-4eba-9d69-d6ddd0753a3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1933ab78b11d4e0b84d7bc038a54084f', 'request_id': 'req-d6f6a6b6-c6da-4eba-9d69-d6ddd0753a3e'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:01.713161 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-d6f6a6b6-c6da-4eba-9d69-d6ddd0753a3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1933ab78b11d4e0b84d7bc038a54084f', 'request_id': 'req-d6f6a6b6-c6da-4eba-9d69-d6ddd0753a3e'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:01.794627 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-d6f6a6b6-c6da-4eba-9d69-d6ddd0753a3e admin admin] The token cache is being invalidate because project 1933ab78b11d4e0b84d7bc038a54084f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:30:01.795267 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-d6f6a6b6-c6da-4eba-9d69-d6ddd0753a3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:01.797969 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-d6f6a6b6-c6da-4eba-9d69-d6ddd0753a3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:01.805730 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 885/1785] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:30:00 2022] DELETE /identity/v3/projects/1933ab78b11d4e0b84d7bc038a54084f => generated 0 bytes in 910 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:30:01.810369 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63dc904-f51b-495b-b634-b89590dc32a6 service nova] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:01.811893 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-c63dc904-f51b-495b-b634-b89590dc32a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:01.831998 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63dc904-f51b-495b-b634-b89590dc32a6 service nova] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:01.853021 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b747e-b3d7-4d11-9e42-bd8cc0885375 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:01.853314 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b747e-b3d7-4d11-9e42-bd8cc0885375 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:01.853596 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b747e-b3d7-4d11-9e42-bd8cc0885375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:01.943252 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-3c5b747e-b3d7-4d11-9e42-bd8cc0885375 None None] MFA Rules not processed for user `b8795829c34046628cae345dd4d45e75`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:30:01.946899 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-3c5b747e-b3d7-4d11-9e42-bd8cc0885375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:02.160876 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbafbe28-0464-413b-95e3-2b61feb66588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:02.162421 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbafbe28-0464-413b-95e3-2b61feb66588 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:02.162953 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbafbe28-0464-413b-95e3-2b61feb66588 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:02.163805 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbafbe28-0464-413b-95e3-2b61feb66588 admin admin] PATH_INFO: `/v3/users/af7b5ed23f674fe7859fcf1afa78c425` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:02.167911 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbafbe28-0464-413b-95e3-2b61feb66588 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af7b5ed23f674fe7859fcf1afa78c425)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:02.173597 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbafbe28-0464-413b-95e3-2b61feb66588 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:02.227965 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 886/1786] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:30:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:30:02.232114 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5b747e-b3d7-4d11-9e42-bd8cc0885375 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:02.236319 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-3c5b747e-b3d7-4d11-9e42-bd8cc0885375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:02.268290 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:02.278369 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5b747e-b3d7-4d11-9e42-bd8cc0885375 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:02.305580 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0aa8cb-3581-4e32-b145-5f9a6f1e39ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:02.307077 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0aa8cb-3581-4e32-b145-5f9a6f1e39ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:02.308129 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0aa8cb-3581-4e32-b145-5f9a6f1e39ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:02.309817 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0aa8cb-3581-4e32-b145-5f9a6f1e39ad admin admin] PATH_INFO: `/v3/projects/197ffba89a3e433394b5d49ab838b517` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:02.314377 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0aa8cb-3581-4e32-b145-5f9a6f1e39ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=197ffba89a3e433394b5d49ab838b517)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:02.316697 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0aa8cb-3581-4e32-b145-5f9a6f1e39ad admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:02.344850 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:02.421680 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-cbafbe28-0464-413b-95e3-2b61feb66588 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af7b5ed23f674fe7859fcf1afa78c425'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:02.424718 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-cbafbe28-0464-413b-95e3-2b61feb66588 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af7b5ed23f674fe7859fcf1afa78c425'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:02.442049 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-cbafbe28-0464-413b-95e3-2b61feb66588 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af7b5ed23f674fe7859fcf1afa78c425'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:02.443705 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-cbafbe28-0464-413b-95e3-2b61feb66588 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af7b5ed23f674fe7859fcf1afa78c425'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:02.500091 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-cbafbe28-0464-413b-95e3-2b61feb66588 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af7b5ed23f674fe7859fcf1afa78c425'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:02.549463 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-bb0aa8cb-3581-4e32-b145-5f9a6f1e39ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '197ffba89a3e433394b5d49ab838b517', 'request_id': 'req-bb0aa8cb-3581-4e32-b145-5f9a6f1e39ad'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:02.565016 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-bb0aa8cb-3581-4e32-b145-5f9a6f1e39ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '197ffba89a3e433394b5d49ab838b517', 'request_id': 'req-bb0aa8cb-3581-4e32-b145-5f9a6f1e39ad'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:02.565729 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 901/1787] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:30:01 2022] DELETE /identity/v3/users/af7b5ed23f674fe7859fcf1afa78c425 => generated 0 bytes in 753 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:30:02.574558 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-bb0aa8cb-3581-4e32-b145-5f9a6f1e39ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '197ffba89a3e433394b5d49ab838b517', 'request_id': 'req-bb0aa8cb-3581-4e32-b145-5f9a6f1e39ad'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:02.625280 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-bb0aa8cb-3581-4e32-b145-5f9a6f1e39ad admin admin] The token cache is being invalidate because project 197ffba89a3e433394b5d49ab838b517 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:30:02.625578 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-bb0aa8cb-3581-4e32-b145-5f9a6f1e39ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:02.626945 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-bb0aa8cb-3581-4e32-b145-5f9a6f1e39ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:02.647128 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 887/1788] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:30:02 2022] DELETE /identity/v3/projects/197ffba89a3e433394b5d49ab838b517 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:30:02.650940 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbafbe28-0464-413b-95e3-2b61feb66588 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:02.652405 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-cbafbe28-0464-413b-95e3-2b61feb66588 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:02.780736 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbafbe28-0464-413b-95e3-2b61feb66588 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:02.794790 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e588ca79-7608-47a7-a289-d0895ad815f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:02.795449 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e588ca79-7608-47a7-a289-d0895ad815f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:02.796889 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e588ca79-7608-47a7-a289-d0895ad815f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:02.797321 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e588ca79-7608-47a7-a289-d0895ad815f8 admin admin] PATH_INFO: `/v3/users/80d1dbeb9aee4764ac8c4dc7f00f71f0` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:02.800980 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e588ca79-7608-47a7-a289-d0895ad815f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80d1dbeb9aee4764ac8c4dc7f00f71f0)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:02.807717 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e588ca79-7608-47a7-a289-d0895ad815f8 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:02.945703 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-e588ca79-7608-47a7-a289-d0895ad815f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80d1dbeb9aee4764ac8c4dc7f00f71f0'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:02.946715 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-e588ca79-7608-47a7-a289-d0895ad815f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80d1dbeb9aee4764ac8c4dc7f00f71f0'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:02.962708 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-e588ca79-7608-47a7-a289-d0895ad815f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80d1dbeb9aee4764ac8c4dc7f00f71f0'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:02.963348 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-e588ca79-7608-47a7-a289-d0895ad815f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80d1dbeb9aee4764ac8c4dc7f00f71f0'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:03.005963 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-e588ca79-7608-47a7-a289-d0895ad815f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80d1dbeb9aee4764ac8c4dc7f00f71f0'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:03.078331 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 902/1789] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:30:02 2022] DELETE /identity/v3/users/80d1dbeb9aee4764ac8c4dc7f00f71f0 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:30:04.057535 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0aa8cb-3581-4e32-b145-5f9a6f1e39ad admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:04.059789 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-bb0aa8cb-3581-4e32-b145-5f9a6f1e39ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:04.279608 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0aa8cb-3581-4e32-b145-5f9a6f1e39ad admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:04.490537 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af308378-2cac-4055-aeda-37b414e65fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:04.491413 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af308378-2cac-4055-aeda-37b414e65fe7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:04.491733 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af308378-2cac-4055-aeda-37b414e65fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:04.492040 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af308378-2cac-4055-aeda-37b414e65fe7 admin admin] PATH_INFO: `/v3/projects/8541198a043e43dbbe3c3e70a8090deb` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:04.496271 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af308378-2cac-4055-aeda-37b414e65fe7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8541198a043e43dbbe3c3e70a8090deb)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:04.503953 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af308378-2cac-4055-aeda-37b414e65fe7 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:04.625575 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:04.673646 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-af308378-2cac-4055-aeda-37b414e65fe7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8541198a043e43dbbe3c3e70a8090deb', 'request_id': 'req-af308378-2cac-4055-aeda-37b414e65fe7'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:04.689056 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-af308378-2cac-4055-aeda-37b414e65fe7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8541198a043e43dbbe3c3e70a8090deb', 'request_id': 'req-af308378-2cac-4055-aeda-37b414e65fe7'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:04.698006 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-af308378-2cac-4055-aeda-37b414e65fe7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8541198a043e43dbbe3c3e70a8090deb', 'request_id': 'req-af308378-2cac-4055-aeda-37b414e65fe7'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:04.721115 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-af308378-2cac-4055-aeda-37b414e65fe7 admin admin] The token cache is being invalidate because project 8541198a043e43dbbe3c3e70a8090deb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:30:04.721115 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-af308378-2cac-4055-aeda-37b414e65fe7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:04.723295 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-af308378-2cac-4055-aeda-37b414e65fe7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:04.730274 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 888/1790] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:30:04 2022] DELETE /identity/v3/projects/8541198a043e43dbbe3c3e70a8090deb => generated 0 bytes in 673 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:30:04.734785 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e588ca79-7608-47a7-a289-d0895ad815f8 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:04.736450 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-e588ca79-7608-47a7-a289-d0895ad815f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:04.781015 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e588ca79-7608-47a7-a289-d0895ad815f8 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:04.861530 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:04.945968 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8bbe18-7e23-46cd-a60a-135f592b684f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:04.946746 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8bbe18-7e23-46cd-a60a-135f592b684f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:04.949105 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8bbe18-7e23-46cd-a60a-135f592b684f admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:04.949443 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8bbe18-7e23-46cd-a60a-135f592b684f admin admin] PATH_INFO: `/v3/users/fef1ef876b6b434ca2a0704eeb10d7aa` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:04.951049 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8bbe18-7e23-46cd-a60a-135f592b684f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fef1ef876b6b434ca2a0704eeb10d7aa)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:04.953808 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8bbe18-7e23-46cd-a60a-135f592b684f admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:05.068800 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-5c8bbe18-7e23-46cd-a60a-135f592b684f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fef1ef876b6b434ca2a0704eeb10d7aa'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:05.070450 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-5c8bbe18-7e23-46cd-a60a-135f592b684f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fef1ef876b6b434ca2a0704eeb10d7aa'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:05.084624 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-5c8bbe18-7e23-46cd-a60a-135f592b684f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fef1ef876b6b434ca2a0704eeb10d7aa'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:05.085359 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-5c8bbe18-7e23-46cd-a60a-135f592b684f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fef1ef876b6b434ca2a0704eeb10d7aa'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:05.102014 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-5c8bbe18-7e23-46cd-a60a-135f592b684f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fef1ef876b6b434ca2a0704eeb10d7aa'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:05.119535 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 903/1791] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:30:04 2022] DELETE /identity/v3/users/fef1ef876b6b434ca2a0704eeb10d7aa => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:30:06.373089 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af308378-2cac-4055-aeda-37b414e65fe7 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:06.375520 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-af308378-2cac-4055-aeda-37b414e65fe7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:06.409916 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af308378-2cac-4055-aeda-37b414e65fe7 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:06.607449 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cd8a53-d7a4-4e3a-8d14-74ffafb2d4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:06.608986 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd8a53-d7a4-4e3a-8d14-74ffafb2d4e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:06.609482 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd8a53-d7a4-4e3a-8d14-74ffafb2d4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:06.609982 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd8a53-d7a4-4e3a-8d14-74ffafb2d4e1 admin admin] PATH_INFO: `/v3/projects/8e7dff9890d94f8c94556cd044008cb4` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:06.615538 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cd8a53-d7a4-4e3a-8d14-74ffafb2d4e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e7dff9890d94f8c94556cd044008cb4)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:06.619816 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cd8a53-d7a4-4e3a-8d14-74ffafb2d4e1 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:06.741709 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-12cd8a53-d7a4-4e3a-8d14-74ffafb2d4e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e7dff9890d94f8c94556cd044008cb4', 'request_id': 'req-12cd8a53-d7a4-4e3a-8d14-74ffafb2d4e1'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:06.756483 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-12cd8a53-d7a4-4e3a-8d14-74ffafb2d4e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e7dff9890d94f8c94556cd044008cb4', 'request_id': 'req-12cd8a53-d7a4-4e3a-8d14-74ffafb2d4e1'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:06.790813 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-12cd8a53-d7a4-4e3a-8d14-74ffafb2d4e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e7dff9890d94f8c94556cd044008cb4', 'request_id': 'req-12cd8a53-d7a4-4e3a-8d14-74ffafb2d4e1'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:06.827672 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-12cd8a53-d7a4-4e3a-8d14-74ffafb2d4e1 admin admin] The token cache is being invalidate because project 8e7dff9890d94f8c94556cd044008cb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:30:06.828295 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-12cd8a53-d7a4-4e3a-8d14-74ffafb2d4e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:06.830146 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-12cd8a53-d7a4-4e3a-8d14-74ffafb2d4e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:06.838665 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 889/1792] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:30:06 2022] DELETE /identity/v3/projects/8e7dff9890d94f8c94556cd044008cb4 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:30:06.846076 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8acd94-0908-46dd-bb9f-e98b39a8c3b3 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:06.846681 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8acd94-0908-46dd-bb9f-e98b39a8c3b3 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:06.846952 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8acd94-0908-46dd-bb9f-e98b39a8c3b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:06.899604 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-fa8acd94-0908-46dd-bb9f-e98b39a8c3b3 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:30:06.902163 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-fa8acd94-0908-46dd-bb9f-e98b39a8c3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:07.133848 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 904/1793] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:30:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:30:07.141455 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a583b-8352-4bb8-b50b-b8d1e78d3eb7 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:07.142131 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a583b-8352-4bb8-b50b-b8d1e78d3eb7 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:07.142914 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a583b-8352-4bb8-b50b-b8d1e78d3eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:07.227591 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-d34a583b-8352-4bb8-b50b-b8d1e78d3eb7 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:30:07.227591 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-d34a583b-8352-4bb8-b50b-b8d1e78d3eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:07.272972 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 890/1794] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:30:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:30:07.274983 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8acd94-0908-46dd-bb9f-e98b39a8c3b3 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:07.308085 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8acd94-0908-46dd-bb9f-e98b39a8c3b3 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:07.385725 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6331ecfa-7250-4d82-8bc4-852f3979e697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:07.394966 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6331ecfa-7250-4d82-8bc4-852f3979e697 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:07.397269 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6331ecfa-7250-4d82-8bc4-852f3979e697 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:07.397733 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6331ecfa-7250-4d82-8bc4-852f3979e697 admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:07.407577 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6331ecfa-7250-4d82-8bc4-852f3979e697 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:30:07.408432 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6331ecfa-7250-4d82-8bc4-852f3979e697 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:07.414618 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6331ecfa-7250-4d82-8bc4-852f3979e697 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:07.503348 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 905/1795] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 03:30:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:30:07.505619 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34a583b-8352-4bb8-b50b-b8d1e78d3eb7 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:07.577922 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34a583b-8352-4bb8-b50b-b8d1e78d3eb7 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:07.595810 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8757c229-c53d-4d39-9d29-4a863e21e70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:07.597766 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8757c229-c53d-4d39-9d29-4a863e21e70c admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:07.600269 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8757c229-c53d-4d39-9d29-4a863e21e70c admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:07.600749 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8757c229-c53d-4d39-9d29-4a863e21e70c admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:07.601131 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8757c229-c53d-4d39-9d29-4a863e21e70c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:07.621904 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8757c229-c53d-4d39-9d29-4a863e21e70c admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:07.691480 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 891/1796] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:30:07 2022] POST /identity/v3/projects => generated 369 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:30:07.696388 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6331ecfa-7250-4d82-8bc4-852f3979e697 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:07.718503 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6331ecfa-7250-4d82-8bc4-852f3979e697 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:07.859985 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:07.961319 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982d0e01-87d8-445c-9798-5775fedaad3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:07.961708 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d0e01-87d8-445c-9798-5775fedaad3e admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:07.962020 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d0e01-87d8-445c-9798-5775fedaad3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:07.962287 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d0e01-87d8-445c-9798-5775fedaad3e admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:07.963452 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982d0e01-87d8-445c-9798-5775fedaad3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:07.965416 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982d0e01-87d8-445c-9798-5775fedaad3e admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:08.019276 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 906/1797] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:30:07 2022] POST /identity/v3/users => generated 285 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:30:08.021403 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8757c229-c53d-4d39-9d29-4a863e21e70c admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:08.048315 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8757c229-c53d-4d39-9d29-4a863e21e70c admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:08.057386 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31ce283-a198-4c1f-a02b-bd4cda3953ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:08.058814 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ce283-a198-4c1f-a02b-bd4cda3953ed admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:08.059653 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ce283-a198-4c1f-a02b-bd4cda3953ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:08.073731 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ce283-a198-4c1f-a02b-bd4cda3953ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:08.075978 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31ce283-a198-4c1f-a02b-bd4cda3953ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:08.082583 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31ce283-a198-4c1f-a02b-bd4cda3953ed admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:08.120911 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 892/1798] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:30:08.124022 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982d0e01-87d8-445c-9798-5775fedaad3e admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:08.141068 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982d0e01-87d8-445c-9798-5775fedaad3e admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:08.169037 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6303bb-fea5-4c44-93ed-942340278a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:08.169670 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6303bb-fea5-4c44-93ed-942340278a65 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:08.170106 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6303bb-fea5-4c44-93ed-942340278a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:08.170388 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6303bb-fea5-4c44-93ed-942340278a65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:08.171045 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6303bb-fea5-4c44-93ed-942340278a65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:08.172766 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6303bb-fea5-4c44-93ed-942340278a65 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:08.241214 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 907/1799] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:30:08.243742 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31ce283-a198-4c1f-a02b-bd4cda3953ed admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:08.267164 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31ce283-a198-4c1f-a02b-bd4cda3953ed admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:08.292285 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2256e0b0-c775-4940-a3fb-5fe8f1f81539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:08.297156 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256e0b0-c775-4940-a3fb-5fe8f1f81539 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:08.298198 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256e0b0-c775-4940-a3fb-5fe8f1f81539 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:08.300712 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256e0b0-c775-4940-a3fb-5fe8f1f81539 admin admin] PATH_INFO: `/v3/projects/e8273030191644e6ac236977d0b74be9/users/33a637b66a6a4c9f831aebec7282d9a4/roles/04d0e4575a28440eb4349b4a6565e8b8` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:08.352266 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:08.375068 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2256e0b0-c775-4940-a3fb-5fe8f1f81539 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8273030191644e6ac236977d0b74be9, user_id=33a637b66a6a4c9f831aebec7282d9a4, role_id=04d0e4575a28440eb4349b4a6565e8b8)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:08.381228 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2256e0b0-c775-4940-a3fb-5fe8f1f81539 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:08.429026 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5410ed98-63d9-49a7-a096-a5cd83e41351 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:08.429401 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5410ed98-63d9-49a7-a096-a5cd83e41351 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:08.429752 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5410ed98-63d9-49a7-a096-a5cd83e41351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:08.430266 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 893/1800] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:30:08 2022] PUT /identity/v3/projects/e8273030191644e6ac236977d0b74be9/users/33a637b66a6a4c9f831aebec7282d9a4/roles/04d0e4575a28440eb4349b4a6565e8b8 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:30:08.477789 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-5410ed98-63d9-49a7-a096-a5cd83e41351 None None] MFA Rules not processed for user `33a637b66a6a4c9f831aebec7282d9a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:30:08.480747 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-5410ed98-63d9-49a7-a096-a5cd83e41351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:08.596300 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 908/1801] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:30:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:30:08.602518 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2256e0b0-c775-4940-a3fb-5fe8f1f81539 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:08.733458 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2256e0b0-c775-4940-a3fb-5fe8f1f81539 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:08.738792 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cc6355-27ca-4d27-a551-dcea5f7a9f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:08.739867 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cc6355-27ca-4d27-a551-dcea5f7a9f90 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:08.740467 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cc6355-27ca-4d27-a551-dcea5f7a9f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:08.740930 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cc6355-27ca-4d27-a551-dcea5f7a9f90 admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:08.741752 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cc6355-27ca-4d27-a551-dcea5f7a9f90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:08.743866 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cc6355-27ca-4d27-a551-dcea5f7a9f90 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:08.789528 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5410ed98-63d9-49a7-a096-a5cd83e41351 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:08.790107 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 894/1802] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:30:08 2022] POST /identity/v3/projects => generated 367 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:30:08.802677 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5410ed98-63d9-49a7-a096-a5cd83e41351 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:08.828780 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cc6355-27ca-4d27-a551-dcea5f7a9f90 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:08.831255 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-77cc6355-27ca-4d27-a551-dcea5f7a9f90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:08.925815 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0cf9f7-2c41-4773-898d-3b93ff29d7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:08.927343 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0cf9f7-2c41-4773-898d-3b93ff29d7dc admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:08.927882 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0cf9f7-2c41-4773-898d-3b93ff29d7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:08.928599 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0cf9f7-2c41-4773-898d-3b93ff29d7dc admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:08.930289 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0cf9f7-2c41-4773-898d-3b93ff29d7dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:08.933005 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0cf9f7-2c41-4773-898d-3b93ff29d7dc admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:08.960485 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 909/1803] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:30:08 2022] POST /identity/v3/users => generated 290 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:30:08.964394 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0cf9f7-2c41-4773-898d-3b93ff29d7dc admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:08.978265 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cc6355-27ca-4d27-a551-dcea5f7a9f90 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:08.986401 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0cf9f7-2c41-4773-898d-3b93ff29d7dc admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:08.998108 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c983d-4ea8-401f-a3d1-425696d97947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:08.998734 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c983d-4ea8-401f-a3d1-425696d97947 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:08.999743 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38449a4a-d1fc-4e88-b4ca-94c9946c08ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:09.000236 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c983d-4ea8-401f-a3d1-425696d97947 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:09.000519 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c983d-4ea8-401f-a3d1-425696d97947 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:09.001573 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38449a4a-d1fc-4e88-b4ca-94c9946c08ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:09.002074 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38449a4a-d1fc-4e88-b4ca-94c9946c08ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:09.002556 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38449a4a-d1fc-4e88-b4ca-94c9946c08ea admin admin] PATH_INFO: `/v3/projects/dcaf6960039848ca9baefc077f86d9bd` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:09.003258 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158c983d-4ea8-401f-a3d1-425696d97947 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:09.005212 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158c983d-4ea8-401f-a3d1-425696d97947 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:09.006931 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38449a4a-d1fc-4e88-b4ca-94c9946c08ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcaf6960039848ca9baefc077f86d9bd)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:09.008981 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38449a4a-d1fc-4e88-b4ca-94c9946c08ea admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:09.029235 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 910/1804] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:30:09.030056 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c983d-4ea8-401f-a3d1-425696d97947 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:09.040822 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c983d-4ea8-401f-a3d1-425696d97947 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:09.053508 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb181beb-ae6a-4904-83e9-861ed178b5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:09.054340 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb181beb-ae6a-4904-83e9-861ed178b5ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:09.054630 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb181beb-ae6a-4904-83e9-861ed178b5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:09.054903 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb181beb-ae6a-4904-83e9-861ed178b5ed admin admin] PATH_INFO: `/v3/projects/009f165614af4f4f8a329c671c12c23d/users/5998c748f2444628883658298f42b7e0/roles/fe9379cda35c4ff78576fe48b60bea3c` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:09.069552 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:09.075972 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb181beb-ae6a-4904-83e9-861ed178b5ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=009f165614af4f4f8a329c671c12c23d, user_id=5998c748f2444628883658298f42b7e0, role_id=fe9379cda35c4ff78576fe48b60bea3c)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:09.078841 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb181beb-ae6a-4904-83e9-861ed178b5ed admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:09.097723 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 911/1805] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:30:09 2022] PUT /identity/v3/projects/009f165614af4f4f8a329c671c12c23d/users/5998c748f2444628883658298f42b7e0/roles/fe9379cda35c4ff78576fe48b60bea3c => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:30:09.102678 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb181beb-ae6a-4904-83e9-861ed178b5ed admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:09.105711 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-38449a4a-d1fc-4e88-b4ca-94c9946c08ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcaf6960039848ca9baefc077f86d9bd', 'request_id': 'req-38449a4a-d1fc-4e88-b4ca-94c9946c08ea'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:09.111520 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-38449a4a-d1fc-4e88-b4ca-94c9946c08ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcaf6960039848ca9baefc077f86d9bd', 'request_id': 'req-38449a4a-d1fc-4e88-b4ca-94c9946c08ea'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:09.119047 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-38449a4a-d1fc-4e88-b4ca-94c9946c08ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcaf6960039848ca9baefc077f86d9bd', 'request_id': 'req-38449a4a-d1fc-4e88-b4ca-94c9946c08ea'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:09.137034 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-38449a4a-d1fc-4e88-b4ca-94c9946c08ea admin admin] The token cache is being invalidate because project dcaf6960039848ca9baefc077f86d9bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:30:09.137249 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-38449a4a-d1fc-4e88-b4ca-94c9946c08ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:09.137895 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-38449a4a-d1fc-4e88-b4ca-94c9946c08ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:09.139585 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 895/1806] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:30:08 2022] DELETE /identity/v3/projects/dcaf6960039848ca9baefc077f86d9bd => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 03:30:09.146037 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc6ebc-6340-4206-ab8f-94123a0cd3d3 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:09.146653 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc6ebc-6340-4206-ab8f-94123a0cd3d3 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:09.147836 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc6ebc-6340-4206-ab8f-94123a0cd3d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:09.163955 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:09.183103 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-39fc6ebc-6340-4206-ab8f-94123a0cd3d3 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:30:09.184566 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-39fc6ebc-6340-4206-ab8f-94123a0cd3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:09.199533 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 896/1807] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:30:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:30:09.199838 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb181beb-ae6a-4904-83e9-861ed178b5ed admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:09.202746 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeca39d-89c5-4b86-9c1e-e2e59663e03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:09.203989 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091eca4d-7d70-42d9-b0cc-8ded0744a611 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:09.204581 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091eca4d-7d70-42d9-b0cc-8ded0744a611 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:09.204698 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeca39d-89c5-4b86-9c1e-e2e59663e03e admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:09.204791 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091eca4d-7d70-42d9-b0cc-8ded0744a611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:09.204888 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeca39d-89c5-4b86-9c1e-e2e59663e03e admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:09.204968 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeca39d-89c5-4b86-9c1e-e2e59663e03e admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:09.205566 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeca39d-89c5-4b86-9c1e-e2e59663e03e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:09.208696 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeca39d-89c5-4b86-9c1e-e2e59663e03e admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:09.222926 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 912/1808] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:30:09 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:30:09.228461 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeca39d-89c5-4b86-9c1e-e2e59663e03e admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:09.230026 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-091eca4d-7d70-42d9-b0cc-8ded0744a611 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:30:09.230198 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-5eeca39d-89c5-4b86-9c1e-e2e59663e03e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:09.231374 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-091eca4d-7d70-42d9-b0cc-8ded0744a611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:09.244531 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeca39d-89c5-4b86-9c1e-e2e59663e03e admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:09.247441 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 897/1809] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:30:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 03:30:09.249119 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091eca4d-7d70-42d9-b0cc-8ded0744a611 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:09.253544 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db30343a-44c3-4e4e-9e2d-23dd0dcd52c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:09.254225 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db30343a-44c3-4e4e-9e2d-23dd0dcd52c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:09.257425 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db30343a-44c3-4e4e-9e2d-23dd0dcd52c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:09.257425 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db30343a-44c3-4e4e-9e2d-23dd0dcd52c5 admin admin] PATH_INFO: `/v3/projects/009f165614af4f4f8a329c671c12c23d/users/5998c748f2444628883658298f42b7e0/roles/fe9379cda35c4ff78576fe48b60bea3c` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:09.259728 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db30343a-44c3-4e4e-9e2d-23dd0dcd52c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=009f165614af4f4f8a329c671c12c23d, user_id=5998c748f2444628883658298f42b7e0, role_id=fe9379cda35c4ff78576fe48b60bea3c)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:09.262495 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091eca4d-7d70-42d9-b0cc-8ded0744a611 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:09.263521 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db30343a-44c3-4e4e-9e2d-23dd0dcd52c5 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:09.272526 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395edd0f-e42d-4040-97dc-03b053ad56fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:09.273755 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395edd0f-e42d-4040-97dc-03b053ad56fe admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:09.274217 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395edd0f-e42d-4040-97dc-03b053ad56fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:09.274637 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395edd0f-e42d-4040-97dc-03b053ad56fe admin admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:09.275600 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395edd0f-e42d-4040-97dc-03b053ad56fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:30:09.276019 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395edd0f-e42d-4040-97dc-03b053ad56fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:09.278589 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395edd0f-e42d-4040-97dc-03b053ad56fe admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:09.287576 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 913/1810] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:30:09 2022] PUT /identity/v3/projects/009f165614af4f4f8a329c671c12c23d/users/5998c748f2444628883658298f42b7e0/roles/fe9379cda35c4ff78576fe48b60bea3c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:30:09.289543 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8eb563-949d-47ef-b8b5-028fe0972371 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:09.289895 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8eb563-949d-47ef-b8b5-028fe0972371 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:09.290237 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8eb563-949d-47ef-b8b5-028fe0972371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:09.304918 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 898/1811] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 03:30:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:30:09.309369 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395edd0f-e42d-4040-97dc-03b053ad56fe admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:09.325811 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395edd0f-e42d-4040-97dc-03b053ad56fe admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:09.339912 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-8f8eb563-949d-47ef-b8b5-028fe0972371 None None] MFA Rules not processed for user `5998c748f2444628883658298f42b7e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:30:09.341436 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-8f8eb563-949d-47ef-b8b5-028fe0972371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:09.420076 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a0d21-1b09-4107-b2b2-00b44d214891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:09.420696 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a0d21-1b09-4107-b2b2-00b44d214891 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:09.421084 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a0d21-1b09-4107-b2b2-00b44d214891 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:09.421365 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a0d21-1b09-4107-b2b2-00b44d214891 admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:09.422136 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8a0d21-1b09-4107-b2b2-00b44d214891 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:09.424274 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8a0d21-1b09-4107-b2b2-00b44d214891 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:09.459536 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 914/1812] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:30:09 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:30:09.466956 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8eb563-949d-47ef-b8b5-028fe0972371 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:09.470983 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 899/1813] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:30:09 2022] POST /identity/v3/projects => generated 375 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:30:09.471122 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-8f8eb563-949d-47ef-b8b5-028fe0972371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:09.472278 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a0d21-1b09-4107-b2b2-00b44d214891 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:09.554717 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8eb563-949d-47ef-b8b5-028fe0972371 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:09.574282 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a0d21-1b09-4107-b2b2-00b44d214891 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:09.575526 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:09.591273 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5aa8ca-3674-431d-a1f6-ef806c765d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:09.599846 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5aa8ca-3674-431d-a1f6-ef806c765d2f admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:09.600433 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5aa8ca-3674-431d-a1f6-ef806c765d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:09.600664 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5aa8ca-3674-431d-a1f6-ef806c765d2f admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:09.601338 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5aa8ca-3674-431d-a1f6-ef806c765d2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:09.604753 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5aa8ca-3674-431d-a1f6-ef806c765d2f admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:09.667541 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 900/1814] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:30:09 2022] POST /identity/v3/users => generated 288 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:30:09.673906 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5aa8ca-3674-431d-a1f6-ef806c765d2f admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:09.697117 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5aa8ca-3674-431d-a1f6-ef806c765d2f admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:09.711613 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbdbc5d-27ea-424b-9cd2-7b6cc35cb8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:09.712393 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbdbc5d-27ea-424b-9cd2-7b6cc35cb8c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:09.713858 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbdbc5d-27ea-424b-9cd2-7b6cc35cb8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:09.714495 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbdbc5d-27ea-424b-9cd2-7b6cc35cb8c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:09.716213 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbdbc5d-27ea-424b-9cd2-7b6cc35cb8c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:09.720592 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1896f5-d063-4261-af1f-91a79e00bbf8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f537aabf3d1040ff840b02616f839975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:09.720592 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1896f5-d063-4261-af1f-91a79e00bbf8 service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:09.721818 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1896f5-d063-4261-af1f-91a79e00bbf8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:09.722112 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1896f5-d063-4261-af1f-91a79e00bbf8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:09.724026 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbdbc5d-27ea-424b-9cd2-7b6cc35cb8c2 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:09.744231 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 901/1815] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:30:09 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:30:09.754161 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbdbc5d-27ea-424b-9cd2-7b6cc35cb8c2 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:09.790700 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbdbc5d-27ea-424b-9cd2-7b6cc35cb8c2 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:09.802637 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4b8755-cc59-4b23-8bdb-0183b58583a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:09.803341 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b8755-cc59-4b23-8bdb-0183b58583a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:09.803893 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b8755-cc59-4b23-8bdb-0183b58583a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:09.804292 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b8755-cc59-4b23-8bdb-0183b58583a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:09.805038 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4b8755-cc59-4b23-8bdb-0183b58583a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:09.806816 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4b8755-cc59-4b23-8bdb-0183b58583a2 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:09.832019 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 902/1816] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:30:09 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:30:09.833870 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4b8755-cc59-4b23-8bdb-0183b58583a2 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:09.853658 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4b8755-cc59-4b23-8bdb-0183b58583a2 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:09.858505 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebd3397-af88-47b6-9f1c-b539949099d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:09.859460 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd3397-af88-47b6-9f1c-b539949099d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:09.859844 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd3397-af88-47b6-9f1c-b539949099d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:09.860186 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd3397-af88-47b6-9f1c-b539949099d6 admin admin] PATH_INFO: `/v3/projects/0fae48b488ab440f8ba3fc955a26c1d0/users/c0191e311d6b4edaae312ec74a3eb96d/roles/04d0e4575a28440eb4349b4a6565e8b8` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:09.872495 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1896f5-d063-4261-af1f-91a79e00bbf8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:09.875375 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1896f5-d063-4261-af1f-91a79e00bbf8 service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:09.900897 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebd3397-af88-47b6-9f1c-b539949099d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fae48b488ab440f8ba3fc955a26c1d0, user_id=c0191e311d6b4edaae312ec74a3eb96d, role_id=04d0e4575a28440eb4349b4a6565e8b8)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:09.904381 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 915/1817] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:30:09 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 03:30:09.920022 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebd3397-af88-47b6-9f1c-b539949099d6 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:09.957386 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 903/1818] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:30:09 2022] PUT /identity/v3/projects/0fae48b488ab440f8ba3fc955a26c1d0/users/c0191e311d6b4edaae312ec74a3eb96d/roles/04d0e4575a28440eb4349b4a6565e8b8 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:30:09.970526 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de0617b-77d8-49fd-87d6-2f30dfee6a54 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:09.971077 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de0617b-77d8-49fd-87d6-2f30dfee6a54 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:09.971077 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de0617b-77d8-49fd-87d6-2f30dfee6a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:10.011963 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebd3397-af88-47b6-9f1c-b539949099d6 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:10.023326 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:10.046966 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-7de0617b-77d8-49fd-87d6-2f30dfee6a54 None None] MFA Rules not processed for user `c0191e311d6b4edaae312ec74a3eb96d`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:30:10.052440 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-7de0617b-77d8-49fd-87d6-2f30dfee6a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:10.130876 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebd3397-af88-47b6-9f1c-b539949099d6 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:10.141559 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b66679-0b2b-478f-8355-d753a53012eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f537aabf3d1040ff840b02616f839975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:10.142334 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b66679-0b2b-478f-8355-d753a53012eb service cinder] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:10.142624 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b66679-0b2b-478f-8355-d753a53012eb service cinder] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:10.142899 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b66679-0b2b-478f-8355-d753a53012eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:10.147074 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-07b66679-0b2b-478f-8355-d753a53012eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:10.212766 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 916/1819] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:30:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:30:10.214513 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de0617b-77d8-49fd-87d6-2f30dfee6a54 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:10.310037 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b66679-0b2b-478f-8355-d753a53012eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:10.311512 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b66679-0b2b-478f-8355-d753a53012eb service cinder] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:10.344776 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 904/1820] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:30:10 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:30:10.371856 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:10.398477 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de0617b-77d8-49fd-87d6-2f30dfee6a54 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:10.424548 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa43fc4-cdab-485e-9e34-7f76ec3515e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:10.425416 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa43fc4-cdab-485e-9e34-7f76ec3515e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:10.425532 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa43fc4-cdab-485e-9e34-7f76ec3515e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:10.425727 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa43fc4-cdab-485e-9e34-7f76ec3515e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:10.426385 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa43fc4-cdab-485e-9e34-7f76ec3515e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:10.428508 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa43fc4-cdab-485e-9e34-7f76ec3515e8 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:10.527930 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 917/1821] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:30:10 2022] POST /identity/v3/projects => generated 375 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:30:10.534008 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b66679-0b2b-478f-8355-d753a53012eb service cinder] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:10.561364 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b66679-0b2b-478f-8355-d753a53012eb service cinder] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:10.712153 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb71fd0-2d75-42af-b857-e8a76669c669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:10.712879 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb71fd0-2d75-42af-b857-e8a76669c669 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:10.713228 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb71fd0-2d75-42af-b857-e8a76669c669 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:10.713572 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb71fd0-2d75-42af-b857-e8a76669c669 admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:10.714580 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb71fd0-2d75-42af-b857-e8a76669c669 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:10.717191 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb71fd0-2d75-42af-b857-e8a76669c669 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:10.749925 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 905/1822] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:30:10 2022] POST /identity/v3/users => generated 294 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:30:10.753708 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa43fc4-cdab-485e-9e34-7f76ec3515e8 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:10.771878 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa43fc4-cdab-485e-9e34-7f76ec3515e8 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:10.788711 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabd2274-92c7-4dcd-b62b-15bd30fe06d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:10.789232 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd2274-92c7-4dcd-b62b-15bd30fe06d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:10.789669 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd2274-92c7-4dcd-b62b-15bd30fe06d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:10.789938 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd2274-92c7-4dcd-b62b-15bd30fe06d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:10.790602 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabd2274-92c7-4dcd-b62b-15bd30fe06d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:10.792421 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabd2274-92c7-4dcd-b62b-15bd30fe06d1 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:10.842810 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 918/1823] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:30:10 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:30:10.850422 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb71fd0-2d75-42af-b857-e8a76669c669 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:10.872552 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb71fd0-2d75-42af-b857-e8a76669c669 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:10.898462 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac49e63-1a5d-4f4e-91dc-4480a16d4911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:10.901385 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac49e63-1a5d-4f4e-91dc-4480a16d4911 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:10.902122 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac49e63-1a5d-4f4e-91dc-4480a16d4911 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:10.902497 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac49e63-1a5d-4f4e-91dc-4480a16d4911 admin admin] PATH_INFO: `/v3/projects/c67ddae4dc92405ab85534b91336c9d5/users/f64b73f7db8a43668ce40a5561f5e7c8/roles/fe9379cda35c4ff78576fe48b60bea3c` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:10.950141 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac49e63-1a5d-4f4e-91dc-4480a16d4911 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c67ddae4dc92405ab85534b91336c9d5, user_id=f64b73f7db8a43668ce40a5561f5e7c8, role_id=fe9379cda35c4ff78576fe48b60bea3c)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:10.957362 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac49e63-1a5d-4f4e-91dc-4480a16d4911 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:10.984290 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 906/1824] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:30:10 2022] PUT /identity/v3/projects/c67ddae4dc92405ab85534b91336c9d5/users/f64b73f7db8a43668ce40a5561f5e7c8/roles/fe9379cda35c4ff78576fe48b60bea3c => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:30:10.986327 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabd2274-92c7-4dcd-b62b-15bd30fe06d1 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:11.003191 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabd2274-92c7-4dcd-b62b-15bd30fe06d1 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:11.084054 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ba78bc-fe58-4fea-baf1-b67ac350b636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:11.084573 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba78bc-fe58-4fea-baf1-b67ac350b636 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:11.084857 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba78bc-fe58-4fea-baf1-b67ac350b636 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:11.085130 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba78bc-fe58-4fea-baf1-b67ac350b636 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:11.085777 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ba78bc-fe58-4fea-baf1-b67ac350b636 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:11.087368 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ba78bc-fe58-4fea-baf1-b67ac350b636 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:11.100121 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 919/1825] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:30:10 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:30:11.104038 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac49e63-1a5d-4f4e-91dc-4480a16d4911 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:11.117781 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac49e63-1a5d-4f4e-91dc-4480a16d4911 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:11.124104 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d990de-b173-4a12-a607-0f135e8a22da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:11.124880 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d990de-b173-4a12-a607-0f135e8a22da admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:11.125254 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d990de-b173-4a12-a607-0f135e8a22da admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:11.125596 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d990de-b173-4a12-a607-0f135e8a22da admin admin] PATH_INFO: `/v3/projects/c67ddae4dc92405ab85534b91336c9d5/users/f64b73f7db8a43668ce40a5561f5e7c8/roles/fe9379cda35c4ff78576fe48b60bea3c` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:11.127686 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d990de-b173-4a12-a607-0f135e8a22da admin admin] RBAC: Authorizing `identity:create_grant(project_id=c67ddae4dc92405ab85534b91336c9d5, user_id=f64b73f7db8a43668ce40a5561f5e7c8, role_id=fe9379cda35c4ff78576fe48b60bea3c)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:11.130699 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d990de-b173-4a12-a607-0f135e8a22da admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:11.142703 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 907/1826] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:30:11 2022] PUT /identity/v3/projects/c67ddae4dc92405ab85534b91336c9d5/users/f64b73f7db8a43668ce40a5561f5e7c8/roles/fe9379cda35c4ff78576fe48b60bea3c => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 03:30:11.154403 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe3b6f0-ee74-4b01-bfec-ed43e2abc1cf None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:11.154749 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe3b6f0-ee74-4b01-bfec-ed43e2abc1cf None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:11.154967 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe3b6f0-ee74-4b01-bfec-ed43e2abc1cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:11.188224 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-ffe3b6f0-ee74-4b01-bfec-ed43e2abc1cf None None] MFA Rules not processed for user `f64b73f7db8a43668ce40a5561f5e7c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:30:11.189477 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-ffe3b6f0-ee74-4b01-bfec-ed43e2abc1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:11.312767 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 920/1827] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:30:11 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:30:11.345703 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d990de-b173-4a12-a607-0f135e8a22da admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:11.347684 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-c7d990de-b173-4a12-a607-0f135e8a22da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:11.370739 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:11.450561 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d990de-b173-4a12-a607-0f135e8a22da admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:11.456340 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f076622c-e934-4dd7-ada9-e1ac64ce2395 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f537aabf3d1040ff840b02616f839975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:11.457085 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f076622c-e934-4dd7-ada9-e1ac64ce2395 service cinder] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:11.457726 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f076622c-e934-4dd7-ada9-e1ac64ce2395 service cinder] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:11.458060 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f076622c-e934-4dd7-ada9-e1ac64ce2395 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:11.532384 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f076622c-e934-4dd7-ada9-e1ac64ce2395 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:11.534117 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f076622c-e934-4dd7-ada9-e1ac64ce2395 service cinder] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:11.548889 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 908/1828] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:30:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:30:13.765755 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e5b7c7-b1ed-4e9a-9adb-e09a40452ba9 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:13.771681 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e5b7c7-b1ed-4e9a-9adb-e09a40452ba9 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:13.773288 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e5b7c7-b1ed-4e9a-9adb-e09a40452ba9 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:13.780950 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 921/1829] 10.222.0.25 () {54 vars in 921 bytes} [Tue Oct 4 03:30:13 2022] GET /identity => generated 270 bytes in 20 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:30:13.946001 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9c866c-b897-4823-b393-bad6b9ab60a0 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:13.946652 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9c866c-b897-4823-b393-bad6b9ab60a0 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:13.947849 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9c866c-b897-4823-b393-bad6b9ab60a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:13.994737 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-bb9c866c-b897-4823-b393-bad6b9ab60a0 None None] MFA Rules not processed for user `2c1f412befb9418fa66a2aabf475aa90`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:30:13.996081 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-bb9c866c-b897-4823-b393-bad6b9ab60a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:14.130341 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 909/1830] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Oct 4 03:30:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:30:14.172083 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e5b7c7-b1ed-4e9a-9adb-e09a40452ba9 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:14.174167 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-79e5b7c7-b1ed-4e9a-9adb-e09a40452ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:14.210218 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e5b7c7-b1ed-4e9a-9adb-e09a40452ba9 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:14.226975 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca2318-1c45-4ecc-a8f0-27e692fdf842 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1f412befb9418fa66a2aabf475aa90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:14.227699 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca2318-1c45-4ecc-a8f0-27e692fdf842 service nova] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:14.228415 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca2318-1c45-4ecc-a8f0-27e692fdf842 service nova] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:14.229102 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca2318-1c45-4ecc-a8f0-27e692fdf842 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:14.244057 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ca2318-1c45-4ecc-a8f0-27e692fdf842 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:14.246460 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ca2318-1c45-4ecc-a8f0-27e692fdf842 service nova] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:14.281509 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 922/1831] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:30:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:30:14.933134 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9bd69-ad81-47ca-a80d-95c4314dc4f7 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:14.933513 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9bd69-ad81-47ca-a80d-95c4314dc4f7 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:14.933513 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9bd69-ad81-47ca-a80d-95c4314dc4f7 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:14.935383 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 910/1832] 10.222.0.25 () {54 vars in 921 bytes} [Tue Oct 4 03:30:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:30:14.947155 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac6c62-829b-468c-a850-43025db06192 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:14.947676 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac6c62-829b-468c-a850-43025db06192 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:14.947772 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac6c62-829b-468c-a850-43025db06192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:14.996158 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-70ac6c62-829b-468c-a850-43025db06192 None None] MFA Rules not processed for user `2c1f412befb9418fa66a2aabf475aa90`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:30:14.997734 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-70ac6c62-829b-468c-a850-43025db06192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:15.023752 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a9bd69-ad81-47ca-a80d-95c4314dc4f7 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:15.026757 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 923/1833] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Oct 4 03:30:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:30:15.076867 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ac6c62-829b-468c-a850-43025db06192 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:15.118448 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:15.144789 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a9bd69-ad81-47ca-a80d-95c4314dc4f7 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:15.156004 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0d2d54-27f9-4361-a495-70e3f4accae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:15.156743 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d2d54-27f9-4361-a495-70e3f4accae2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:15.157024 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d2d54-27f9-4361-a495-70e3f4accae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:15.157294 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d2d54-27f9-4361-a495-70e3f4accae2 admin admin] PATH_INFO: `/v3/users/c0191e311d6b4edaae312ec74a3eb96d` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:15.159830 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0d2d54-27f9-4361-a495-70e3f4accae2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0191e311d6b4edaae312ec74a3eb96d)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:15.165282 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0d2d54-27f9-4361-a495-70e3f4accae2 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:15.167054 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:15.180182 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ac6c62-829b-468c-a850-43025db06192 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:15.188596 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7978dbcb-dd3e-477d-8b08-42935481986a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:15.189290 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978dbcb-dd3e-477d-8b08-42935481986a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:15.189759 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978dbcb-dd3e-477d-8b08-42935481986a admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:15.190222 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978dbcb-dd3e-477d-8b08-42935481986a admin admin] PATH_INFO: `/v3/users/33a637b66a6a4c9f831aebec7282d9a4` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:15.193528 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7978dbcb-dd3e-477d-8b08-42935481986a admin admin] RBAC: Authorizing `identity:delete_user(user_id=33a637b66a6a4c9f831aebec7282d9a4)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:15.196033 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7978dbcb-dd3e-477d-8b08-42935481986a admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:15.240042 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-cb0d2d54-27f9-4361-a495-70e3f4accae2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0191e311d6b4edaae312ec74a3eb96d'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:15.249718 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-cb0d2d54-27f9-4361-a495-70e3f4accae2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0191e311d6b4edaae312ec74a3eb96d'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:15.262424 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-cb0d2d54-27f9-4361-a495-70e3f4accae2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0191e311d6b4edaae312ec74a3eb96d'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:15.263553 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-cb0d2d54-27f9-4361-a495-70e3f4accae2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0191e311d6b4edaae312ec74a3eb96d'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:15.277364 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-7978dbcb-dd3e-477d-8b08-42935481986a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33a637b66a6a4c9f831aebec7282d9a4'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:15.278062 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-7978dbcb-dd3e-477d-8b08-42935481986a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33a637b66a6a4c9f831aebec7282d9a4'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:15.281990 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-cb0d2d54-27f9-4361-a495-70e3f4accae2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0191e311d6b4edaae312ec74a3eb96d'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:15.291402 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-7978dbcb-dd3e-477d-8b08-42935481986a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33a637b66a6a4c9f831aebec7282d9a4'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:15.292199 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 911/1834] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:30:15 2022] DELETE /identity/v3/users/c0191e311d6b4edaae312ec74a3eb96d => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 03:30:15.293129 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0d2d54-27f9-4361-a495-70e3f4accae2 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:15.294062 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-7978dbcb-dd3e-477d-8b08-42935481986a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33a637b66a6a4c9f831aebec7282d9a4'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:15.294668 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-cb0d2d54-27f9-4361-a495-70e3f4accae2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:15.319878 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-7978dbcb-dd3e-477d-8b08-42935481986a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33a637b66a6a4c9f831aebec7282d9a4'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:15.341943 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 924/1835] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:30:15 2022] DELETE /identity/v3/users/33a637b66a6a4c9f831aebec7282d9a4 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 03:30:15.344254 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c1f4b2-a0df-4394-b965-c8a8bca05862 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:15.345091 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c1f4b2-a0df-4394-b965-c8a8bca05862 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:15.345776 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c1f4b2-a0df-4394-b965-c8a8bca05862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:15.374968 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-01c1f4b2-a0df-4394-b965-c8a8bca05862 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:30:15.376700 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-01c1f4b2-a0df-4394-b965-c8a8bca05862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:15.390684 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0d2d54-27f9-4361-a495-70e3f4accae2 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:15.512408 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a974d5-61f3-435b-9b40-f580bdad4920 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1f412befb9418fa66a2aabf475aa90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:15.513036 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a974d5-61f3-435b-9b40-f580bdad4920 service nova] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:15.513318 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a974d5-61f3-435b-9b40-f580bdad4920 service nova] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:15.513601 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a974d5-61f3-435b-9b40-f580bdad4920 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:15.515992 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-c7a974d5-61f3-435b-9b40-f580bdad4920 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:15.522986 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 925/1836] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:30:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:30:15.524486 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f92f9a-88a9-48f7-b4dd-e91881325c40 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:15.524778 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f92f9a-88a9-48f7-b4dd-e91881325c40 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:15.525053 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f92f9a-88a9-48f7-b4dd-e91881325c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:15.532327 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a974d5-61f3-435b-9b40-f580bdad4920 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:15.538694 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a974d5-61f3-435b-9b40-f580bdad4920 service nova] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:15.549542 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-d5f92f9a-88a9-48f7-b4dd-e91881325c40 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:30:15.551166 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-d5f92f9a-88a9-48f7-b4dd-e91881325c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:15.555546 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 912/1837] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:30:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:30:15.556569 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a974d5-61f3-435b-9b40-f580bdad4920 service nova] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:15.558042 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-c7a974d5-61f3-435b-9b40-f580bdad4920 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:15.565248 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:15.565581 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 926/1838] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:30:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:30:15.648227 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f92f9a-88a9-48f7-b4dd-e91881325c40 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:15.649905 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a974d5-61f3-435b-9b40-f580bdad4920 service nova] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:15.663611 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f92f9a-88a9-48f7-b4dd-e91881325c40 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:15.665705 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b78474-46f7-4818-91d3-9f70065871eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:15.666342 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b78474-46f7-4818-91d3-9f70065871eb service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:15.666633 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b78474-46f7-4818-91d3-9f70065871eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:15.666913 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b78474-46f7-4818-91d3-9f70065871eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:15.671553 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4369321c-f444-42e8-a013-3ca6a0cce8c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:15.672183 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369321c-f444-42e8-a013-3ca6a0cce8c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:15.672469 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369321c-f444-42e8-a013-3ca6a0cce8c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:15.672749 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369321c-f444-42e8-a013-3ca6a0cce8c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:15.690424 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b78474-46f7-4818-91d3-9f70065871eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:15.691827 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4369321c-f444-42e8-a013-3ca6a0cce8c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:15.694455 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b78474-46f7-4818-91d3-9f70065871eb service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:15.697021 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4369321c-f444-42e8-a013-3ca6a0cce8c0 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:15.721241 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 913/1839] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:30:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:30:15.723257 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 927/1840] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:30:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 03:30:16.506466 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b78474-46f7-4818-91d3-9f70065871eb service neutron] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:16.508598 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-b6b78474-46f7-4818-91d3-9f70065871eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:16.549586 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b78474-46f7-4818-91d3-9f70065871eb service neutron] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:16.568261 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1801fa1c-38b5-4b79-bfd7-402b9111b41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:16.569090 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1801fa1c-38b5-4b79-bfd7-402b9111b41e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:16.569509 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1801fa1c-38b5-4b79-bfd7-402b9111b41e admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:16.569802 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1801fa1c-38b5-4b79-bfd7-402b9111b41e admin admin] PATH_INFO: `/v3/projects/0fae48b488ab440f8ba3fc955a26c1d0` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:16.571295 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1801fa1c-38b5-4b79-bfd7-402b9111b41e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fae48b488ab440f8ba3fc955a26c1d0)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:16.577051 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1801fa1c-38b5-4b79-bfd7-402b9111b41e admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:16.590972 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4369321c-f444-42e8-a013-3ca6a0cce8c0 service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:16.592724 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-4369321c-f444-42e8-a013-3ca6a0cce8c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:16.623548 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4369321c-f444-42e8-a013-3ca6a0cce8c0 service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:16.630749 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2878df5-6104-4c48-8613-fa6d2a2e4d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:16.631823 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2878df5-6104-4c48-8613-fa6d2a2e4d63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:16.632499 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2878df5-6104-4c48-8613-fa6d2a2e4d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:16.633055 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2878df5-6104-4c48-8613-fa6d2a2e4d63 admin admin] PATH_INFO: `/v3/projects/e8273030191644e6ac236977d0b74be9` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:16.634666 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2878df5-6104-4c48-8613-fa6d2a2e4d63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8273030191644e6ac236977d0b74be9)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:16.636969 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2878df5-6104-4c48-8613-fa6d2a2e4d63 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:16.670388 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-1801fa1c-38b5-4b79-bfd7-402b9111b41e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fae48b488ab440f8ba3fc955a26c1d0', 'request_id': 'req-1801fa1c-38b5-4b79-bfd7-402b9111b41e'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:16.677889 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-1801fa1c-38b5-4b79-bfd7-402b9111b41e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fae48b488ab440f8ba3fc955a26c1d0', 'request_id': 'req-1801fa1c-38b5-4b79-bfd7-402b9111b41e'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:16.684944 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-1801fa1c-38b5-4b79-bfd7-402b9111b41e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fae48b488ab440f8ba3fc955a26c1d0', 'request_id': 'req-1801fa1c-38b5-4b79-bfd7-402b9111b41e'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:16.704650 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-1801fa1c-38b5-4b79-bfd7-402b9111b41e admin admin] The token cache is being invalidate because project 0fae48b488ab440f8ba3fc955a26c1d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:30:16.704835 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-1801fa1c-38b5-4b79-bfd7-402b9111b41e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:16.706212 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-1801fa1c-38b5-4b79-bfd7-402b9111b41e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:16.708958 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 914/1841] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:30:16 2022] DELETE /identity/v3/projects/0fae48b488ab440f8ba3fc955a26c1d0 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:30:16.713656 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1801fa1c-38b5-4b79-bfd7-402b9111b41e admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:16.715879 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-1801fa1c-38b5-4b79-bfd7-402b9111b41e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:16.722566 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:16.758792 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-a2878df5-6104-4c48-8613-fa6d2a2e4d63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8273030191644e6ac236977d0b74be9', 'request_id': 'req-a2878df5-6104-4c48-8613-fa6d2a2e4d63'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:16.766238 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-a2878df5-6104-4c48-8613-fa6d2a2e4d63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8273030191644e6ac236977d0b74be9', 'request_id': 'req-a2878df5-6104-4c48-8613-fa6d2a2e4d63'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:16.774337 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-a2878df5-6104-4c48-8613-fa6d2a2e4d63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8273030191644e6ac236977d0b74be9', 'request_id': 'req-a2878df5-6104-4c48-8613-fa6d2a2e4d63'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:16.790027 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-a2878df5-6104-4c48-8613-fa6d2a2e4d63 admin admin] The token cache is being invalidate because project e8273030191644e6ac236977d0b74be9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:30:16.790524 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-a2878df5-6104-4c48-8613-fa6d2a2e4d63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:16.791674 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-a2878df5-6104-4c48-8613-fa6d2a2e4d63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:16.793339 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 928/1842] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:30:16 2022] DELETE /identity/v3/projects/e8273030191644e6ac236977d0b74be9 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 03:30:16.797150 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2878df5-6104-4c48-8613-fa6d2a2e4d63 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:16.798649 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-a2878df5-6104-4c48-8613-fa6d2a2e4d63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:16.829112 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1801fa1c-38b5-4b79-bfd7-402b9111b41e admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:16.872521 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:16.875880 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2878df5-6104-4c48-8613-fa6d2a2e4d63 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:16.882397 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750832b9-f0a5-4aa4-b38a-d85b778180dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:16.883076 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750832b9-f0a5-4aa4-b38a-d85b778180dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:16.883398 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750832b9-f0a5-4aa4-b38a-d85b778180dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:16.883799 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750832b9-f0a5-4aa4-b38a-d85b778180dc admin admin] PATH_INFO: `/v3/users/5998c748f2444628883658298f42b7e0` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:16.884994 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750832b9-f0a5-4aa4-b38a-d85b778180dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=5998c748f2444628883658298f42b7e0)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:16.887245 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750832b9-f0a5-4aa4-b38a-d85b778180dc admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:16.905392 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6902e1cb-1e4b-456e-897b-32ce8a0a2d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:16.906055 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6902e1cb-1e4b-456e-897b-32ce8a0a2d6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:16.906329 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6902e1cb-1e4b-456e-897b-32ce8a0a2d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:16.906652 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6902e1cb-1e4b-456e-897b-32ce8a0a2d6e admin admin] PATH_INFO: `/v3/users/f64b73f7db8a43668ce40a5561f5e7c8` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:16.907977 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6902e1cb-1e4b-456e-897b-32ce8a0a2d6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f64b73f7db8a43668ce40a5561f5e7c8)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:16.910075 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6902e1cb-1e4b-456e-897b-32ce8a0a2d6e admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:16.958534 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-750832b9-f0a5-4aa4-b38a-d85b778180dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5998c748f2444628883658298f42b7e0'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:16.959265 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-750832b9-f0a5-4aa4-b38a-d85b778180dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5998c748f2444628883658298f42b7e0'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:16.972024 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-750832b9-f0a5-4aa4-b38a-d85b778180dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5998c748f2444628883658298f42b7e0'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:16.972466 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-750832b9-f0a5-4aa4-b38a-d85b778180dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5998c748f2444628883658298f42b7e0'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:16.981944 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-6902e1cb-1e4b-456e-897b-32ce8a0a2d6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f64b73f7db8a43668ce40a5561f5e7c8'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:16.990398 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-6902e1cb-1e4b-456e-897b-32ce8a0a2d6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f64b73f7db8a43668ce40a5561f5e7c8'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:16.993052 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-750832b9-f0a5-4aa4-b38a-d85b778180dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5998c748f2444628883658298f42b7e0'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:17.000054 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-6902e1cb-1e4b-456e-897b-32ce8a0a2d6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f64b73f7db8a43668ce40a5561f5e7c8'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:17.000787 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-6902e1cb-1e4b-456e-897b-32ce8a0a2d6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f64b73f7db8a43668ce40a5561f5e7c8'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:17.009749 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 929/1843] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:30:16 2022] DELETE /identity/v3/users/5998c748f2444628883658298f42b7e0 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:30:17.024888 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-6902e1cb-1e4b-456e-897b-32ce8a0a2d6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f64b73f7db8a43668ce40a5561f5e7c8'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:17.034896 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 915/1844] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:30:16 2022] DELETE /identity/v3/users/f64b73f7db8a43668ce40a5561f5e7c8 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:30:17.661280 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750832b9-f0a5-4aa4-b38a-d85b778180dc admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:17.663411 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-750832b9-f0a5-4aa4-b38a-d85b778180dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:17.723729 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:17.768096 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6902e1cb-1e4b-456e-897b-32ce8a0a2d6e admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:17.770081 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-6902e1cb-1e4b-456e-897b-32ce8a0a2d6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:17.795573 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750832b9-f0a5-4aa4-b38a-d85b778180dc admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:17.899342 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6902e1cb-1e4b-456e-897b-32ce8a0a2d6e admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:17.904013 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3655dc45-f70b-4507-a569-27b56187cefd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:17.904778 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3655dc45-f70b-4507-a569-27b56187cefd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:17.905149 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3655dc45-f70b-4507-a569-27b56187cefd admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:17.905432 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3655dc45-f70b-4507-a569-27b56187cefd admin admin] PATH_INFO: `/v3/projects/009f165614af4f4f8a329c671c12c23d` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:17.906673 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f46deae-787f-4626-828c-ced71886d480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:17.906867 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3655dc45-f70b-4507-a569-27b56187cefd admin admin] RBAC: Authorizing `identity:delete_project(project_id=009f165614af4f4f8a329c671c12c23d)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:17.908374 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46deae-787f-4626-828c-ced71886d480 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:17.908797 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46deae-787f-4626-828c-ced71886d480 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:17.909176 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46deae-787f-4626-828c-ced71886d480 admin admin] PATH_INFO: `/v3/projects/c67ddae4dc92405ab85534b91336c9d5` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:17.909916 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3655dc45-f70b-4507-a569-27b56187cefd admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:17.911231 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f46deae-787f-4626-828c-ced71886d480 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c67ddae4dc92405ab85534b91336c9d5)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:17.913818 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f46deae-787f-4626-828c-ced71886d480 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:17.982766 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-3655dc45-f70b-4507-a569-27b56187cefd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '009f165614af4f4f8a329c671c12c23d', 'request_id': 'req-3655dc45-f70b-4507-a569-27b56187cefd'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:17.993237 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-6f46deae-787f-4626-828c-ced71886d480 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c67ddae4dc92405ab85534b91336c9d5', 'request_id': 'req-6f46deae-787f-4626-828c-ced71886d480'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:17.994247 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-3655dc45-f70b-4507-a569-27b56187cefd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '009f165614af4f4f8a329c671c12c23d', 'request_id': 'req-3655dc45-f70b-4507-a569-27b56187cefd'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:18.000032 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:18.004723 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-6f46deae-787f-4626-828c-ced71886d480 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c67ddae4dc92405ab85534b91336c9d5', 'request_id': 'req-6f46deae-787f-4626-828c-ced71886d480'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:18.005265 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-3655dc45-f70b-4507-a569-27b56187cefd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '009f165614af4f4f8a329c671c12c23d', 'request_id': 'req-3655dc45-f70b-4507-a569-27b56187cefd'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:18.015359 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-6f46deae-787f-4626-828c-ced71886d480 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c67ddae4dc92405ab85534b91336c9d5', 'request_id': 'req-6f46deae-787f-4626-828c-ced71886d480'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:18.033157 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-3655dc45-f70b-4507-a569-27b56187cefd admin admin] The token cache is being invalidate because project 009f165614af4f4f8a329c671c12c23d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:30:18.033454 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-3655dc45-f70b-4507-a569-27b56187cefd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:18.034127 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-3655dc45-f70b-4507-a569-27b56187cefd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:18.036307 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 930/1845] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:30:17 2022] DELETE /identity/v3/projects/009f165614af4f4f8a329c671c12c23d => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:30:18.041957 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2770767-b2d2-48e4-83f5-52397c07e467 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:18.042252 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2770767-b2d2-48e4-83f5-52397c07e467 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:18.042521 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2770767-b2d2-48e4-83f5-52397c07e467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:18.046343 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-6f46deae-787f-4626-828c-ced71886d480 admin admin] The token cache is being invalidate because project c67ddae4dc92405ab85534b91336c9d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:30:18.046986 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-6f46deae-787f-4626-828c-ced71886d480 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:18.047688 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-6f46deae-787f-4626-828c-ced71886d480 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:18.049376 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 916/1846] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:30:17 2022] DELETE /identity/v3/projects/c67ddae4dc92405ab85534b91336c9d5 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 03:30:18.059664 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f1523-be87-4ddb-8f0c-19ac73d1e822 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:18.060204 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f1523-be87-4ddb-8f0c-19ac73d1e822 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:18.060616 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f1523-be87-4ddb-8f0c-19ac73d1e822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:18.066442 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-a2770767-b2d2-48e4-83f5-52397c07e467 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:30:18.066442 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-a2770767-b2d2-48e4-83f5-52397c07e467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:18.087043 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-4f3f1523-be87-4ddb-8f0c-19ac73d1e822 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:30:18.088500 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-4f3f1523-be87-4ddb-8f0c-19ac73d1e822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:18.138285 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 931/1847] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:30:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 03:30:18.146682 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf520aa2-6889-40d6-8643-72d5ccffe1f2 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:18.146967 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf520aa2-6889-40d6-8643-72d5ccffe1f2 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:18.147353 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf520aa2-6889-40d6-8643-72d5ccffe1f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:18.151132 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 917/1848] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:30:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:30:18.158332 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27d2e0-a960-40cd-a036-3659d4c4483a None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:18.158622 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27d2e0-a960-40cd-a036-3659d4c4483a None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:18.158896 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27d2e0-a960-40cd-a036-3659d4c4483a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:18.172699 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-cf520aa2-6889-40d6-8643-72d5ccffe1f2 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:30:18.173911 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-cf520aa2-6889-40d6-8643-72d5ccffe1f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:18.178686 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-4f27d2e0-a960-40cd-a036-3659d4c4483a None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:30:18.179985 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-4f27d2e0-a960-40cd-a036-3659d4c4483a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:18.181941 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 932/1849] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:30:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 03:30:18.186021 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf520aa2-6889-40d6-8643-72d5ccffe1f2 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:18.188408 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 918/1850] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:30:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 03:30:18.192280 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f27d2e0-a960-40cd-a036-3659d4c4483a None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:18.192526 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:18.196742 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf520aa2-6889-40d6-8643-72d5ccffe1f2 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:18.202837 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f27d2e0-a960-40cd-a036-3659d4c4483a None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:18.203097 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6176e66f-cb83-4c29-8df2-b1386dbb1188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:18.203848 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6176e66f-cb83-4c29-8df2-b1386dbb1188 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:18.204206 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6176e66f-cb83-4c29-8df2-b1386dbb1188 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:18.204832 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6176e66f-cb83-4c29-8df2-b1386dbb1188 admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:18.205594 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6176e66f-cb83-4c29-8df2-b1386dbb1188 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:30:18.205913 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6176e66f-cb83-4c29-8df2-b1386dbb1188 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:18.208096 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52871e5b-8652-4ea2-b06f-16b920080466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:18.208248 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6176e66f-cb83-4c29-8df2-b1386dbb1188 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:18.208683 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52871e5b-8652-4ea2-b06f-16b920080466 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:18.208956 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52871e5b-8652-4ea2-b06f-16b920080466 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:18.209220 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52871e5b-8652-4ea2-b06f-16b920080466 admin admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:18.209865 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52871e5b-8652-4ea2-b06f-16b920080466 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:30:18.210160 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52871e5b-8652-4ea2-b06f-16b920080466 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:18.212213 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52871e5b-8652-4ea2-b06f-16b920080466 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:18.220456 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 933/1851] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 03:30:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:30:18.227756 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 919/1852] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 03:30:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:30:18.228419 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6176e66f-cb83-4c29-8df2-b1386dbb1188 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:18.229281 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52871e5b-8652-4ea2-b06f-16b920080466 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:18.236261 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6176e66f-cb83-4c29-8df2-b1386dbb1188 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:18.239257 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52871e5b-8652-4ea2-b06f-16b920080466 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:18.241580 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b557867-6f69-4709-8735-d083a3724973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:18.242172 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b557867-6f69-4709-8735-d083a3724973 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:18.242447 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b557867-6f69-4709-8735-d083a3724973 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:18.242726 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b557867-6f69-4709-8735-d083a3724973 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:18.243353 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b557867-6f69-4709-8735-d083a3724973 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:18.243882 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdf1567-7651-4a33-8bac-12750fc898c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:18.244461 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf1567-7651-4a33-8bac-12750fc898c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:18.244737 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf1567-7651-4a33-8bac-12750fc898c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:18.245007 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf1567-7651-4a33-8bac-12750fc898c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:18.245276 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b557867-6f69-4709-8735-d083a3724973 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:18.245622 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdf1567-7651-4a33-8bac-12750fc898c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:18.247547 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdf1567-7651-4a33-8bac-12750fc898c3 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:18.273710 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 934/1853] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:30:18 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 03:30:18.277960 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b557867-6f69-4709-8735-d083a3724973 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:18.279899 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 920/1854] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:30:18 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:30:18.283771 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdf1567-7651-4a33-8bac-12750fc898c3 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:18.346707 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b557867-6f69-4709-8735-d083a3724973 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:18.347845 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdf1567-7651-4a33-8bac-12750fc898c3 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:18.352098 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a384e63-c8e7-413b-899d-4ed2200b33da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:18.352753 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a384e63-c8e7-413b-899d-4ed2200b33da admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:18.353040 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a384e63-c8e7-413b-899d-4ed2200b33da admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:18.353318 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a384e63-c8e7-413b-899d-4ed2200b33da admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:18.353557 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952bcd76-34ab-4bfa-90d0-a30c7fdfee66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:18.354001 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a384e63-c8e7-413b-899d-4ed2200b33da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:18.354157 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952bcd76-34ab-4bfa-90d0-a30c7fdfee66 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:18.354448 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952bcd76-34ab-4bfa-90d0-a30c7fdfee66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:18.354724 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952bcd76-34ab-4bfa-90d0-a30c7fdfee66 admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:18.355350 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952bcd76-34ab-4bfa-90d0-a30c7fdfee66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:18.355953 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a384e63-c8e7-413b-899d-4ed2200b33da admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:18.357270 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952bcd76-34ab-4bfa-90d0-a30c7fdfee66 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:18.385117 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 935/1855] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:30:18 2022] POST /identity/v3/users => generated 290 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:30:18.386901 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a384e63-c8e7-413b-899d-4ed2200b33da admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:18.391559 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 921/1856] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:30:18 2022] POST /identity/v3/users => generated 288 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 03:30:18.392560 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952bcd76-34ab-4bfa-90d0-a30c7fdfee66 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:18.397867 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a384e63-c8e7-413b-899d-4ed2200b33da admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:18.402748 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952bcd76-34ab-4bfa-90d0-a30c7fdfee66 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:18.402890 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d78728-8b0d-46f7-a486-7c92d575823b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:18.403678 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d78728-8b0d-46f7-a486-7c92d575823b admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:18.403961 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d78728-8b0d-46f7-a486-7c92d575823b admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:18.404233 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d78728-8b0d-46f7-a486-7c92d575823b admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:18.404884 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d78728-8b0d-46f7-a486-7c92d575823b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:18.406598 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d78728-8b0d-46f7-a486-7c92d575823b admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:18.407925 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d3880-bf47-469b-bf32-f2818f7f2fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:18.408367 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d3880-bf47-469b-bf32-f2818f7f2fa7 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:18.408648 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d3880-bf47-469b-bf32-f2818f7f2fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:18.408919 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d3880-bf47-469b-bf32-f2818f7f2fa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:18.409568 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7d3880-bf47-469b-bf32-f2818f7f2fa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:18.411768 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7d3880-bf47-469b-bf32-f2818f7f2fa7 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:18.417352 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 936/1857] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:30:18.421270 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d78728-8b0d-46f7-a486-7c92d575823b admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:18.428927 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 922/1858] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:30:18.430155 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d3880-bf47-469b-bf32-f2818f7f2fa7 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:18.431796 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d78728-8b0d-46f7-a486-7c92d575823b admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:18.436449 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce09402b-142d-42c0-a205-3a2383f4d359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:18.437043 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce09402b-142d-42c0-a205-3a2383f4d359 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:18.437328 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce09402b-142d-42c0-a205-3a2383f4d359 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:18.437607 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce09402b-142d-42c0-a205-3a2383f4d359 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:18.438245 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce09402b-142d-42c0-a205-3a2383f4d359 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:18.439829 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d3880-bf47-469b-bf32-f2818f7f2fa7 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:18.439951 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce09402b-142d-42c0-a205-3a2383f4d359 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:18.444767 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6018c121-85db-4818-a723-558be7344db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:18.445348 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6018c121-85db-4818-a723-558be7344db6 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:18.445633 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6018c121-85db-4818-a723-558be7344db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:18.445937 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6018c121-85db-4818-a723-558be7344db6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:18.446597 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6018c121-85db-4818-a723-558be7344db6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:18.448201 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6018c121-85db-4818-a723-558be7344db6 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:18.454713 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 937/1859] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 03:30:18.455599 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce09402b-142d-42c0-a205-3a2383f4d359 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:18.460286 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 923/1860] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 03:30:18.464226 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6018c121-85db-4818-a723-558be7344db6 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:18.465506 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce09402b-142d-42c0-a205-3a2383f4d359 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:18.470573 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff6a45d-04f4-421f-89e9-c68fabf49729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:18.471226 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff6a45d-04f4-421f-89e9-c68fabf49729 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:18.471524 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff6a45d-04f4-421f-89e9-c68fabf49729 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:18.471820 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff6a45d-04f4-421f-89e9-c68fabf49729 admin admin] PATH_INFO: `/v3/projects/0e795671e4654d25a6d340b05fa22d84/users/0342f65c8fed4a96a76a774113c46d0b/roles/04d0e4575a28440eb4349b4a6565e8b8` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:18.474882 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6018c121-85db-4818-a723-558be7344db6 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:18.480118 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbba685-f03f-467c-9543-0a4277499f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:18.480762 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbba685-f03f-467c-9543-0a4277499f50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:18.481046 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbba685-f03f-467c-9543-0a4277499f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:18.481593 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbba685-f03f-467c-9543-0a4277499f50 admin admin] PATH_INFO: `/v3/projects/139c60e7c8dd4620b0f362f238f03959/users/14e11d98cd484d67a8c5e524d8764c20/roles/04d0e4575a28440eb4349b4a6565e8b8` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:18.495696 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:18.497747 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff6a45d-04f4-421f-89e9-c68fabf49729 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e795671e4654d25a6d340b05fa22d84, user_id=0342f65c8fed4a96a76a774113c46d0b, role_id=04d0e4575a28440eb4349b4a6565e8b8)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:18.499081 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbba685-f03f-467c-9543-0a4277499f50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=139c60e7c8dd4620b0f362f238f03959, user_id=14e11d98cd484d67a8c5e524d8764c20, role_id=04d0e4575a28440eb4349b4a6565e8b8)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:18.500559 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff6a45d-04f4-421f-89e9-c68fabf49729 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:18.502136 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbba685-f03f-467c-9543-0a4277499f50 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:18.516015 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 938/1861] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:30:18 2022] PUT /identity/v3/projects/0e795671e4654d25a6d340b05fa22d84/users/0342f65c8fed4a96a76a774113c46d0b/roles/04d0e4575a28440eb4349b4a6565e8b8 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:30:18.518020 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 924/1862] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:30:18 2022] PUT /identity/v3/projects/139c60e7c8dd4620b0f362f238f03959/users/14e11d98cd484d67a8c5e524d8764c20/roles/04d0e4575a28440eb4349b4a6565e8b8 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 03:30:18.528398 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c95ff19-19f6-491a-84a5-93416f966933 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:18.528771 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c95ff19-19f6-491a-84a5-93416f966933 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:18.528944 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a50ac-5462-434e-beb5-aec9d1d76289 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:18.529168 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c95ff19-19f6-491a-84a5-93416f966933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:18.529373 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a50ac-5462-434e-beb5-aec9d1d76289 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:18.529723 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a50ac-5462-434e-beb5-aec9d1d76289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:18.567038 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-4c95ff19-19f6-491a-84a5-93416f966933 None None] MFA Rules not processed for user `14e11d98cd484d67a8c5e524d8764c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:30:18.568752 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-4c95ff19-19f6-491a-84a5-93416f966933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:18.569777 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-800a50ac-5462-434e-beb5-aec9d1d76289 None None] MFA Rules not processed for user `0342f65c8fed4a96a76a774113c46d0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:30:18.571114 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-800a50ac-5462-434e-beb5-aec9d1d76289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:18.668254 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 939/1863] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:30:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 03:30:18.687094 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 925/1864] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:30:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 03:30:18.692143 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c95ff19-19f6-491a-84a5-93416f966933 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:18.694086 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800a50ac-5462-434e-beb5-aec9d1d76289 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:18.695521 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-800a50ac-5462-434e-beb5-aec9d1d76289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:18.698115 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:18.767082 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800a50ac-5462-434e-beb5-aec9d1d76289 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:18.772040 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784b0efe-f888-4cc5-ba6c-3e2a87be6b71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f537aabf3d1040ff840b02616f839975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:18.772877 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b0efe-f888-4cc5-ba6c-3e2a87be6b71 service cinder] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:18.772971 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b0efe-f888-4cc5-ba6c-3e2a87be6b71 service cinder] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:18.773207 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b0efe-f888-4cc5-ba6c-3e2a87be6b71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:18.783024 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784b0efe-f888-4cc5-ba6c-3e2a87be6b71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:18.784493 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784b0efe-f888-4cc5-ba6c-3e2a87be6b71 service cinder] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:18.796547 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 926/1865] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:30:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:30:18.882075 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c95ff19-19f6-491a-84a5-93416f966933 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:18.895778 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95ef1ed-3eb7-4d99-8999-95fe14822573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:18.899649 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ef1ed-3eb7-4d99-8999-95fe14822573 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:18.899934 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ef1ed-3eb7-4d99-8999-95fe14822573 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:18.900217 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ef1ed-3eb7-4d99-8999-95fe14822573 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:18.901472 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95ef1ed-3eb7-4d99-8999-95fe14822573 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:18.905541 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95ef1ed-3eb7-4d99-8999-95fe14822573 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:18.965810 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 940/1866] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:30:18 2022] POST /identity/v3/projects => generated 379 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:30:18.968413 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784b0efe-f888-4cc5-ba6c-3e2a87be6b71 service cinder] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:18.983932 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784b0efe-f888-4cc5-ba6c-3e2a87be6b71 service cinder] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:19.159825 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1944acb-a633-43ab-9a23-9c8cf2f6df66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:19.160368 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1944acb-a633-43ab-9a23-9c8cf2f6df66 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:19.160679 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1944acb-a633-43ab-9a23-9c8cf2f6df66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:19.162297 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1944acb-a633-43ab-9a23-9c8cf2f6df66 admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:19.163807 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1944acb-a633-43ab-9a23-9c8cf2f6df66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:19.168165 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1944acb-a633-43ab-9a23-9c8cf2f6df66 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:19.227523 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 927/1867] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:30:18 2022] POST /identity/v3/users => generated 296 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:30:19.232253 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95ef1ed-3eb7-4d99-8999-95fe14822573 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:19.260943 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95ef1ed-3eb7-4d99-8999-95fe14822573 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:19.273752 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053cc4e5-459b-4a02-8a70-960610f91a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:19.275748 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053cc4e5-459b-4a02-8a70-960610f91a07 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:19.277170 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053cc4e5-459b-4a02-8a70-960610f91a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:19.277524 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053cc4e5-459b-4a02-8a70-960610f91a07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:19.281612 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053cc4e5-459b-4a02-8a70-960610f91a07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:19.284319 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053cc4e5-459b-4a02-8a70-960610f91a07 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:19.308471 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 941/1868] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:30:19 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:30:19.313722 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1944acb-a633-43ab-9a23-9c8cf2f6df66 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:19.336537 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1944acb-a633-43ab-9a23-9c8cf2f6df66 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:19.349001 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fc183f-b807-41b7-af5b-5e4142aaa0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:19.350498 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc183f-b807-41b7-af5b-5e4142aaa0cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:19.351044 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc183f-b807-41b7-af5b-5e4142aaa0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:19.351584 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc183f-b807-41b7-af5b-5e4142aaa0cf admin admin] PATH_INFO: `/v3/projects/8e94cbbd200a443aa11408f7a6c3cbf8/users/3eb2597904ae404f93c35cbadee87ebf/roles/fe9379cda35c4ff78576fe48b60bea3c` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:19.358034 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:19.429679 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fc183f-b807-41b7-af5b-5e4142aaa0cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e94cbbd200a443aa11408f7a6c3cbf8, user_id=3eb2597904ae404f93c35cbadee87ebf, role_id=fe9379cda35c4ff78576fe48b60bea3c)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:19.438685 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fc183f-b807-41b7-af5b-5e4142aaa0cf admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:19.467251 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 928/1869] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:30:19 2022] PUT /identity/v3/projects/8e94cbbd200a443aa11408f7a6c3cbf8/users/3eb2597904ae404f93c35cbadee87ebf/roles/fe9379cda35c4ff78576fe48b60bea3c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:30:19.474463 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053cc4e5-459b-4a02-8a70-960610f91a07 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:19.491269 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053cc4e5-459b-4a02-8a70-960610f91a07 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:19.612085 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d112463-e0f3-4c90-a1bf-b0954f3957d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:19.612761 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d112463-e0f3-4c90-a1bf-b0954f3957d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:19.613043 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d112463-e0f3-4c90-a1bf-b0954f3957d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:19.613368 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d112463-e0f3-4c90-a1bf-b0954f3957d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:19.614978 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d112463-e0f3-4c90-a1bf-b0954f3957d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:19.622391 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d112463-e0f3-4c90-a1bf-b0954f3957d6 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:19.658857 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 942/1870] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:30:19 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:30:19.666703 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fc183f-b807-41b7-af5b-5e4142aaa0cf admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:19.721050 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fc183f-b807-41b7-af5b-5e4142aaa0cf admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:19.735942 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edab00e-2f66-4d1e-8b82-b56dae7dd9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:19.738473 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edab00e-2f66-4d1e-8b82-b56dae7dd9b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:19.739722 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edab00e-2f66-4d1e-8b82-b56dae7dd9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:19.740034 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edab00e-2f66-4d1e-8b82-b56dae7dd9b9 admin admin] PATH_INFO: `/v3/projects/8e94cbbd200a443aa11408f7a6c3cbf8/users/3eb2597904ae404f93c35cbadee87ebf/roles/fe9379cda35c4ff78576fe48b60bea3c` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:19.748360 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edab00e-2f66-4d1e-8b82-b56dae7dd9b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e94cbbd200a443aa11408f7a6c3cbf8, user_id=3eb2597904ae404f93c35cbadee87ebf, role_id=fe9379cda35c4ff78576fe48b60bea3c)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:19.758924 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edab00e-2f66-4d1e-8b82-b56dae7dd9b9 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:19.800493 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 929/1871] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:30:19 2022] PUT /identity/v3/projects/8e94cbbd200a443aa11408f7a6c3cbf8/users/3eb2597904ae404f93c35cbadee87ebf/roles/fe9379cda35c4ff78576fe48b60bea3c => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:30:19.803043 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ebcd86-8730-4f7f-8b46-5bbce512a299 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:19.803447 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ebcd86-8730-4f7f-8b46-5bbce512a299 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:19.803811 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ebcd86-8730-4f7f-8b46-5bbce512a299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:19.900867 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-14ebcd86-8730-4f7f-8b46-5bbce512a299 None None] MFA Rules not processed for user `3eb2597904ae404f93c35cbadee87ebf`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:30:19.902211 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-14ebcd86-8730-4f7f-8b46-5bbce512a299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:20.101592 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:20.122043 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 943/1872] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:30:19 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:30:20.130861 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edab00e-2f66-4d1e-8b82-b56dae7dd9b9 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:20.132765 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-6edab00e-2f66-4d1e-8b82-b56dae7dd9b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:20.206118 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edab00e-2f66-4d1e-8b82-b56dae7dd9b9 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:20.211227 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c4627-4e02-40b8-a503-fd3def09fbd5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f537aabf3d1040ff840b02616f839975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:20.212054 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c4627-4e02-40b8-a503-fd3def09fbd5 service cinder] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:20.212346 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c4627-4e02-40b8-a503-fd3def09fbd5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:20.212622 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c4627-4e02-40b8-a503-fd3def09fbd5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:20.228650 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875c4627-4e02-40b8-a503-fd3def09fbd5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:20.231019 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875c4627-4e02-40b8-a503-fd3def09fbd5 service cinder] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:20.251729 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 930/1873] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:30:20 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:30:21.233523 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ebcd86-8730-4f7f-8b46-5bbce512a299 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:21.235068 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-14ebcd86-8730-4f7f-8b46-5bbce512a299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:21.236507 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c4627-4e02-40b8-a503-fd3def09fbd5 service cinder] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:21.375214 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c4627-4e02-40b8-a503-fd3def09fbd5 service cinder] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:21.378547 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ebcd86-8730-4f7f-8b46-5bbce512a299 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:21.381332 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e485b111-abf6-4832-989e-5473778db335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:21.381961 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e485b111-abf6-4832-989e-5473778db335 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:21.382241 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e485b111-abf6-4832-989e-5473778db335 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:21.382511 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e485b111-abf6-4832-989e-5473778db335 admin admin] PATH_INFO: `/v3/users/0342f65c8fed4a96a76a774113c46d0b` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:21.384196 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c8ebb0-9c65-49a3-98ce-1cb6bfab6a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:21.384449 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e485b111-abf6-4832-989e-5473778db335 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0342f65c8fed4a96a76a774113c46d0b)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:21.384825 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8ebb0-9c65-49a3-98ce-1cb6bfab6a2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:21.385635 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8ebb0-9c65-49a3-98ce-1cb6bfab6a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:21.385635 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8ebb0-9c65-49a3-98ce-1cb6bfab6a2e admin admin] PATH_INFO: `/v3/users/4c7416d6e5e045468c3cfba1e20ec354` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:21.387020 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c8ebb0-9c65-49a3-98ce-1cb6bfab6a2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c7416d6e5e045468c3cfba1e20ec354)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:21.388679 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e485b111-abf6-4832-989e-5473778db335 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:21.389483 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c8ebb0-9c65-49a3-98ce-1cb6bfab6a2e admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:21.449860 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-e485b111-abf6-4832-989e-5473778db335 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0342f65c8fed4a96a76a774113c46d0b'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:21.450629 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-02c8ebb0-9c65-49a3-98ce-1cb6bfab6a2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c7416d6e5e045468c3cfba1e20ec354'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:21.451792 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-02c8ebb0-9c65-49a3-98ce-1cb6bfab6a2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c7416d6e5e045468c3cfba1e20ec354'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:21.462861 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-02c8ebb0-9c65-49a3-98ce-1cb6bfab6a2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c7416d6e5e045468c3cfba1e20ec354'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:21.463646 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-02c8ebb0-9c65-49a3-98ce-1cb6bfab6a2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c7416d6e5e045468c3cfba1e20ec354'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:21.464236 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-e485b111-abf6-4832-989e-5473778db335 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0342f65c8fed4a96a76a774113c46d0b'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:21.475853 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-e485b111-abf6-4832-989e-5473778db335 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0342f65c8fed4a96a76a774113c46d0b'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:21.476497 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-e485b111-abf6-4832-989e-5473778db335 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0342f65c8fed4a96a76a774113c46d0b'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:21.483985 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-02c8ebb0-9c65-49a3-98ce-1cb6bfab6a2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c7416d6e5e045468c3cfba1e20ec354'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:21.489230 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:21.491790 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-e485b111-abf6-4832-989e-5473778db335 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0342f65c8fed4a96a76a774113c46d0b'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:21.501245 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 931/1874] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:30:21 2022] DELETE /identity/v3/users/0342f65c8fed4a96a76a774113c46d0b => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:30:21.503478 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 944/1875] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:30:21 2022] DELETE /identity/v3/users/4c7416d6e5e045468c3cfba1e20ec354 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:30:21.507215 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c8382-36e3-44c7-8c7c-ebc6cf4a7aa9 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:21.507215 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c8382-36e3-44c7-8c7c-ebc6cf4a7aa9 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:21.507215 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c8382-36e3-44c7-8c7c-ebc6cf4a7aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:21.508874 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11867ab-dc49-424d-a36d-603be586437f None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:21.509063 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11867ab-dc49-424d-a36d-603be586437f None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:21.509488 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11867ab-dc49-424d-a36d-603be586437f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:21.529899 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-6f3c8382-36e3-44c7-8c7c-ebc6cf4a7aa9 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:30:21.531277 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-6f3c8382-36e3-44c7-8c7c-ebc6cf4a7aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:21.533741 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-a11867ab-dc49-424d-a36d-603be586437f None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:30:21.534954 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-a11867ab-dc49-424d-a36d-603be586437f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:21.602150 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 932/1876] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:30:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 03:30:21.606024 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 945/1877] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:30:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:30:21.623821 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3c8382-36e3-44c7-8c7c-ebc6cf4a7aa9 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:21.625532 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-6f3c8382-36e3-44c7-8c7c-ebc6cf4a7aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:21.626144 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11867ab-dc49-424d-a36d-603be586437f None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:21.627547 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-a11867ab-dc49-424d-a36d-603be586437f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:21.659324 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:21.719367 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11867ab-dc49-424d-a36d-603be586437f None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:21.720708 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3c8382-36e3-44c7-8c7c-ebc6cf4a7aa9 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:21.725058 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc5d8c-c679-405e-9947-b56e0b8c89ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:21.725223 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b205f863-30b8-420b-970c-961eab6c59e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:21.725329 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc5d8c-c679-405e-9947-b56e0b8c89ba service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:21.725562 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b205f863-30b8-420b-970c-961eab6c59e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:21.725670 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc5d8c-c679-405e-9947-b56e0b8c89ba service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:21.725842 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc5d8c-c679-405e-9947-b56e0b8c89ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:21.725945 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b205f863-30b8-420b-970c-961eab6c59e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:21.726115 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b205f863-30b8-420b-970c-961eab6c59e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:21.737434 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b205f863-30b8-420b-970c-961eab6c59e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:21.739900 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b205f863-30b8-420b-970c-961eab6c59e5 service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:21.741619 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbc5d8c-c679-405e-9947-b56e0b8c89ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:21.743343 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbc5d8c-c679-405e-9947-b56e0b8c89ba service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:21.751107 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 933/1878] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:30:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:30:21.757461 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 946/1879] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:30:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:30:22.352153 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b205f863-30b8-420b-970c-961eab6c59e5 service neutron] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:22.354494 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-b205f863-30b8-420b-970c-961eab6c59e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:22.370402 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc5d8c-c679-405e-9947-b56e0b8c89ba service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:22.372063 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-1cbc5d8c-c679-405e-9947-b56e0b8c89ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:22.398942 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc5d8c-c679-405e-9947-b56e0b8c89ba service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:22.403587 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b205f863-30b8-420b-970c-961eab6c59e5 service neutron] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:22.419786 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3593f8f-4f4f-4ddf-ba79-ea9140ef4cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:22.420441 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3593f8f-4f4f-4ddf-ba79-ea9140ef4cbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:22.420727 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3593f8f-4f4f-4ddf-ba79-ea9140ef4cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:22.421005 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3593f8f-4f4f-4ddf-ba79-ea9140ef4cbe admin admin] PATH_INFO: `/v3/projects/d100880a25134e3cbe298d9f83b063a6` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:22.422799 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3593f8f-4f4f-4ddf-ba79-ea9140ef4cbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=d100880a25134e3cbe298d9f83b063a6)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:22.426247 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa97656-7c24-4905-87ad-d77c327d71df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:22.427419 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa97656-7c24-4905-87ad-d77c327d71df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:22.427728 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa97656-7c24-4905-87ad-d77c327d71df admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:22.428295 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa97656-7c24-4905-87ad-d77c327d71df admin admin] PATH_INFO: `/v3/projects/0e795671e4654d25a6d340b05fa22d84` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:22.430408 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa97656-7c24-4905-87ad-d77c327d71df admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e795671e4654d25a6d340b05fa22d84)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:22.433247 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3593f8f-4f4f-4ddf-ba79-ea9140ef4cbe admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:22.435923 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa97656-7c24-4905-87ad-d77c327d71df admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:22.528696 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-8fa97656-7c24-4905-87ad-d77c327d71df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e795671e4654d25a6d340b05fa22d84', 'request_id': 'req-8fa97656-7c24-4905-87ad-d77c327d71df'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:22.534854 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-e3593f8f-4f4f-4ddf-ba79-ea9140ef4cbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd100880a25134e3cbe298d9f83b063a6', 'request_id': 'req-e3593f8f-4f4f-4ddf-ba79-ea9140ef4cbe'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:22.537099 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-8fa97656-7c24-4905-87ad-d77c327d71df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e795671e4654d25a6d340b05fa22d84', 'request_id': 'req-8fa97656-7c24-4905-87ad-d77c327d71df'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:22.543847 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-e3593f8f-4f4f-4ddf-ba79-ea9140ef4cbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd100880a25134e3cbe298d9f83b063a6', 'request_id': 'req-e3593f8f-4f4f-4ddf-ba79-ea9140ef4cbe'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:22.545307 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-8fa97656-7c24-4905-87ad-d77c327d71df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e795671e4654d25a6d340b05fa22d84', 'request_id': 'req-8fa97656-7c24-4905-87ad-d77c327d71df'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:22.554597 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-e3593f8f-4f4f-4ddf-ba79-ea9140ef4cbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd100880a25134e3cbe298d9f83b063a6', 'request_id': 'req-e3593f8f-4f4f-4ddf-ba79-ea9140ef4cbe'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:22.564985 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-8fa97656-7c24-4905-87ad-d77c327d71df admin admin] The token cache is being invalidate because project 0e795671e4654d25a6d340b05fa22d84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:30:22.566252 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-8fa97656-7c24-4905-87ad-d77c327d71df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:22.567354 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-8fa97656-7c24-4905-87ad-d77c327d71df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:22.569807 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 934/1880] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:30:22 2022] DELETE /identity/v3/projects/0e795671e4654d25a6d340b05fa22d84 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:30:22.575121 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa97656-7c24-4905-87ad-d77c327d71df admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:22.577717 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-8fa97656-7c24-4905-87ad-d77c327d71df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:22.584353 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-e3593f8f-4f4f-4ddf-ba79-ea9140ef4cbe admin admin] The token cache is being invalidate because project d100880a25134e3cbe298d9f83b063a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:30:22.584822 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-e3593f8f-4f4f-4ddf-ba79-ea9140ef4cbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:22.585527 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-e3593f8f-4f4f-4ddf-ba79-ea9140ef4cbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:22.587958 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 947/1881] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:30:22 2022] DELETE /identity/v3/projects/d100880a25134e3cbe298d9f83b063a6 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:30:22.591733 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3593f8f-4f4f-4ddf-ba79-ea9140ef4cbe admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:22.593105 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-e3593f8f-4f4f-4ddf-ba79-ea9140ef4cbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:22.613798 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:22.680032 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa97656-7c24-4905-87ad-d77c327d71df admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:22.685077 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262246f7-6aee-4f44-80e9-6284e41d2b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:22.685913 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262246f7-6aee-4f44-80e9-6284e41d2b09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:22.686026 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262246f7-6aee-4f44-80e9-6284e41d2b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:22.686248 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262246f7-6aee-4f44-80e9-6284e41d2b09 admin admin] PATH_INFO: `/v3/users/3eb2597904ae404f93c35cbadee87ebf` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:22.687825 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262246f7-6aee-4f44-80e9-6284e41d2b09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3eb2597904ae404f93c35cbadee87ebf)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:22.690183 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262246f7-6aee-4f44-80e9-6284e41d2b09 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:22.710844 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3593f8f-4f4f-4ddf-ba79-ea9140ef4cbe admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:22.722189 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671627da-f21d-4f92-8b9a-7db58b48ef95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:22.722847 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671627da-f21d-4f92-8b9a-7db58b48ef95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:22.724336 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671627da-f21d-4f92-8b9a-7db58b48ef95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:22.724672 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671627da-f21d-4f92-8b9a-7db58b48ef95 admin admin] PATH_INFO: `/v3/users/37ba2f4a66cb49f4ad9ab4c8c2cad6a3` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:22.726039 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671627da-f21d-4f92-8b9a-7db58b48ef95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37ba2f4a66cb49f4ad9ab4c8c2cad6a3)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:22.739230 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671627da-f21d-4f92-8b9a-7db58b48ef95 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:22.804551 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-262246f7-6aee-4f44-80e9-6284e41d2b09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3eb2597904ae404f93c35cbadee87ebf'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:22.827281 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-262246f7-6aee-4f44-80e9-6284e41d2b09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3eb2597904ae404f93c35cbadee87ebf'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:22.836824 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:22.839869 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-262246f7-6aee-4f44-80e9-6284e41d2b09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3eb2597904ae404f93c35cbadee87ebf'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:22.840528 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-262246f7-6aee-4f44-80e9-6284e41d2b09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3eb2597904ae404f93c35cbadee87ebf'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:22.842055 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-671627da-f21d-4f92-8b9a-7db58b48ef95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37ba2f4a66cb49f4ad9ab4c8c2cad6a3'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:22.842889 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-671627da-f21d-4f92-8b9a-7db58b48ef95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37ba2f4a66cb49f4ad9ab4c8c2cad6a3'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:22.856327 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-671627da-f21d-4f92-8b9a-7db58b48ef95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37ba2f4a66cb49f4ad9ab4c8c2cad6a3'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:22.857388 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-671627da-f21d-4f92-8b9a-7db58b48ef95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37ba2f4a66cb49f4ad9ab4c8c2cad6a3'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:22.858553 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-262246f7-6aee-4f44-80e9-6284e41d2b09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3eb2597904ae404f93c35cbadee87ebf'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:22.867545 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 935/1882] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:30:22 2022] DELETE /identity/v3/users/3eb2597904ae404f93c35cbadee87ebf => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:30:22.877801 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-671627da-f21d-4f92-8b9a-7db58b48ef95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37ba2f4a66cb49f4ad9ab4c8c2cad6a3'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:22.895344 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 948/1883] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:30:22 2022] DELETE /identity/v3/users/37ba2f4a66cb49f4ad9ab4c8c2cad6a3 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:30:23.490091 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262246f7-6aee-4f44-80e9-6284e41d2b09 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:23.492555 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-262246f7-6aee-4f44-80e9-6284e41d2b09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:23.646106 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262246f7-6aee-4f44-80e9-6284e41d2b09 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:23.752436 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:23.775364 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f5bb00-9f9e-4654-b71e-4633e54da86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:23.776784 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f5bb00-9f9e-4654-b71e-4633e54da86c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:23.777065 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f5bb00-9f9e-4654-b71e-4633e54da86c admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:23.777441 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f5bb00-9f9e-4654-b71e-4633e54da86c admin admin] PATH_INFO: `/v3/projects/31fd39fe626e4a389747c316388a5078` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:23.778844 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f5bb00-9f9e-4654-b71e-4633e54da86c admin admin] RBAC: Authorizing `identity:delete_project(project_id=31fd39fe626e4a389747c316388a5078)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:23.781020 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f5bb00-9f9e-4654-b71e-4633e54da86c admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:23.846953 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-05f5bb00-9f9e-4654-b71e-4633e54da86c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31fd39fe626e4a389747c316388a5078', 'request_id': 'req-05f5bb00-9f9e-4654-b71e-4633e54da86c'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:23.853758 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-05f5bb00-9f9e-4654-b71e-4633e54da86c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31fd39fe626e4a389747c316388a5078', 'request_id': 'req-05f5bb00-9f9e-4654-b71e-4633e54da86c'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:23.870498 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-05f5bb00-9f9e-4654-b71e-4633e54da86c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31fd39fe626e4a389747c316388a5078', 'request_id': 'req-05f5bb00-9f9e-4654-b71e-4633e54da86c'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:23.896003 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-05f5bb00-9f9e-4654-b71e-4633e54da86c admin admin] The token cache is being invalidate because project 31fd39fe626e4a389747c316388a5078 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:30:23.898459 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-05f5bb00-9f9e-4654-b71e-4633e54da86c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:23.899304 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-05f5bb00-9f9e-4654-b71e-4633e54da86c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:23.902423 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 936/1884] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:30:23 2022] DELETE /identity/v3/projects/31fd39fe626e4a389747c316388a5078 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:30:23.908055 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b8599-e8fc-403f-b38f-68535bba1ade None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:23.909170 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b8599-e8fc-403f-b38f-68535bba1ade None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:23.909918 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b8599-e8fc-403f-b38f-68535bba1ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:23.937818 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-593b8599-e8fc-403f-b38f-68535bba1ade None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:30:23.940833 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-593b8599-e8fc-403f-b38f-68535bba1ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:24.041927 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 949/1885] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:30:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:30:24.042942 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f5bb00-9f9e-4654-b71e-4633e54da86c admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:24.044971 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-05f5bb00-9f9e-4654-b71e-4633e54da86c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:24.045163 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c65b34-e209-4012-afd2-f6733e9fe621 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:24.045396 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c65b34-e209-4012-afd2-f6733e9fe621 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:24.045667 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c65b34-e209-4012-afd2-f6733e9fe621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:24.057392 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f5bb00-9f9e-4654-b71e-4633e54da86c admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:24.063163 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b33c72-bd59-4755-a560-aaac02998d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:24.063834 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b33c72-bd59-4755-a560-aaac02998d20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:24.064275 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b33c72-bd59-4755-a560-aaac02998d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:24.064560 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b33c72-bd59-4755-a560-aaac02998d20 admin admin] PATH_INFO: `/v3/projects/8e94cbbd200a443aa11408f7a6c3cbf8` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:24.070738 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b33c72-bd59-4755-a560-aaac02998d20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e94cbbd200a443aa11408f7a6c3cbf8)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:24.071660 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-f5c65b34-e209-4012-afd2-f6733e9fe621 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:30:24.073076 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-f5c65b34-e209-4012-afd2-f6733e9fe621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:24.078102 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b33c72-bd59-4755-a560-aaac02998d20 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:24.083525 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 950/1886] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:30:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:30:24.088123 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c65b34-e209-4012-afd2-f6733e9fe621 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:24.100161 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c65b34-e209-4012-afd2-f6733e9fe621 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:24.107993 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9972f8c-97d9-40fc-bdce-bdea98145c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:24.108781 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9972f8c-97d9-40fc-bdce-bdea98145c5d admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:24.109668 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9972f8c-97d9-40fc-bdce-bdea98145c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:24.109962 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9972f8c-97d9-40fc-bdce-bdea98145c5d admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:24.110621 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9972f8c-97d9-40fc-bdce-bdea98145c5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:30:24.111016 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9972f8c-97d9-40fc-bdce-bdea98145c5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:24.112543 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9972f8c-97d9-40fc-bdce-bdea98145c5d admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:24.127652 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 951/1887] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 03:30:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:30:24.132656 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9972f8c-97d9-40fc-bdce-bdea98145c5d admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:24.144849 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-93b33c72-bd59-4755-a560-aaac02998d20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e94cbbd200a443aa11408f7a6c3cbf8', 'request_id': 'req-93b33c72-bd59-4755-a560-aaac02998d20'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:24.145744 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9972f8c-97d9-40fc-bdce-bdea98145c5d admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:24.155260 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-93b33c72-bd59-4755-a560-aaac02998d20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e94cbbd200a443aa11408f7a6c3cbf8', 'request_id': 'req-93b33c72-bd59-4755-a560-aaac02998d20'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:24.168266 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-93b33c72-bd59-4755-a560-aaac02998d20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e94cbbd200a443aa11408f7a6c3cbf8', 'request_id': 'req-93b33c72-bd59-4755-a560-aaac02998d20'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:24.184926 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-93b33c72-bd59-4755-a560-aaac02998d20 admin admin] The token cache is being invalidate because project 8e94cbbd200a443aa11408f7a6c3cbf8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:30:24.185229 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-93b33c72-bd59-4755-a560-aaac02998d20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:24.185901 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-93b33c72-bd59-4755-a560-aaac02998d20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:24.191324 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 937/1888] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:30:24 2022] DELETE /identity/v3/projects/8e94cbbd200a443aa11408f7a6c3cbf8 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:30:24.196831 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0243c3-656f-4c5b-8f44-dcbdf370ac4f None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:24.197822 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0243c3-656f-4c5b-8f44-dcbdf370ac4f None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:24.198418 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0243c3-656f-4c5b-8f44-dcbdf370ac4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:24.228192 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-ea0243c3-656f-4c5b-8f44-dcbdf370ac4f None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:30:24.229690 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-ea0243c3-656f-4c5b-8f44-dcbdf370ac4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:24.237585 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae6bf17-42d2-4371-a2eb-81f237e495dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:24.238411 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae6bf17-42d2-4371-a2eb-81f237e495dc admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:24.240328 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae6bf17-42d2-4371-a2eb-81f237e495dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:24.240629 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae6bf17-42d2-4371-a2eb-81f237e495dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:24.241722 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae6bf17-42d2-4371-a2eb-81f237e495dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:24.243670 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae6bf17-42d2-4371-a2eb-81f237e495dc admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:24.279573 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 952/1889] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:30:24 2022] POST /identity/v3/projects => generated 367 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 03:30:24.283395 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae6bf17-42d2-4371-a2eb-81f237e495dc admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:24.285312 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-7ae6bf17-42d2-4371-a2eb-81f237e495dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:24.298068 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:24.327253 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:24.328022 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 938/1890] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:30:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:30:24.331357 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268daa0-d39f-4d1a-a8fb-c564c9c4b560 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:24.331869 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268daa0-d39f-4d1a-a8fb-c564c9c4b560 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:24.332830 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268daa0-d39f-4d1a-a8fb-c564c9c4b560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:24.358104 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-d268daa0-d39f-4d1a-a8fb-c564c9c4b560 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:30:24.359444 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-d268daa0-d39f-4d1a-a8fb-c564c9c4b560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:24.369368 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 939/1891] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:30:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:30:24.372280 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae6bf17-42d2-4371-a2eb-81f237e495dc admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:24.373493 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d268daa0-d39f-4d1a-a8fb-c564c9c4b560 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:24.377590 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56860f79-b055-4105-9bdb-8afd2f15fa63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:24.378314 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56860f79-b055-4105-9bdb-8afd2f15fa63 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:24.378673 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56860f79-b055-4105-9bdb-8afd2f15fa63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:24.379023 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56860f79-b055-4105-9bdb-8afd2f15fa63 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:24.380451 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56860f79-b055-4105-9bdb-8afd2f15fa63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:24.382553 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56860f79-b055-4105-9bdb-8afd2f15fa63 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:24.386838 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d268daa0-d39f-4d1a-a8fb-c564c9c4b560 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:24.397588 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e5d6f7-f82b-475e-8cbc-66ada8a51f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:24.397588 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e5d6f7-f82b-475e-8cbc-66ada8a51f88 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:24.397588 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e5d6f7-f82b-475e-8cbc-66ada8a51f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:24.397966 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e5d6f7-f82b-475e-8cbc-66ada8a51f88 admin admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:24.398583 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e5d6f7-f82b-475e-8cbc-66ada8a51f88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:30:24.398944 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e5d6f7-f82b-475e-8cbc-66ada8a51f88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:24.400684 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e5d6f7-f82b-475e-8cbc-66ada8a51f88 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:24.411916 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 953/1892] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:30:24 2022] POST /identity/v3/users => generated 284 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:30:24.413116 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56860f79-b055-4105-9bdb-8afd2f15fa63 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:24.420041 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 940/1893] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 03:30:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:30:24.423466 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e5d6f7-f82b-475e-8cbc-66ada8a51f88 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:24.424107 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56860f79-b055-4105-9bdb-8afd2f15fa63 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:24.431074 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a9b77c-c294-42a1-8b06-7b1e67f3479f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:24.431605 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a9b77c-c294-42a1-8b06-7b1e67f3479f admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:24.432162 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a9b77c-c294-42a1-8b06-7b1e67f3479f admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:24.432448 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a9b77c-c294-42a1-8b06-7b1e67f3479f admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:24.433353 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a9b77c-c294-42a1-8b06-7b1e67f3479f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:24.434839 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e5d6f7-f82b-475e-8cbc-66ada8a51f88 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:24.435800 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a9b77c-c294-42a1-8b06-7b1e67f3479f admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:24.441174 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6f2a77-d1bc-402d-a46f-02a1ef6d66ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:24.442499 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f2a77-d1bc-402d-a46f-02a1ef6d66ba admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:24.443079 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f2a77-d1bc-402d-a46f-02a1ef6d66ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:24.443348 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f2a77-d1bc-402d-a46f-02a1ef6d66ba admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:24.444021 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6f2a77-d1bc-402d-a46f-02a1ef6d66ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:24.447166 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6f2a77-d1bc-402d-a46f-02a1ef6d66ba admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:24.450975 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 954/1894] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:30:24 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:30:24.480702 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a9b77c-c294-42a1-8b06-7b1e67f3479f admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:24.508219 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 941/1895] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:30:24 2022] POST /identity/v3/projects => generated 383 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 03:30:24.508686 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a9b77c-c294-42a1-8b06-7b1e67f3479f admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:24.512193 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6f2a77-d1bc-402d-a46f-02a1ef6d66ba admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:24.588922 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cff19f-4891-44f4-a034-d237b86ee906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:24.589646 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cff19f-4891-44f4-a034-d237b86ee906 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:24.590077 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cff19f-4891-44f4-a034-d237b86ee906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:24.590454 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cff19f-4891-44f4-a034-d237b86ee906 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:24.591181 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cff19f-4891-44f4-a034-d237b86ee906 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:24.592902 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cff19f-4891-44f4-a034-d237b86ee906 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:24.610303 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 955/1896] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:30:24 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:30:24.610922 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6f2a77-d1bc-402d-a46f-02a1ef6d66ba admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:24.616046 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cff19f-4891-44f4-a034-d237b86ee906 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:24.618213 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e44210-76b0-425b-81d7-4fd1d55c7b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:24.618213 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e44210-76b0-425b-81d7-4fd1d55c7b5a admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:24.618445 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e44210-76b0-425b-81d7-4fd1d55c7b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:24.618592 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e44210-76b0-425b-81d7-4fd1d55c7b5a admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:24.619209 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e44210-76b0-425b-81d7-4fd1d55c7b5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:24.621350 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e44210-76b0-425b-81d7-4fd1d55c7b5a admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:24.632417 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cff19f-4891-44f4-a034-d237b86ee906 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:24.649870 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b11b34-5d7d-4c7f-8446-d4dc56918ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:24.650923 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b11b34-5d7d-4c7f-8446-d4dc56918ba1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:24.651387 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b11b34-5d7d-4c7f-8446-d4dc56918ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:24.651688 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b11b34-5d7d-4c7f-8446-d4dc56918ba1 admin admin] PATH_INFO: `/v3/projects/be542984d8d14203a6f682c834312505/users/41c06b4182904d34a251d3c96548b97a/roles/04d0e4575a28440eb4349b4a6565e8b8` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:24.678480 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 942/1897] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:30:24 2022] POST /identity/v3/users => generated 292 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:30:24.679848 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e44210-76b0-425b-81d7-4fd1d55c7b5a admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:24.682416 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b11b34-5d7d-4c7f-8446-d4dc56918ba1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be542984d8d14203a6f682c834312505, user_id=41c06b4182904d34a251d3c96548b97a, role_id=04d0e4575a28440eb4349b4a6565e8b8)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:24.685118 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b11b34-5d7d-4c7f-8446-d4dc56918ba1 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:24.691914 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e44210-76b0-425b-81d7-4fd1d55c7b5a admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:24.697412 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3578b3e-e62a-4fee-8c7b-3c316de35cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:24.698017 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3578b3e-e62a-4fee-8c7b-3c316de35cd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:24.698306 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3578b3e-e62a-4fee-8c7b-3c316de35cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:24.698580 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3578b3e-e62a-4fee-8c7b-3c316de35cd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:24.699229 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3578b3e-e62a-4fee-8c7b-3c316de35cd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:24.700835 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3578b3e-e62a-4fee-8c7b-3c316de35cd5 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:24.714806 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 956/1898] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:30:24 2022] PUT /identity/v3/projects/be542984d8d14203a6f682c834312505/users/41c06b4182904d34a251d3c96548b97a/roles/04d0e4575a28440eb4349b4a6565e8b8 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:30:24.727548 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 943/1899] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:30:24 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:30:24.727761 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737dab3-7ce9-43d6-ae4e-e6985ed04934 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:24.727761 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737dab3-7ce9-43d6-ae4e-e6985ed04934 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:24.727761 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737dab3-7ce9-43d6-ae4e-e6985ed04934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:24.729347 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3578b3e-e62a-4fee-8c7b-3c316de35cd5 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:24.751099 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3578b3e-e62a-4fee-8c7b-3c316de35cd5 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:24.770622 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-1737dab3-7ce9-43d6-ae4e-e6985ed04934 None None] MFA Rules not processed for user `41c06b4182904d34a251d3c96548b97a`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:30:24.772174 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-1737dab3-7ce9-43d6-ae4e-e6985ed04934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:24.861211 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 957/1900] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:30:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:30:24.862821 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1737dab3-7ce9-43d6-ae4e-e6985ed04934 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:24.893509 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:24.903954 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab69d6b-564d-4d62-bb60-c9218eb0da4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:24.904960 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab69d6b-564d-4d62-bb60-c9218eb0da4a admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:24.905574 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab69d6b-564d-4d62-bb60-c9218eb0da4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:24.906046 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab69d6b-564d-4d62-bb60-c9218eb0da4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:24.907450 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab69d6b-564d-4d62-bb60-c9218eb0da4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:24.909492 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab69d6b-564d-4d62-bb60-c9218eb0da4a admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:24.928455 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 944/1901] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:30:24 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:30:24.946883 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab69d6b-564d-4d62-bb60-c9218eb0da4a admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:24.967647 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab69d6b-564d-4d62-bb60-c9218eb0da4a admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:24.977927 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfdc43b-9c1e-4909-b179-df2c88b188c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:24.979010 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfdc43b-9c1e-4909-b179-df2c88b188c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:24.979303 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfdc43b-9c1e-4909-b179-df2c88b188c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:24.979615 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfdc43b-9c1e-4909-b179-df2c88b188c7 admin admin] PATH_INFO: `/v3/projects/5f8a981e9ca34184b4abfdfc1cc6071f/users/db70192350c44abca1b9c4c59c1d548c/roles/04d0e4575a28440eb4349b4a6565e8b8` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:25.016764 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfdc43b-9c1e-4909-b179-df2c88b188c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f8a981e9ca34184b4abfdfc1cc6071f, user_id=db70192350c44abca1b9c4c59c1d548c, role_id=04d0e4575a28440eb4349b4a6565e8b8)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:25.023835 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfdc43b-9c1e-4909-b179-df2c88b188c7 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:25.028664 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1737dab3-7ce9-43d6-ae4e-e6985ed04934 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:25.034822 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a005253-57ba-47db-9b5e-0e8c86d2d63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:25.036290 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a005253-57ba-47db-9b5e-0e8c86d2d63b admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:25.036990 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a005253-57ba-47db-9b5e-0e8c86d2d63b admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:25.037887 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a005253-57ba-47db-9b5e-0e8c86d2d63b admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:25.040117 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a005253-57ba-47db-9b5e-0e8c86d2d63b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:25.042787 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 945/1902] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:30:24 2022] PUT /identity/v3/projects/5f8a981e9ca34184b4abfdfc1cc6071f/users/db70192350c44abca1b9c4c59c1d548c/roles/04d0e4575a28440eb4349b4a6565e8b8 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:30:25.043407 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a005253-57ba-47db-9b5e-0e8c86d2d63b admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:25.053786 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b4ebf6-00f7-481e-8fdb-cf36f44896dd None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:25.056855 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b4ebf6-00f7-481e-8fdb-cf36f44896dd None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:25.057149 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b4ebf6-00f7-481e-8fdb-cf36f44896dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:25.093534 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 958/1903] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:30:24 2022] POST /identity/v3/projects => generated 369 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:30:25.097678 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a005253-57ba-47db-9b5e-0e8c86d2d63b admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:25.111305 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:25.133929 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-03b4ebf6-00f7-481e-8fdb-cf36f44896dd None None] MFA Rules not processed for user `db70192350c44abca1b9c4c59c1d548c`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:30:25.135306 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-03b4ebf6-00f7-481e-8fdb-cf36f44896dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:25.207346 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a005253-57ba-47db-9b5e-0e8c86d2d63b admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:25.220882 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a436b64-977b-4c74-aba4-11831133518f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:25.222680 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a436b64-977b-4c74-aba4-11831133518f admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:25.223960 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a436b64-977b-4c74-aba4-11831133518f admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:25.224246 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a436b64-977b-4c74-aba4-11831133518f admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:25.225467 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a436b64-977b-4c74-aba4-11831133518f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:25.245530 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a436b64-977b-4c74-aba4-11831133518f admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:25.304290 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 946/1904] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:30:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 03:30:25.308721 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b4ebf6-00f7-481e-8fdb-cf36f44896dd None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:25.312433 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 959/1905] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:30:25 2022] POST /identity/v3/users => generated 291 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 03:30:25.320382 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a436b64-977b-4c74-aba4-11831133518f admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:25.342775 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b4ebf6-00f7-481e-8fdb-cf36f44896dd None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:25.359767 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a436b64-977b-4c74-aba4-11831133518f admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:25.381291 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082855b4-a430-4962-bf3c-42f53a95a719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:25.381930 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082855b4-a430-4962-bf3c-42f53a95a719 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:25.382217 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082855b4-a430-4962-bf3c-42f53a95a719 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:25.382498 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082855b4-a430-4962-bf3c-42f53a95a719 admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:25.383091 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbe0b1b-af1b-4b86-8c92-75d1b5b27ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:25.383240 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082855b4-a430-4962-bf3c-42f53a95a719 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:25.383944 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe0b1b-af1b-4b86-8c92-75d1b5b27ce1 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:25.384358 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe0b1b-af1b-4b86-8c92-75d1b5b27ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:25.385305 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe0b1b-af1b-4b86-8c92-75d1b5b27ce1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:25.386112 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbe0b1b-af1b-4b86-8c92-75d1b5b27ce1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:25.386248 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082855b4-a430-4962-bf3c-42f53a95a719 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:25.387971 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbe0b1b-af1b-4b86-8c92-75d1b5b27ce1 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:25.414034 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 960/1906] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:30:25 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 03:30:25.414972 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbe0b1b-af1b-4b86-8c92-75d1b5b27ce1 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:25.426819 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbe0b1b-af1b-4b86-8c92-75d1b5b27ce1 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:25.433385 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011f7cd8-4266-4c5a-815e-fe9bf0c7cd0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:25.434496 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f7cd8-4266-4c5a-815e-fe9bf0c7cd0e admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:25.434860 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f7cd8-4266-4c5a-815e-fe9bf0c7cd0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:25.435228 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f7cd8-4266-4c5a-815e-fe9bf0c7cd0e admin admin] PATH_INFO: `/v3/projects/75468d61fc964503b879607b11b6ac6a/users/0e7bd0bb6a624b5680caa9efc899ed93/roles/fe9379cda35c4ff78576fe48b60bea3c` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:25.458631 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011f7cd8-4266-4c5a-815e-fe9bf0c7cd0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=75468d61fc964503b879607b11b6ac6a, user_id=0e7bd0bb6a624b5680caa9efc899ed93, role_id=fe9379cda35c4ff78576fe48b60bea3c)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:25.461793 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011f7cd8-4266-4c5a-815e-fe9bf0c7cd0e admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:25.501551 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 961/1907] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:30:25 2022] PUT /identity/v3/projects/75468d61fc964503b879607b11b6ac6a/users/0e7bd0bb6a624b5680caa9efc899ed93/roles/fe9379cda35c4ff78576fe48b60bea3c => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:30:25.501783 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 947/1908] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:30:25 2022] POST /identity/v3/projects => generated 381 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:30:25.503711 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011f7cd8-4266-4c5a-815e-fe9bf0c7cd0e admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:25.507580 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082855b4-a430-4962-bf3c-42f53a95a719 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:25.620000 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:25.642636 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011f7cd8-4266-4c5a-815e-fe9bf0c7cd0e admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:25.652207 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45f39fd-d3d0-48f1-9c7e-0fd4921dc7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:25.653043 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f39fd-d3d0-48f1-9c7e-0fd4921dc7f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:25.653393 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f39fd-d3d0-48f1-9c7e-0fd4921dc7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:25.653637 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082855b4-a430-4962-bf3c-42f53a95a719 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:25.654097 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f39fd-d3d0-48f1-9c7e-0fd4921dc7f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:25.654530 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45f39fd-d3d0-48f1-9c7e-0fd4921dc7f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:25.656507 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45f39fd-d3d0-48f1-9c7e-0fd4921dc7f2 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:25.660065 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb07edf3-da55-42c8-a29d-a90751850613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:25.662319 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb07edf3-da55-42c8-a29d-a90751850613 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:25.662923 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb07edf3-da55-42c8-a29d-a90751850613 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:25.663372 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb07edf3-da55-42c8-a29d-a90751850613 admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:25.664469 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb07edf3-da55-42c8-a29d-a90751850613 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:25.666889 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb07edf3-da55-42c8-a29d-a90751850613 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:25.674922 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 962/1909] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:30:25 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:30:25.677503 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45f39fd-d3d0-48f1-9c7e-0fd4921dc7f2 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:25.688896 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45f39fd-d3d0-48f1-9c7e-0fd4921dc7f2 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:25.695821 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80385e5-1b4b-4d54-960e-b5408b3ccba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:25.696887 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80385e5-1b4b-4d54-960e-b5408b3ccba6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:25.700201 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80385e5-1b4b-4d54-960e-b5408b3ccba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:25.700320 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 948/1910] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:30:25 2022] POST /identity/v3/users => generated 297 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 03:30:25.700412 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80385e5-1b4b-4d54-960e-b5408b3ccba6 admin admin] PATH_INFO: `/v3/projects/75468d61fc964503b879607b11b6ac6a/users/0e7bd0bb6a624b5680caa9efc899ed93/roles/fe9379cda35c4ff78576fe48b60bea3c` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:25.701044 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb07edf3-da55-42c8-a29d-a90751850613 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:25.701478 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80385e5-1b4b-4d54-960e-b5408b3ccba6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75468d61fc964503b879607b11b6ac6a, user_id=0e7bd0bb6a624b5680caa9efc899ed93, role_id=fe9379cda35c4ff78576fe48b60bea3c)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:25.704434 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80385e5-1b4b-4d54-960e-b5408b3ccba6 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:25.712154 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb07edf3-da55-42c8-a29d-a90751850613 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:25.721465 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 963/1911] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:30:25 2022] PUT /identity/v3/projects/75468d61fc964503b879607b11b6ac6a/users/0e7bd0bb6a624b5680caa9efc899ed93/roles/fe9379cda35c4ff78576fe48b60bea3c => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:30:25.734369 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f450c5b-8eee-4ec9-8ad0-d4aef1c0844d None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:25.734660 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f450c5b-8eee-4ec9-8ad0-d4aef1c0844d None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:25.734938 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f450c5b-8eee-4ec9-8ad0-d4aef1c0844d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:25.766468 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-3f450c5b-8eee-4ec9-8ad0-d4aef1c0844d None None] MFA Rules not processed for user `0e7bd0bb6a624b5680caa9efc899ed93`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:30:25.768119 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-3f450c5b-8eee-4ec9-8ad0-d4aef1c0844d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:25.807543 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8b64e8-aaf0-4918-9a3a-3925bcbe408d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:25.808146 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b64e8-aaf0-4918-9a3a-3925bcbe408d admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:25.808427 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b64e8-aaf0-4918-9a3a-3925bcbe408d admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:25.809871 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b64e8-aaf0-4918-9a3a-3925bcbe408d admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:25.810535 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8b64e8-aaf0-4918-9a3a-3925bcbe408d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:25.812195 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8b64e8-aaf0-4918-9a3a-3925bcbe408d admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:25.832743 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 949/1912] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:30:25 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 03:30:25.836581 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8b64e8-aaf0-4918-9a3a-3925bcbe408d admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:25.842586 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:25.851628 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8b64e8-aaf0-4918-9a3a-3925bcbe408d admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:25.859165 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a8ff73-7b03-46ea-936e-6d13217841a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:25.860071 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8ff73-7b03-46ea-936e-6d13217841a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:25.860617 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8ff73-7b03-46ea-936e-6d13217841a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:25.861015 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8ff73-7b03-46ea-936e-6d13217841a0 admin admin] PATH_INFO: `/v3/projects/fd8d231d2ebb488badf631f0d199a675/users/48e085a9e93e495c8679541af04df04d/roles/fe9379cda35c4ff78576fe48b60bea3c` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:25.880443 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 964/1913] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:30:25 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:30:25.888723 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a8ff73-7b03-46ea-936e-6d13217841a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd8d231d2ebb488badf631f0d199a675, user_id=48e085a9e93e495c8679541af04df04d, role_id=fe9379cda35c4ff78576fe48b60bea3c)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:25.892448 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a8ff73-7b03-46ea-936e-6d13217841a0 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:25.896874 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f450c5b-8eee-4ec9-8ad0-d4aef1c0844d None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:25.898630 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-3f450c5b-8eee-4ec9-8ad0-d4aef1c0844d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:25.915882 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 950/1914] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:30:25 2022] PUT /identity/v3/projects/fd8d231d2ebb488badf631f0d199a675/users/48e085a9e93e495c8679541af04df04d/roles/fe9379cda35c4ff78576fe48b60bea3c => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:30:25.919861 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a8ff73-7b03-46ea-936e-6d13217841a0 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:25.993752 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f450c5b-8eee-4ec9-8ad0-d4aef1c0844d None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:26.012001 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a8ff73-7b03-46ea-936e-6d13217841a0 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:26.017831 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a90d132-99ca-40aa-99ed-b8ee69f59efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:26.018786 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90d132-99ca-40aa-99ed-b8ee69f59efa admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:26.019172 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90d132-99ca-40aa-99ed-b8ee69f59efa admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:26.019571 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90d132-99ca-40aa-99ed-b8ee69f59efa admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:26.020929 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a90d132-99ca-40aa-99ed-b8ee69f59efa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:26.022732 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a90d132-99ca-40aa-99ed-b8ee69f59efa admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:26.050113 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 951/1915] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:30:25 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:30:26.056811 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a90d132-99ca-40aa-99ed-b8ee69f59efa admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:26.075789 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce5f8b2-6040-478c-acaf-cd6350105e6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f537aabf3d1040ff840b02616f839975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:26.076797 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce5f8b2-6040-478c-acaf-cd6350105e6f service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:26.077174 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce5f8b2-6040-478c-acaf-cd6350105e6f service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:26.077576 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce5f8b2-6040-478c-acaf-cd6350105e6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:26.094372 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a90d132-99ca-40aa-99ed-b8ee69f59efa admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:26.107503 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9037830b-6a53-4e8b-a902-6eade6c1bfd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:26.111878 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9037830b-6a53-4e8b-a902-6eade6c1bfd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:26.112275 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9037830b-6a53-4e8b-a902-6eade6c1bfd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:26.112651 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9037830b-6a53-4e8b-a902-6eade6c1bfd1 admin admin] PATH_INFO: `/v3/projects/fd8d231d2ebb488badf631f0d199a675/users/48e085a9e93e495c8679541af04df04d/roles/fe9379cda35c4ff78576fe48b60bea3c` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:26.121660 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9037830b-6a53-4e8b-a902-6eade6c1bfd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd8d231d2ebb488badf631f0d199a675, user_id=48e085a9e93e495c8679541af04df04d, role_id=fe9379cda35c4ff78576fe48b60bea3c)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:26.125739 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9037830b-6a53-4e8b-a902-6eade6c1bfd1 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:26.131621 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:26.143738 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 952/1916] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:30:26 2022] PUT /identity/v3/projects/fd8d231d2ebb488badf631f0d199a675/users/48e085a9e93e495c8679541af04df04d/roles/fe9379cda35c4ff78576fe48b60bea3c => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 03:30:26.154318 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e267e-d438-4214-a362-4d5b2af4ba7e None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:26.154611 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e267e-d438-4214-a362-4d5b2af4ba7e None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:26.154891 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e267e-d438-4214-a362-4d5b2af4ba7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:26.198294 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce5f8b2-6040-478c-acaf-cd6350105e6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:26.200648 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce5f8b2-6040-478c-acaf-cd6350105e6f service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:26.213673 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 965/1917] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:30:25 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 03:30:26.236154 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-162e267e-d438-4214-a362-4d5b2af4ba7e None None] MFA Rules not processed for user `48e085a9e93e495c8679541af04df04d`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:30:26.237392 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-162e267e-d438-4214-a362-4d5b2af4ba7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:26.387831 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 953/1918] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:30:26 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 03:30:26.392490 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce5f8b2-6040-478c-acaf-cd6350105e6f service cinder] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:26.418557 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce5f8b2-6040-478c-acaf-cd6350105e6f service cinder] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:26.527886 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169af633-0b5a-4fc6-b94e-72cd67de17ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f537aabf3d1040ff840b02616f839975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:26.531681 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169af633-0b5a-4fc6-b94e-72cd67de17ea service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:26.532144 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169af633-0b5a-4fc6-b94e-72cd67de17ea service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:26.532574 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169af633-0b5a-4fc6-b94e-72cd67de17ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:26.548547 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169af633-0b5a-4fc6-b94e-72cd67de17ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:26.550762 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169af633-0b5a-4fc6-b94e-72cd67de17ea service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:26.575469 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 966/1919] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:30:26 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:30:26.871230 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e267e-d438-4214-a362-4d5b2af4ba7e None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:26.884616 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e267e-d438-4214-a362-4d5b2af4ba7e None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:26.892525 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ba8bb3-5026-429e-ae67-d79b31c5555d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f537aabf3d1040ff840b02616f839975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:26.893661 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba8bb3-5026-429e-ae67-d79b31c5555d service cinder] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:26.893661 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba8bb3-5026-429e-ae67-d79b31c5555d service cinder] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:26.893847 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba8bb3-5026-429e-ae67-d79b31c5555d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:26.987187 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:27.024393 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ba8bb3-5026-429e-ae67-d79b31c5555d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:27.026287 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ba8bb3-5026-429e-ae67-d79b31c5555d service cinder] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:27.056990 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 954/1920] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:30:26 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:30:27.419625 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169af633-0b5a-4fc6-b94e-72cd67de17ea service cinder] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:27.517051 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169af633-0b5a-4fc6-b94e-72cd67de17ea service cinder] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:27.526307 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35c9bf0-ef6b-415b-9cf4-0498019f489d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:27.527094 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c9bf0-ef6b-415b-9cf4-0498019f489d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:27.527355 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c9bf0-ef6b-415b-9cf4-0498019f489d admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:27.527690 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c9bf0-ef6b-415b-9cf4-0498019f489d admin admin] PATH_INFO: `/v3/users/db70192350c44abca1b9c4c59c1d548c` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:27.531042 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35c9bf0-ef6b-415b-9cf4-0498019f489d admin admin] RBAC: Authorizing `identity:delete_user(user_id=db70192350c44abca1b9c4c59c1d548c)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:27.533485 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35c9bf0-ef6b-415b-9cf4-0498019f489d admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:27.659123 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-b35c9bf0-ef6b-415b-9cf4-0498019f489d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db70192350c44abca1b9c4c59c1d548c'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:27.660622 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-b35c9bf0-ef6b-415b-9cf4-0498019f489d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db70192350c44abca1b9c4c59c1d548c'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:27.674501 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-b35c9bf0-ef6b-415b-9cf4-0498019f489d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db70192350c44abca1b9c4c59c1d548c'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:27.675241 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-b35c9bf0-ef6b-415b-9cf4-0498019f489d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db70192350c44abca1b9c4c59c1d548c'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:27.705477 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:27.707005 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-b35c9bf0-ef6b-415b-9cf4-0498019f489d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db70192350c44abca1b9c4c59c1d548c'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:27.733066 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 967/1921] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:30:27 2022] DELETE /identity/v3/users/db70192350c44abca1b9c4c59c1d548c => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:30:27.738043 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd232765-506a-41eb-ae93-4084075f569b None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:27.738294 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd232765-506a-41eb-ae93-4084075f569b None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:27.739611 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd232765-506a-41eb-ae93-4084075f569b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:27.770286 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-dd232765-506a-41eb-ae93-4084075f569b None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:30:27.772703 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-dd232765-506a-41eb-ae93-4084075f569b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:27.883070 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 955/1922] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:30:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:30:27.887071 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35c9bf0-ef6b-415b-9cf4-0498019f489d admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:27.888759 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-b35c9bf0-ef6b-415b-9cf4-0498019f489d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:28.004889 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35c9bf0-ef6b-415b-9cf4-0498019f489d admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:28.009130 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8214ef4-e7df-42c9-a883-aa324bfb8313 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:28.009486 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8214ef4-e7df-42c9-a883-aa324bfb8313 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:28.009837 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8214ef4-e7df-42c9-a883-aa324bfb8313 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:28.010300 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8214ef4-e7df-42c9-a883-aa324bfb8313 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:28.029983 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8214ef4-e7df-42c9-a883-aa324bfb8313 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:28.031440 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8214ef4-e7df-42c9-a883-aa324bfb8313 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:28.069221 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 968/1923] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:30:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:30:28.679517 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd232765-506a-41eb-ae93-4084075f569b None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:28.680990 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-dd232765-506a-41eb-ae93-4084075f569b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:28.704096 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd232765-506a-41eb-ae93-4084075f569b None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:28.717028 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfcc936-d646-4197-acbf-2fc17eedc8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:28.717028 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfcc936-d646-4197-acbf-2fc17eedc8c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:28.718134 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfcc936-d646-4197-acbf-2fc17eedc8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:28.718444 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfcc936-d646-4197-acbf-2fc17eedc8c4 admin admin] PATH_INFO: `/v3/projects/5f8a981e9ca34184b4abfdfc1cc6071f` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:28.720091 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfcc936-d646-4197-acbf-2fc17eedc8c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f8a981e9ca34184b4abfdfc1cc6071f)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:28.722239 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfcc936-d646-4197-acbf-2fc17eedc8c4 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:28.810509 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-2cfcc936-d646-4197-acbf-2fc17eedc8c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f8a981e9ca34184b4abfdfc1cc6071f', 'request_id': 'req-2cfcc936-d646-4197-acbf-2fc17eedc8c4'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:28.825361 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-2cfcc936-d646-4197-acbf-2fc17eedc8c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f8a981e9ca34184b4abfdfc1cc6071f', 'request_id': 'req-2cfcc936-d646-4197-acbf-2fc17eedc8c4'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:28.838715 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-2cfcc936-d646-4197-acbf-2fc17eedc8c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f8a981e9ca34184b4abfdfc1cc6071f', 'request_id': 'req-2cfcc936-d646-4197-acbf-2fc17eedc8c4'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:28.866240 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-2cfcc936-d646-4197-acbf-2fc17eedc8c4 admin admin] The token cache is being invalidate because project 5f8a981e9ca34184b4abfdfc1cc6071f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:30:28.866541 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-2cfcc936-d646-4197-acbf-2fc17eedc8c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:28.867207 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-2cfcc936-d646-4197-acbf-2fc17eedc8c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:28.870885 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 956/1924] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:30:28 2022] DELETE /identity/v3/projects/5f8a981e9ca34184b4abfdfc1cc6071f => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:30:28.875671 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8214ef4-e7df-42c9-a883-aa324bfb8313 service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:28.891668 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8214ef4-e7df-42c9-a883-aa324bfb8313 service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:29.077680 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168742c4-1e22-4e02-b1c6-fcc41cf54f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:29.078120 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168742c4-1e22-4e02-b1c6-fcc41cf54f1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:29.078414 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168742c4-1e22-4e02-b1c6-fcc41cf54f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:29.078778 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168742c4-1e22-4e02-b1c6-fcc41cf54f1b admin admin] PATH_INFO: `/v3/users/48e085a9e93e495c8679541af04df04d` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:29.089001 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168742c4-1e22-4e02-b1c6-fcc41cf54f1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=48e085a9e93e495c8679541af04df04d)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:29.091320 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168742c4-1e22-4e02-b1c6-fcc41cf54f1b admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:29.133748 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfcc936-d646-4197-acbf-2fc17eedc8c4 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:29.136417 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-2cfcc936-d646-4197-acbf-2fc17eedc8c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:29.154924 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfcc936-d646-4197-acbf-2fc17eedc8c4 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:29.163021 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9abcf5-bf0c-4616-8357-b3297910e936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:29.166207 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9abcf5-bf0c-4616-8357-b3297910e936 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:29.166677 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9abcf5-bf0c-4616-8357-b3297910e936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:29.167129 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9abcf5-bf0c-4616-8357-b3297910e936 admin admin] PATH_INFO: `/v3/users/41c06b4182904d34a251d3c96548b97a` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:29.168943 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9abcf5-bf0c-4616-8357-b3297910e936 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41c06b4182904d34a251d3c96548b97a)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:29.171354 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9abcf5-bf0c-4616-8357-b3297910e936 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:29.175641 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-168742c4-1e22-4e02-b1c6-fcc41cf54f1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48e085a9e93e495c8679541af04df04d'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:29.177113 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-168742c4-1e22-4e02-b1c6-fcc41cf54f1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48e085a9e93e495c8679541af04df04d'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:29.187620 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-168742c4-1e22-4e02-b1c6-fcc41cf54f1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48e085a9e93e495c8679541af04df04d'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:29.189981 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-168742c4-1e22-4e02-b1c6-fcc41cf54f1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48e085a9e93e495c8679541af04df04d'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:29.216591 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-168742c4-1e22-4e02-b1c6-fcc41cf54f1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48e085a9e93e495c8679541af04df04d'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:29.240096 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 969/1925] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:30:28 2022] DELETE /identity/v3/users/48e085a9e93e495c8679541af04df04d => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:30:29.248736 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-be9abcf5-bf0c-4616-8357-b3297910e936 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41c06b4182904d34a251d3c96548b97a'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:29.257861 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-be9abcf5-bf0c-4616-8357-b3297910e936 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41c06b4182904d34a251d3c96548b97a'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:29.268265 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-be9abcf5-bf0c-4616-8357-b3297910e936 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41c06b4182904d34a251d3c96548b97a'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:29.269224 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-be9abcf5-bf0c-4616-8357-b3297910e936 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41c06b4182904d34a251d3c96548b97a'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:29.279547 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:29.291203 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-be9abcf5-bf0c-4616-8357-b3297910e936 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41c06b4182904d34a251d3c96548b97a'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:29.303218 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 957/1926] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:30:29 2022] DELETE /identity/v3/users/41c06b4182904d34a251d3c96548b97a => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:30:29.309128 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55aa3b2-0674-451c-95cc-fc6467468e13 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:29.309465 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55aa3b2-0674-451c-95cc-fc6467468e13 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:29.309761 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55aa3b2-0674-451c-95cc-fc6467468e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:29.342011 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:29.365157 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-b55aa3b2-0674-451c-95cc-fc6467468e13 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:30:29.369632 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-b55aa3b2-0674-451c-95cc-fc6467468e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:29.557413 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 970/1927] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:30:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:30:29.569088 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9abcf5-bf0c-4616-8357-b3297910e936 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:29.570782 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-be9abcf5-bf0c-4616-8357-b3297910e936 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:29.673545 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55aa3b2-0674-451c-95cc-fc6467468e13 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:29.676907 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-b55aa3b2-0674-451c-95cc-fc6467468e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:29.726206 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55aa3b2-0674-451c-95cc-fc6467468e13 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:29.736091 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6444d94-08e5-4457-9fd1-5322c120cb8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:29.736933 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6444d94-08e5-4457-9fd1-5322c120cb8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:29.737218 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6444d94-08e5-4457-9fd1-5322c120cb8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:29.737497 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6444d94-08e5-4457-9fd1-5322c120cb8f admin admin] PATH_INFO: `/v3/projects/fd8d231d2ebb488badf631f0d199a675` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:29.738761 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6444d94-08e5-4457-9fd1-5322c120cb8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd8d231d2ebb488badf631f0d199a675)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:29.740300 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9abcf5-bf0c-4616-8357-b3297910e936 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:29.740976 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6444d94-08e5-4457-9fd1-5322c120cb8f admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:29.747823 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd605419-058e-465e-b407-8b4fc23b5670 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:29.748932 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd605419-058e-465e-b407-8b4fc23b5670 service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:29.749424 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd605419-058e-465e-b407-8b4fc23b5670 service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:29.750760 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd605419-058e-465e-b407-8b4fc23b5670 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:29.763857 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd605419-058e-465e-b407-8b4fc23b5670 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:29.765960 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd605419-058e-465e-b407-8b4fc23b5670 service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:29.781778 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 958/1928] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:30:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 03:30:29.802363 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-f6444d94-08e5-4457-9fd1-5322c120cb8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd8d231d2ebb488badf631f0d199a675', 'request_id': 'req-f6444d94-08e5-4457-9fd1-5322c120cb8f'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:29.813086 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-f6444d94-08e5-4457-9fd1-5322c120cb8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd8d231d2ebb488badf631f0d199a675', 'request_id': 'req-f6444d94-08e5-4457-9fd1-5322c120cb8f'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:29.823763 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-f6444d94-08e5-4457-9fd1-5322c120cb8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd8d231d2ebb488badf631f0d199a675', 'request_id': 'req-f6444d94-08e5-4457-9fd1-5322c120cb8f'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:29.851877 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-f6444d94-08e5-4457-9fd1-5322c120cb8f admin admin] The token cache is being invalidate because project fd8d231d2ebb488badf631f0d199a675 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:30:29.852407 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-f6444d94-08e5-4457-9fd1-5322c120cb8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:29.853312 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-f6444d94-08e5-4457-9fd1-5322c120cb8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:29.855115 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 971/1929] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:30:29 2022] DELETE /identity/v3/projects/fd8d231d2ebb488badf631f0d199a675 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:30:29.861847 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0eff7-f35a-4198-942c-00519ed2aad0 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:29.862315 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0eff7-f35a-4198-942c-00519ed2aad0 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:29.863094 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0eff7-f35a-4198-942c-00519ed2aad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:29.894814 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-10c0eff7-f35a-4198-942c-00519ed2aad0 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:30:29.896218 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-10c0eff7-f35a-4198-942c-00519ed2aad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:30.017972 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 959/1930] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:30:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:30:30.026532 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b84917-ff2b-4510-9742-c8d25cf08323 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:30.026958 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b84917-ff2b-4510-9742-c8d25cf08323 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:30.027410 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b84917-ff2b-4510-9742-c8d25cf08323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:30.059521 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-54b84917-ff2b-4510-9742-c8d25cf08323 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:30:30.061786 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-54b84917-ff2b-4510-9742-c8d25cf08323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:30.077143 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 972/1931] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:30:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:30:30.081953 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c0eff7-f35a-4198-942c-00519ed2aad0 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:30.108321 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c0eff7-f35a-4198-942c-00519ed2aad0 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:30.130146 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2c7a1a-daed-464b-b935-b1734c69939c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:30.130781 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c7a1a-daed-464b-b935-b1734c69939c admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:30.131161 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c7a1a-daed-464b-b935-b1734c69939c admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:30.131686 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c7a1a-daed-464b-b935-b1734c69939c admin admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:30.132749 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2c7a1a-daed-464b-b935-b1734c69939c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:30:30.132749 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2c7a1a-daed-464b-b935-b1734c69939c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:30.136167 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2c7a1a-daed-464b-b935-b1734c69939c admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:30.166498 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 960/1932] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 03:30:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:30:30.171481 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b84917-ff2b-4510-9742-c8d25cf08323 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:30.196325 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2c7a1a-daed-464b-b935-b1734c69939c admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:30.199629 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-2b2c7a1a-daed-464b-b935-b1734c69939c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:30.220288 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2c7a1a-daed-464b-b935-b1734c69939c admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:30.246557 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b84917-ff2b-4510-9742-c8d25cf08323 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:30.267646 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0b5bc5-0b1c-4222-9267-9d3de5d958b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:30.270301 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b5bc5-0b1c-4222-9267-9d3de5d958b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:30.277342 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b5bc5-0b1c-4222-9267-9d3de5d958b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:30.279148 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b5bc5-0b1c-4222-9267-9d3de5d958b1 admin admin] PATH_INFO: `/v3/projects/be542984d8d14203a6f682c834312505` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:30.281361 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebbb88d-9198-4fe5-acfe-f79681cdd6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:30.283931 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebbb88d-9198-4fe5-acfe-f79681cdd6ae admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:30.287198 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebbb88d-9198-4fe5-acfe-f79681cdd6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:30.287384 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0b5bc5-0b1c-4222-9267-9d3de5d958b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be542984d8d14203a6f682c834312505)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:30.289056 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebbb88d-9198-4fe5-acfe-f79681cdd6ae admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:30.294179 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebbb88d-9198-4fe5-acfe-f79681cdd6ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:30.299461 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0b5bc5-0b1c-4222-9267-9d3de5d958b1 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:30.300765 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebbb88d-9198-4fe5-acfe-f79681cdd6ae admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:30.396943 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 973/1933] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:30:30 2022] POST /identity/v3/projects => generated 383 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:30:30.404053 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebbb88d-9198-4fe5-acfe-f79681cdd6ae admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:30.491217 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-dd0b5bc5-0b1c-4222-9267-9d3de5d958b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be542984d8d14203a6f682c834312505', 'request_id': 'req-dd0b5bc5-0b1c-4222-9267-9d3de5d958b1'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:30.498656 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-dd0b5bc5-0b1c-4222-9267-9d3de5d958b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be542984d8d14203a6f682c834312505', 'request_id': 'req-dd0b5bc5-0b1c-4222-9267-9d3de5d958b1'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:30.509685 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-dd0b5bc5-0b1c-4222-9267-9d3de5d958b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be542984d8d14203a6f682c834312505', 'request_id': 'req-dd0b5bc5-0b1c-4222-9267-9d3de5d958b1'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:30.518645 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:30.536979 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-dd0b5bc5-0b1c-4222-9267-9d3de5d958b1 admin admin] The token cache is being invalidate because project be542984d8d14203a6f682c834312505 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:30:30.540667 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-dd0b5bc5-0b1c-4222-9267-9d3de5d958b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:30.541777 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-dd0b5bc5-0b1c-4222-9267-9d3de5d958b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:30.544847 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 961/1934] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:30:30 2022] DELETE /identity/v3/projects/be542984d8d14203a6f682c834312505 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:30:30.548277 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebbb88d-9198-4fe5-acfe-f79681cdd6ae admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:30.548642 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0b5bc5-0b1c-4222-9267-9d3de5d958b1 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:30.554059 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-dd0b5bc5-0b1c-4222-9267-9d3de5d958b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:30.564709 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:30.694025 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0b5bc5-0b1c-4222-9267-9d3de5d958b1 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:30.702943 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9664987f-7fcf-484b-a2cb-a6c9dfefaacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:30.703592 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664987f-7fcf-484b-a2cb-a6c9dfefaacf admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:30.705044 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664987f-7fcf-484b-a2cb-a6c9dfefaacf admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:30.705044 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664987f-7fcf-484b-a2cb-a6c9dfefaacf admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:30.706011 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9664987f-7fcf-484b-a2cb-a6c9dfefaacf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:30.710001 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219cd637-bed2-4219-ace8-f3fd06c9daa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:30.710656 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219cd637-bed2-4219-ace8-f3fd06c9daa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:30.710935 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219cd637-bed2-4219-ace8-f3fd06c9daa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:30.711211 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219cd637-bed2-4219-ace8-f3fd06c9daa2 admin admin] PATH_INFO: `/v3/users/0e7bd0bb6a624b5680caa9efc899ed93` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:30.712711 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219cd637-bed2-4219-ace8-f3fd06c9daa2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e7bd0bb6a624b5680caa9efc899ed93)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:30.714199 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9664987f-7fcf-484b-a2cb-a6c9dfefaacf admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:30.717572 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219cd637-bed2-4219-ace8-f3fd06c9daa2 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:30.763011 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 974/1935] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:30:30 2022] POST /identity/v3/users => generated 292 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:30:30.766650 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9664987f-7fcf-484b-a2cb-a6c9dfefaacf admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:30.769259 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-9664987f-7fcf-484b-a2cb-a6c9dfefaacf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:30.790234 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9664987f-7fcf-484b-a2cb-a6c9dfefaacf admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:30.807838 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca926d-03ef-464b-a00c-b7efa490ecaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:30.808915 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca926d-03ef-464b-a00c-b7efa490ecaa admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:30.809202 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca926d-03ef-464b-a00c-b7efa490ecaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:30.809820 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca926d-03ef-464b-a00c-b7efa490ecaa admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:30.810140 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beca926d-03ef-464b-a00c-b7efa490ecaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:30.812615 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beca926d-03ef-464b-a00c-b7efa490ecaa admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:30.846097 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-219cd637-bed2-4219-ace8-f3fd06c9daa2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e7bd0bb6a624b5680caa9efc899ed93'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:30.859862 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 975/1936] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:30:30 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:30:30.861275 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca926d-03ef-464b-a00c-b7efa490ecaa admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:30.875457 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-219cd637-bed2-4219-ace8-f3fd06c9daa2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e7bd0bb6a624b5680caa9efc899ed93'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:30.896404 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-219cd637-bed2-4219-ace8-f3fd06c9daa2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e7bd0bb6a624b5680caa9efc899ed93'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:30.898681 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-219cd637-bed2-4219-ace8-f3fd06c9daa2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e7bd0bb6a624b5680caa9efc899ed93'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:30.904490 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca926d-03ef-464b-a00c-b7efa490ecaa admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:30.921636 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa858b1-91e9-44fe-b196-3cddbfa50673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:30.923292 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa858b1-91e9-44fe-b196-3cddbfa50673 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:30.924097 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa858b1-91e9-44fe-b196-3cddbfa50673 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:30.924382 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa858b1-91e9-44fe-b196-3cddbfa50673 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:30.927161 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa858b1-91e9-44fe-b196-3cddbfa50673 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:30.931773 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa858b1-91e9-44fe-b196-3cddbfa50673 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:30.936244 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-219cd637-bed2-4219-ace8-f3fd06c9daa2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e7bd0bb6a624b5680caa9efc899ed93'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:30.956017 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 962/1937] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:30:30 2022] DELETE /identity/v3/users/0e7bd0bb6a624b5680caa9efc899ed93 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:30:30.956213 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 976/1938] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:30:30 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:30:30.964433 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219cd637-bed2-4219-ace8-f3fd06c9daa2 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:30.966202 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-219cd637-bed2-4219-ace8-f3fd06c9daa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:31.092182 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219cd637-bed2-4219-ace8-f3fd06c9daa2 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:31.105649 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc1db3-46e9-4951-affa-53630b18764e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:31.105871 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc1db3-46e9-4951-affa-53630b18764e admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:31.107818 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc1db3-46e9-4951-affa-53630b18764e admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:31.111882 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc1db3-46e9-4951-affa-53630b18764e admin admin] PATH_INFO: `/v3/projects/66f902eeb78943fdb8bfaf3712eace9d/users/5bdb99bf98a241e096296f8ad322eb59/roles/04d0e4575a28440eb4349b4a6565e8b8` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:31.178755 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dc1db3-46e9-4951-affa-53630b18764e admin admin] RBAC: Authorizing `identity:create_grant(project_id=66f902eeb78943fdb8bfaf3712eace9d, user_id=5bdb99bf98a241e096296f8ad322eb59, role_id=04d0e4575a28440eb4349b4a6565e8b8)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:31.181473 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dc1db3-46e9-4951-affa-53630b18764e admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:31.198047 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:31.224209 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 963/1939] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:30:30 2022] PUT /identity/v3/projects/66f902eeb78943fdb8bfaf3712eace9d/users/5bdb99bf98a241e096296f8ad322eb59/roles/04d0e4575a28440eb4349b4a6565e8b8 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:30:31.240402 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d9c74-0f74-4197-b042-544963a2c7a2 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:31.243589 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d9c74-0f74-4197-b042-544963a2c7a2 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:31.244982 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d9c74-0f74-4197-b042-544963a2c7a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:31.323358 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-5f1d9c74-0f74-4197-b042-544963a2c7a2 None None] MFA Rules not processed for user `5bdb99bf98a241e096296f8ad322eb59`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:30:31.325497 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-5f1d9c74-0f74-4197-b042-544963a2c7a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:31.444092 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 977/1940] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:30:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:30:31.464774 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc1db3-46e9-4951-affa-53630b18764e admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:31.470503 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-96dc1db3-46e9-4951-affa-53630b18764e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:31.694335 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc1db3-46e9-4951-affa-53630b18764e admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:31.701971 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b45f48f-4f43-4e4a-82e4-5589cf8a9704 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f537aabf3d1040ff840b02616f839975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:31.702600 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45f48f-4f43-4e4a-82e4-5589cf8a9704 service cinder] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:31.705938 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45f48f-4f43-4e4a-82e4-5589cf8a9704 service cinder] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:31.706257 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45f48f-4f43-4e4a-82e4-5589cf8a9704 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:31.745051 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b45f48f-4f43-4e4a-82e4-5589cf8a9704 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:31.746571 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b45f48f-4f43-4e4a-82e4-5589cf8a9704 service cinder] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:31.776805 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 964/1941] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:30:31 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:30:32.704754 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1d9c74-0f74-4197-b042-544963a2c7a2 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:32.706762 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-5f1d9c74-0f74-4197-b042-544963a2c7a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:32.861622 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1d9c74-0f74-4197-b042-544963a2c7a2 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:32.874078 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f84f07e-0c32-40de-878c-b6d424dfb9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:32.876221 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f84f07e-0c32-40de-878c-b6d424dfb9c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:32.876728 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f84f07e-0c32-40de-878c-b6d424dfb9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:32.877435 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f84f07e-0c32-40de-878c-b6d424dfb9c9 admin admin] PATH_INFO: `/v3/projects/75468d61fc964503b879607b11b6ac6a` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:32.879839 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f84f07e-0c32-40de-878c-b6d424dfb9c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75468d61fc964503b879607b11b6ac6a)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:32.883765 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f84f07e-0c32-40de-878c-b6d424dfb9c9 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:32.897421 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:32.972251 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-7f84f07e-0c32-40de-878c-b6d424dfb9c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75468d61fc964503b879607b11b6ac6a', 'request_id': 'req-7f84f07e-0c32-40de-878c-b6d424dfb9c9'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:32.979793 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-7f84f07e-0c32-40de-878c-b6d424dfb9c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75468d61fc964503b879607b11b6ac6a', 'request_id': 'req-7f84f07e-0c32-40de-878c-b6d424dfb9c9'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:32.990977 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-7f84f07e-0c32-40de-878c-b6d424dfb9c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75468d61fc964503b879607b11b6ac6a', 'request_id': 'req-7f84f07e-0c32-40de-878c-b6d424dfb9c9'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:33.021352 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-7f84f07e-0c32-40de-878c-b6d424dfb9c9 admin admin] The token cache is being invalidate because project 75468d61fc964503b879607b11b6ac6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:30:33.021656 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-7f84f07e-0c32-40de-878c-b6d424dfb9c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:33.023144 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-7f84f07e-0c32-40de-878c-b6d424dfb9c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:33.025223 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 978/1942] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:30:32 2022] DELETE /identity/v3/projects/75468d61fc964503b879607b11b6ac6a => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:30:33.030688 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1404dd00-ddad-4648-9e68-b7ceb03633eb None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:33.031762 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1404dd00-ddad-4648-9e68-b7ceb03633eb None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:33.034278 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1404dd00-ddad-4648-9e68-b7ceb03633eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:33.099760 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-1404dd00-ddad-4648-9e68-b7ceb03633eb None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:30:33.100989 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-1404dd00-ddad-4648-9e68-b7ceb03633eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:33.243013 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f84f07e-0c32-40de-878c-b6d424dfb9c9 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:33.243792 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-7f84f07e-0c32-40de-878c-b6d424dfb9c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:33.307316 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 965/1943] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:30:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:30:33.313444 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b16cd7d-03e7-45df-9d0e-0af39f1be0d5 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:33.314105 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b16cd7d-03e7-45df-9d0e-0af39f1be0d5 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:33.314616 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b16cd7d-03e7-45df-9d0e-0af39f1be0d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:33.453240 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-5b16cd7d-03e7-45df-9d0e-0af39f1be0d5 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:30:33.454662 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-5b16cd7d-03e7-45df-9d0e-0af39f1be0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:33.458967 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f84f07e-0c32-40de-878c-b6d424dfb9c9 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:33.479254 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 966/1944] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:30:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:30:33.479400 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74602bd1-54d7-4bba-ae5a-85da6b8099de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:33.480647 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b16cd7d-03e7-45df-9d0e-0af39f1be0d5 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:33.483580 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74602bd1-54d7-4bba-ae5a-85da6b8099de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:33.483892 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74602bd1-54d7-4bba-ae5a-85da6b8099de admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:33.487607 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74602bd1-54d7-4bba-ae5a-85da6b8099de admin admin] PATH_INFO: `/v3/users/14e11d98cd484d67a8c5e524d8764c20` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:33.492744 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74602bd1-54d7-4bba-ae5a-85da6b8099de admin admin] RBAC: Authorizing `identity:delete_user(user_id=14e11d98cd484d67a8c5e524d8764c20)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:33.499066 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74602bd1-54d7-4bba-ae5a-85da6b8099de admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:33.520266 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b16cd7d-03e7-45df-9d0e-0af39f1be0d5 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:33.548422 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337bae31-9eec-44d8-b0e4-a8e684f413c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:33.550246 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337bae31-9eec-44d8-b0e4-a8e684f413c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:33.551428 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337bae31-9eec-44d8-b0e4-a8e684f413c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:33.552404 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337bae31-9eec-44d8-b0e4-a8e684f413c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:33.554248 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337bae31-9eec-44d8-b0e4-a8e684f413c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:30:33.554710 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337bae31-9eec-44d8-b0e4-a8e684f413c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:33.558874 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337bae31-9eec-44d8-b0e4-a8e684f413c8 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:33.588243 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 967/1945] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 03:30:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:30:33.592319 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337bae31-9eec-44d8-b0e4-a8e684f413c8 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:33.609017 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337bae31-9eec-44d8-b0e4-a8e684f413c8 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:33.616347 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d6f99-6fdf-4a9f-8230-8277ebde5780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:33.618100 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d6f99-6fdf-4a9f-8230-8277ebde5780 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:33.618672 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d6f99-6fdf-4a9f-8230-8277ebde5780 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:33.619100 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d6f99-6fdf-4a9f-8230-8277ebde5780 admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:33.620645 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4d6f99-6fdf-4a9f-8230-8277ebde5780 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:33.623856 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4d6f99-6fdf-4a9f-8230-8277ebde5780 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:33.650416 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-74602bd1-54d7-4bba-ae5a-85da6b8099de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14e11d98cd484d67a8c5e524d8764c20'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:33.652199 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-74602bd1-54d7-4bba-ae5a-85da6b8099de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14e11d98cd484d67a8c5e524d8764c20'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:33.670274 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-74602bd1-54d7-4bba-ae5a-85da6b8099de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14e11d98cd484d67a8c5e524d8764c20'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:33.670902 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-74602bd1-54d7-4bba-ae5a-85da6b8099de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14e11d98cd484d67a8c5e524d8764c20'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:33.700835 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 968/1946] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:30:33 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:30:33.705397 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d6f99-6fdf-4a9f-8230-8277ebde5780 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:33.709945 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-4b4d6f99-6fdf-4a9f-8230-8277ebde5780 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:33.717196 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-74602bd1-54d7-4bba-ae5a-85da6b8099de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14e11d98cd484d67a8c5e524d8764c20'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:33.764191 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 979/1947] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:30:33 2022] DELETE /identity/v3/users/14e11d98cd484d67a8c5e524d8764c20 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:30:33.767194 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb915196-adb1-47b5-8545-57a2d2077a4e None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:33.767528 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb915196-adb1-47b5-8545-57a2d2077a4e None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:33.767793 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb915196-adb1-47b5-8545-57a2d2077a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:33.820499 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-cb915196-adb1-47b5-8545-57a2d2077a4e None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:30:33.821864 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-cb915196-adb1-47b5-8545-57a2d2077a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:33.841584 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:33.853467 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:33.859469 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d6f99-6fdf-4a9f-8230-8277ebde5780 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:33.920445 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 980/1948] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:30:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:30:33.933452 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb915196-adb1-47b5-8545-57a2d2077a4e None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:33.935763 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-cb915196-adb1-47b5-8545-57a2d2077a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:33.987324 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f6de63-0698-43bd-9c70-d8c00b3ab860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:33.989312 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6de63-0698-43bd-9c70-d8c00b3ab860 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:33.989849 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6de63-0698-43bd-9c70-d8c00b3ab860 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:33.990306 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6de63-0698-43bd-9c70-d8c00b3ab860 admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:33.990830 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f6de63-0698-43bd-9c70-d8c00b3ab860 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:33.993480 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f6de63-0698-43bd-9c70-d8c00b3ab860 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:34.025855 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb915196-adb1-47b5-8545-57a2d2077a4e None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:34.031541 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 969/1949] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:30:33 2022] POST /identity/v3/users => generated 293 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:30:34.032353 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f6de63-0698-43bd-9c70-d8c00b3ab860 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:34.037112 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b65bb2-27da-42aa-bed0-5b3426a5c573 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:34.037850 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b65bb2-27da-42aa-bed0-5b3426a5c573 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:34.039144 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b65bb2-27da-42aa-bed0-5b3426a5c573 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:34.039441 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b65bb2-27da-42aa-bed0-5b3426a5c573 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:34.052547 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b65bb2-27da-42aa-bed0-5b3426a5c573 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:34.056355 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b65bb2-27da-42aa-bed0-5b3426a5c573 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:34.062584 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f6de63-0698-43bd-9c70-d8c00b3ab860 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:34.068211 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 981/1950] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:30:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 03:30:34.068906 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dedc09-18b1-4119-8f3e-4c9568a7a9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:34.069517 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dedc09-18b1-4119-8f3e-4c9568a7a9ca admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:34.069794 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dedc09-18b1-4119-8f3e-4c9568a7a9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:34.070322 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dedc09-18b1-4119-8f3e-4c9568a7a9ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:34.071128 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dedc09-18b1-4119-8f3e-4c9568a7a9ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:34.072913 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dedc09-18b1-4119-8f3e-4c9568a7a9ca admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:34.104522 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 970/1951] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:30:34 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:30:34.105667 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b65bb2-27da-42aa-bed0-5b3426a5c573 service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:34.116643 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b65bb2-27da-42aa-bed0-5b3426a5c573 service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:34.122253 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3be15b-7251-48cc-9a05-692929c14d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:34.123068 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3be15b-7251-48cc-9a05-692929c14d7c admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:34.123657 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3be15b-7251-48cc-9a05-692929c14d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:34.123657 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3be15b-7251-48cc-9a05-692929c14d7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:34.124765 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3be15b-7251-48cc-9a05-692929c14d7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:34.126424 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3be15b-7251-48cc-9a05-692929c14d7c admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:34.143329 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 982/1952] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:30:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:30:34.144446 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dedc09-18b1-4119-8f3e-4c9568a7a9ca admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:34.156634 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dedc09-18b1-4119-8f3e-4c9568a7a9ca admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:34.170150 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5635a9-3150-4364-bbd9-d968556ff386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:34.170898 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5635a9-3150-4364-bbd9-d968556ff386 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:34.171182 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5635a9-3150-4364-bbd9-d968556ff386 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:34.171529 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5635a9-3150-4364-bbd9-d968556ff386 admin admin] PATH_INFO: `/v3/projects/7286192eda0e48a190040ed11c230eb6/users/8a234a42049d45b79d59af7e45c4f759/roles/04d0e4575a28440eb4349b4a6565e8b8` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:34.188835 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5635a9-3150-4364-bbd9-d968556ff386 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7286192eda0e48a190040ed11c230eb6, user_id=8a234a42049d45b79d59af7e45c4f759, role_id=04d0e4575a28440eb4349b4a6565e8b8)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:34.192382 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5635a9-3150-4364-bbd9-d968556ff386 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:34.222435 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 971/1953] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:30:34 2022] PUT /identity/v3/projects/7286192eda0e48a190040ed11c230eb6/users/8a234a42049d45b79d59af7e45c4f759/roles/04d0e4575a28440eb4349b4a6565e8b8 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:30:34.226153 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279acd52-60ce-4fbd-9775-d96edc022d23 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:34.226153 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279acd52-60ce-4fbd-9775-d96edc022d23 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:34.226153 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279acd52-60ce-4fbd-9775-d96edc022d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:34.276920 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-279acd52-60ce-4fbd-9775-d96edc022d23 None None] MFA Rules not processed for user `8a234a42049d45b79d59af7e45c4f759`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:30:34.278332 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-279acd52-60ce-4fbd-9775-d96edc022d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:34.376238 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 983/1954] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:30:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:30:34.381379 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5635a9-3150-4364-bbd9-d968556ff386 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:34.479011 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5635a9-3150-4364-bbd9-d968556ff386 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:34.489881 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fdc9c5-ee3d-40eb-a733-eb3a3c5c670e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:34.491935 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fdc9c5-ee3d-40eb-a733-eb3a3c5c670e admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:34.493137 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fdc9c5-ee3d-40eb-a733-eb3a3c5c670e admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:34.493806 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fdc9c5-ee3d-40eb-a733-eb3a3c5c670e admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:34.494269 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fdc9c5-ee3d-40eb-a733-eb3a3c5c670e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:34.496443 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fdc9c5-ee3d-40eb-a733-eb3a3c5c670e admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:34.544043 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 972/1955] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:30:34 2022] POST /identity/v3/projects => generated 387 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 03:30:34.547953 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279acd52-60ce-4fbd-9775-d96edc022d23 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:34.560411 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279acd52-60ce-4fbd-9775-d96edc022d23 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:34.622394 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:34.686840 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284677ad-c7e8-4c2c-b940-e18838568a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:34.686840 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284677ad-c7e8-4c2c-b940-e18838568a1f admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:34.697332 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284677ad-c7e8-4c2c-b940-e18838568a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:34.703539 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284677ad-c7e8-4c2c-b940-e18838568a1f admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:34.704171 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284677ad-c7e8-4c2c-b940-e18838568a1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:34.710397 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284677ad-c7e8-4c2c-b940-e18838568a1f admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:34.747708 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 984/1956] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:30:34 2022] POST /identity/v3/users => generated 300 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:30:34.749081 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fdc9c5-ee3d-40eb-a733-eb3a3c5c670e admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:34.763057 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fdc9c5-ee3d-40eb-a733-eb3a3c5c670e admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:34.775563 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0364e5-100e-4675-9a66-f2cb37ba2366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:34.777499 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0364e5-100e-4675-9a66-f2cb37ba2366 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:34.778939 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0364e5-100e-4675-9a66-f2cb37ba2366 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:34.779326 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0364e5-100e-4675-9a66-f2cb37ba2366 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:34.780130 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0364e5-100e-4675-9a66-f2cb37ba2366 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:34.783396 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0364e5-100e-4675-9a66-f2cb37ba2366 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:34.803598 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 973/1957] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:30:34 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:30:34.807433 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284677ad-c7e8-4c2c-b940-e18838568a1f admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:34.821191 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284677ad-c7e8-4c2c-b940-e18838568a1f admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:34.831271 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55037fda-1745-4772-b564-57a7f69c6fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:34.835985 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55037fda-1745-4772-b564-57a7f69c6fa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:34.836490 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55037fda-1745-4772-b564-57a7f69c6fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:34.837155 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55037fda-1745-4772-b564-57a7f69c6fa2 admin admin] PATH_INFO: `/v3/projects/9ee50aefff1f41e6a21093b78ea673d2/users/a51a149eca234553a8c0107eef476c47/roles/fe9379cda35c4ff78576fe48b60bea3c` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:34.884262 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55037fda-1745-4772-b564-57a7f69c6fa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ee50aefff1f41e6a21093b78ea673d2, user_id=a51a149eca234553a8c0107eef476c47, role_id=fe9379cda35c4ff78576fe48b60bea3c)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:34.894208 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55037fda-1745-4772-b564-57a7f69c6fa2 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:34.897447 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0364e5-100e-4675-9a66-f2cb37ba2366 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:34.899309 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-1b0364e5-100e-4675-9a66-f2cb37ba2366 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:34.929673 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0364e5-100e-4675-9a66-f2cb37ba2366 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:34.940456 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c179d7c2-c77b-48dc-ac28-1861ccaa9069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:34.941220 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c179d7c2-c77b-48dc-ac28-1861ccaa9069 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:34.942107 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c179d7c2-c77b-48dc-ac28-1861ccaa9069 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:34.942514 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c179d7c2-c77b-48dc-ac28-1861ccaa9069 admin admin] PATH_INFO: `/v3/projects/139c60e7c8dd4620b0f362f238f03959` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:34.947437 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c179d7c2-c77b-48dc-ac28-1861ccaa9069 admin admin] RBAC: Authorizing `identity:delete_project(project_id=139c60e7c8dd4620b0f362f238f03959)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:34.953543 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c179d7c2-c77b-48dc-ac28-1861ccaa9069 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:34.954467 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 985/1958] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:30:34 2022] PUT /identity/v3/projects/9ee50aefff1f41e6a21093b78ea673d2/users/a51a149eca234553a8c0107eef476c47/roles/fe9379cda35c4ff78576fe48b60bea3c => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 03:30:34.959851 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55037fda-1745-4772-b564-57a7f69c6fa2 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:35.024583 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:35.069605 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-c179d7c2-c77b-48dc-ac28-1861ccaa9069 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '139c60e7c8dd4620b0f362f238f03959', 'request_id': 'req-c179d7c2-c77b-48dc-ac28-1861ccaa9069'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:35.095619 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-c179d7c2-c77b-48dc-ac28-1861ccaa9069 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '139c60e7c8dd4620b0f362f238f03959', 'request_id': 'req-c179d7c2-c77b-48dc-ac28-1861ccaa9069'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:35.110107 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-c179d7c2-c77b-48dc-ac28-1861ccaa9069 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '139c60e7c8dd4620b0f362f238f03959', 'request_id': 'req-c179d7c2-c77b-48dc-ac28-1861ccaa9069'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:35.131980 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55037fda-1745-4772-b564-57a7f69c6fa2 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:35.133937 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-c179d7c2-c77b-48dc-ac28-1861ccaa9069 admin admin] The token cache is being invalidate because project 139c60e7c8dd4620b0f362f238f03959 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:30:35.134271 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-c179d7c2-c77b-48dc-ac28-1861ccaa9069 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:35.135078 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-c179d7c2-c77b-48dc-ac28-1861ccaa9069 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:35.140262 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 974/1959] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:30:34 2022] DELETE /identity/v3/projects/139c60e7c8dd4620b0f362f238f03959 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:30:35.142297 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d639dd4-e478-4d11-9a2f-c845a37bbd40 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:35.142537 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d639dd4-e478-4d11-9a2f-c845a37bbd40 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:35.143379 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d639dd4-e478-4d11-9a2f-c845a37bbd40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:35.199945 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-9d639dd4-e478-4d11-9a2f-c845a37bbd40 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:30:35.203072 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-9d639dd4-e478-4d11-9a2f-c845a37bbd40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:35.242829 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa3d8d-a24e-4634-baff-f4607d045c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:35.243844 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa3d8d-a24e-4634-baff-f4607d045c3e admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:35.244371 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa3d8d-a24e-4634-baff-f4607d045c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:35.244822 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa3d8d-a24e-4634-baff-f4607d045c3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:35.246601 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fa3d8d-a24e-4634-baff-f4607d045c3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:35.248533 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fa3d8d-a24e-4634-baff-f4607d045c3e admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:35.278295 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 986/1960] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:30:34 2022] GET /identity/v3/roles => generated 1420 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:30:35.279932 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa3d8d-a24e-4634-baff-f4607d045c3e admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:35.283904 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-b0fa3d8d-a24e-4634-baff-f4607d045c3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:35.303978 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa3d8d-a24e-4634-baff-f4607d045c3e admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:35.314608 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d312b8d0-cd40-4cb2-8958-59920a681f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:35.315871 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d312b8d0-cd40-4cb2-8958-59920a681f47 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:35.316133 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d312b8d0-cd40-4cb2-8958-59920a681f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:35.316535 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d312b8d0-cd40-4cb2-8958-59920a681f47 admin admin] PATH_INFO: `/v3/projects/9ee50aefff1f41e6a21093b78ea673d2/users/a51a149eca234553a8c0107eef476c47/roles/fe9379cda35c4ff78576fe48b60bea3c` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:35.319407 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d312b8d0-cd40-4cb2-8958-59920a681f47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ee50aefff1f41e6a21093b78ea673d2, user_id=a51a149eca234553a8c0107eef476c47, role_id=fe9379cda35c4ff78576fe48b60bea3c)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:35.322757 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d312b8d0-cd40-4cb2-8958-59920a681f47 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:35.342010 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 987/1961] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:30:35 2022] PUT /identity/v3/projects/9ee50aefff1f41e6a21093b78ea673d2/users/a51a149eca234553a8c0107eef476c47/roles/fe9379cda35c4ff78576fe48b60bea3c => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:30:35.353867 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c443bf-e993-451d-84fe-ef81e0c6b4e1 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:35.354260 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c443bf-e993-451d-84fe-ef81e0c6b4e1 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:35.354766 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c443bf-e993-451d-84fe-ef81e0c6b4e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:35.367556 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 975/1962] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:30:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:30:35.371762 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1694bdf3-49e2-4cb8-87f7-7dc6d0cd5c0a None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:35.375597 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1694bdf3-49e2-4cb8-87f7-7dc6d0cd5c0a None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:35.375597 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1694bdf3-49e2-4cb8-87f7-7dc6d0cd5c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:35.432130 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-48c443bf-e993-451d-84fe-ef81e0c6b4e1 None None] MFA Rules not processed for user `a51a149eca234553a8c0107eef476c47`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:30:35.434032 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-48c443bf-e993-451d-84fe-ef81e0c6b4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:35.462491 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-1694bdf3-49e2-4cb8-87f7-7dc6d0cd5c0a None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:30:35.464080 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-1694bdf3-49e2-4cb8-87f7-7dc6d0cd5c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:35.511929 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:35.682443 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 976/1963] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:30:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:30:35.699884 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 988/1964] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:30:35 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 03:30:35.700083 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1694bdf3-49e2-4cb8-87f7-7dc6d0cd5c0a None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:35.710385 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c443bf-e993-451d-84fe-ef81e0c6b4e1 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:35.711384 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-48c443bf-e993-451d-84fe-ef81e0c6b4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:35.729714 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1694bdf3-49e2-4cb8-87f7-7dc6d0cd5c0a None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:35.741483 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d763e7-6fbe-42c7-a99a-47de757d0b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:35.742453 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d763e7-6fbe-42c7-a99a-47de757d0b68 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:35.743875 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d763e7-6fbe-42c7-a99a-47de757d0b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:35.745089 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d763e7-6fbe-42c7-a99a-47de757d0b68 admin admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:35.746880 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d763e7-6fbe-42c7-a99a-47de757d0b68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:30:35.747233 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d763e7-6fbe-42c7-a99a-47de757d0b68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:35.748944 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d763e7-6fbe-42c7-a99a-47de757d0b68 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:35.780947 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 977/1965] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 03:30:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:30:35.789970 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d763e7-6fbe-42c7-a99a-47de757d0b68 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:35.820303 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d763e7-6fbe-42c7-a99a-47de757d0b68 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:35.840577 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d6bb3a-302f-494e-821c-1b3854b77b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:35.840577 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6bb3a-302f-494e-821c-1b3854b77b9f admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:35.840577 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6bb3a-302f-494e-821c-1b3854b77b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:35.840577 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6bb3a-302f-494e-821c-1b3854b77b9f admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:35.840875 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d6bb3a-302f-494e-821c-1b3854b77b9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:35.860087 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d6bb3a-302f-494e-821c-1b3854b77b9f admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:35.912303 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c443bf-e993-451d-84fe-ef81e0c6b4e1 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:35.920112 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd5e0a4-7da9-4c85-bfa2-662ac71c8dfb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f537aabf3d1040ff840b02616f839975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:35.923104 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd5e0a4-7da9-4c85-bfa2-662ac71c8dfb service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:35.923405 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd5e0a4-7da9-4c85-bfa2-662ac71c8dfb service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:35.925527 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd5e0a4-7da9-4c85-bfa2-662ac71c8dfb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:35.962889 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 978/1966] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:30:35 2022] POST /identity/v3/projects => generated 385 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:30:35.963952 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d6bb3a-302f-494e-821c-1b3854b77b9f admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:35.965026 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd5e0a4-7da9-4c85-bfa2-662ac71c8dfb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:35.970208 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd5e0a4-7da9-4c85-bfa2-662ac71c8dfb service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:36.000766 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 989/1967] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:30:35 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 03:30:36.014588 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:36.079782 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d6bb3a-302f-494e-821c-1b3854b77b9f admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:36.086600 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb08fa-468c-4773-8389-b035514cd933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:36.087499 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb08fa-468c-4773-8389-b035514cd933 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:36.088168 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb08fa-468c-4773-8389-b035514cd933 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:36.089147 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb08fa-468c-4773-8389-b035514cd933 admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:36.090158 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeb08fa-468c-4773-8389-b035514cd933 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:36.099635 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeb08fa-468c-4773-8389-b035514cd933 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:36.144014 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 979/1968] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:30:35 2022] POST /identity/v3/users => generated 293 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:30:36.145806 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd5e0a4-7da9-4c85-bfa2-662ac71c8dfb service cinder] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:36.165583 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd5e0a4-7da9-4c85-bfa2-662ac71c8dfb service cinder] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:36.187277 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb08fa-468c-4773-8389-b035514cd933 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:36.196716 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16420bd7-0545-4e5f-92a9-4dd7d4c4fa11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:36.196716 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16420bd7-0545-4e5f-92a9-4dd7d4c4fa11 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:36.199305 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16420bd7-0545-4e5f-92a9-4dd7d4c4fa11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:36.200905 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16420bd7-0545-4e5f-92a9-4dd7d4c4fa11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:36.201744 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16420bd7-0545-4e5f-92a9-4dd7d4c4fa11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:36.203352 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16420bd7-0545-4e5f-92a9-4dd7d4c4fa11 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:36.213704 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb08fa-468c-4773-8389-b035514cd933 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:36.227571 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 990/1969] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:30:36.232607 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16420bd7-0545-4e5f-92a9-4dd7d4c4fa11 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:36.235835 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7e4bc9-0471-429d-ab4a-2ac683f85f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:36.236602 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e4bc9-0471-429d-ab4a-2ac683f85f1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:36.236890 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e4bc9-0471-429d-ab4a-2ac683f85f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:36.237166 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e4bc9-0471-429d-ab4a-2ac683f85f1b admin admin] PATH_INFO: `/v3/users/8a234a42049d45b79d59af7e45c4f759` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:36.248336 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7e4bc9-0471-429d-ab4a-2ac683f85f1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a234a42049d45b79d59af7e45c4f759)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:36.251028 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7e4bc9-0471-429d-ab4a-2ac683f85f1b admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:36.265399 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16420bd7-0545-4e5f-92a9-4dd7d4c4fa11 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:36.280573 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b279a60-12d9-4d2f-9f40-7107be73ed15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:36.281137 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b279a60-12d9-4d2f-9f40-7107be73ed15 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:36.281423 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b279a60-12d9-4d2f-9f40-7107be73ed15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:36.281696 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b279a60-12d9-4d2f-9f40-7107be73ed15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:36.282436 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b279a60-12d9-4d2f-9f40-7107be73ed15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:36.288950 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b279a60-12d9-4d2f-9f40-7107be73ed15 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:36.324267 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 991/1970] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:30:36.329177 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b279a60-12d9-4d2f-9f40-7107be73ed15 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:36.366079 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b279a60-12d9-4d2f-9f40-7107be73ed15 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:36.377187 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbcb416-68e2-498c-bc3a-23d34b5e26f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:36.380219 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbcb416-68e2-498c-bc3a-23d34b5e26f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:36.380219 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbcb416-68e2-498c-bc3a-23d34b5e26f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:36.380394 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbcb416-68e2-498c-bc3a-23d34b5e26f1 admin admin] PATH_INFO: `/v3/projects/960758d5affe4ef5ab2d36f93bbde53d/users/bb40abb0dd224dbea955ca6e35f07374/roles/04d0e4575a28440eb4349b4a6565e8b8` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:36.391669 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-5d7e4bc9-0471-429d-ab4a-2ac683f85f1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a234a42049d45b79d59af7e45c4f759'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:36.402566 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-5d7e4bc9-0471-429d-ab4a-2ac683f85f1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a234a42049d45b79d59af7e45c4f759'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:36.422453 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-5d7e4bc9-0471-429d-ab4a-2ac683f85f1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a234a42049d45b79d59af7e45c4f759'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:36.422989 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-5d7e4bc9-0471-429d-ab4a-2ac683f85f1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a234a42049d45b79d59af7e45c4f759'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:36.432036 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbcb416-68e2-498c-bc3a-23d34b5e26f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=960758d5affe4ef5ab2d36f93bbde53d, user_id=bb40abb0dd224dbea955ca6e35f07374, role_id=04d0e4575a28440eb4349b4a6565e8b8)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:36.435522 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbcb416-68e2-498c-bc3a-23d34b5e26f1 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:36.451987 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-5d7e4bc9-0471-429d-ab4a-2ac683f85f1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a234a42049d45b79d59af7e45c4f759'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:36.465392 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 992/1971] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:30:36 2022] PUT /identity/v3/projects/960758d5affe4ef5ab2d36f93bbde53d/users/bb40abb0dd224dbea955ca6e35f07374/roles/04d0e4575a28440eb4349b4a6565e8b8 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 03:30:36.476377 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 980/1972] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:30:36 2022] DELETE /identity/v3/users/8a234a42049d45b79d59af7e45c4f759 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:30:36.481645 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b632e-a0d7-4753-a0e3-51bb29f744bb None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:36.481945 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b632e-a0d7-4753-a0e3-51bb29f744bb None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:36.483213 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b632e-a0d7-4753-a0e3-51bb29f744bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:36.485401 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c322bd09-ae59-4a57-ae1c-a3044438c954 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:36.486569 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c322bd09-ae59-4a57-ae1c-a3044438c954 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:36.487049 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c322bd09-ae59-4a57-ae1c-a3044438c954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:36.553663 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-0c4b632e-a0d7-4753-a0e3-51bb29f744bb None None] MFA Rules not processed for user `bb40abb0dd224dbea955ca6e35f07374`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:30:36.554998 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-0c4b632e-a0d7-4753-a0e3-51bb29f744bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:36.555728 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-c322bd09-ae59-4a57-ae1c-a3044438c954 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:30:36.557044 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-c322bd09-ae59-4a57-ae1c-a3044438c954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:36.663184 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 981/1973] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:30:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:30:36.681925 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c322bd09-ae59-4a57-ae1c-a3044438c954 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:36.685432 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-c322bd09-ae59-4a57-ae1c-a3044438c954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:36.722359 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 993/1974] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:30:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:30:36.727312 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4b632e-a0d7-4753-a0e3-51bb29f744bb None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:36.739072 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-0c4b632e-a0d7-4753-a0e3-51bb29f744bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:36.762537 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:36.763091 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:36.774010 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4b632e-a0d7-4753-a0e3-51bb29f744bb None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:36.786601 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cac9c1c-3363-4974-a2dc-00b681325b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:36.787193 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac9c1c-3363-4974-a2dc-00b681325b0f admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:36.794347 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac9c1c-3363-4974-a2dc-00b681325b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:36.794876 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac9c1c-3363-4974-a2dc-00b681325b0f admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:36.795907 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cac9c1c-3363-4974-a2dc-00b681325b0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:36.798549 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cac9c1c-3363-4974-a2dc-00b681325b0f admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:36.848104 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c322bd09-ae59-4a57-ae1c-a3044438c954 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:36.858378 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b087ae-f4b5-438d-a4eb-9d3b943e1428 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:36.859011 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b087ae-f4b5-438d-a4eb-9d3b943e1428 service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:36.859293 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b087ae-f4b5-438d-a4eb-9d3b943e1428 service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:36.859610 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b087ae-f4b5-438d-a4eb-9d3b943e1428 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:36.867048 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 994/1975] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:30:36 2022] POST /identity/v3/projects => generated 385 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 03:30:36.870388 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cac9c1c-3363-4974-a2dc-00b681325b0f admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:36.878551 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b087ae-f4b5-438d-a4eb-9d3b943e1428 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:36.881131 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b087ae-f4b5-438d-a4eb-9d3b943e1428 service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:36.903888 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 982/1976] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:30:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:30:37.009704 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cac9c1c-3363-4974-a2dc-00b681325b0f admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:37.015690 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23abb3a7-08ca-4d7f-adf6-620207c788da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:37.016570 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23abb3a7-08ca-4d7f-adf6-620207c788da admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:37.017057 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23abb3a7-08ca-4d7f-adf6-620207c788da admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:37.017517 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23abb3a7-08ca-4d7f-adf6-620207c788da admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:37.018525 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23abb3a7-08ca-4d7f-adf6-620207c788da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:37.021424 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23abb3a7-08ca-4d7f-adf6-620207c788da admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:37.056034 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 995/1977] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:30:36 2022] POST /identity/v3/users => generated 293 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:30:37.060143 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b087ae-f4b5-438d-a4eb-9d3b943e1428 service neutron] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:37.077328 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b087ae-f4b5-438d-a4eb-9d3b943e1428 service neutron] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:37.084856 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027f4796-52f1-41b8-a85b-6d9055265ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:37.086147 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f4796-52f1-41b8-a85b-6d9055265ca3 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:37.086586 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f4796-52f1-41b8-a85b-6d9055265ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:37.087021 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f4796-52f1-41b8-a85b-6d9055265ca3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:37.087878 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027f4796-52f1-41b8-a85b-6d9055265ca3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:37.089866 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027f4796-52f1-41b8-a85b-6d9055265ca3 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:37.106956 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 983/1978] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:30:37 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 03:30:37.108169 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23abb3a7-08ca-4d7f-adf6-620207c788da admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:37.122225 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23abb3a7-08ca-4d7f-adf6-620207c788da admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:37.134950 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b645b92-9d0d-4ecd-beae-104b90d82b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:37.135434 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b645b92-9d0d-4ecd-beae-104b90d82b58 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:37.137270 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b645b92-9d0d-4ecd-beae-104b90d82b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:37.137549 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b645b92-9d0d-4ecd-beae-104b90d82b58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:37.138213 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b645b92-9d0d-4ecd-beae-104b90d82b58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:37.140969 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b645b92-9d0d-4ecd-beae-104b90d82b58 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:37.157285 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 996/1979] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:30:37 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:30:37.162162 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027f4796-52f1-41b8-a85b-6d9055265ca3 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:37.175007 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027f4796-52f1-41b8-a85b-6d9055265ca3 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:37.181830 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb35feb-a974-4a2d-b98d-172832717396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:37.182747 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb35feb-a974-4a2d-b98d-172832717396 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:37.183022 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb35feb-a974-4a2d-b98d-172832717396 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:37.183446 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb35feb-a974-4a2d-b98d-172832717396 admin admin] PATH_INFO: `/v3/projects/0b1a2a2328a44c7489347da2f0a8367e/users/612bac3be4c040e88853193b3e3853c1/roles/04d0e4575a28440eb4349b4a6565e8b8` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:37.209005 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb35feb-a974-4a2d-b98d-172832717396 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b1a2a2328a44c7489347da2f0a8367e, user_id=612bac3be4c040e88853193b3e3853c1, role_id=04d0e4575a28440eb4349b4a6565e8b8)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:37.211881 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb35feb-a974-4a2d-b98d-172832717396 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:37.242873 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 984/1980] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:30:37 2022] PUT /identity/v3/projects/0b1a2a2328a44c7489347da2f0a8367e/users/612bac3be4c040e88853193b3e3853c1/roles/04d0e4575a28440eb4349b4a6565e8b8 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:30:37.244998 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d0e8f-0501-44e7-ab35-72de9df01f04 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:37.245286 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d0e8f-0501-44e7-ab35-72de9df01f04 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:37.245563 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d0e8f-0501-44e7-ab35-72de9df01f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:37.298722 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-a06d0e8f-0501-44e7-ab35-72de9df01f04 None None] MFA Rules not processed for user `612bac3be4c040e88853193b3e3853c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:30:37.302959 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-a06d0e8f-0501-44e7-ab35-72de9df01f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:37.324334 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb35feb-a974-4a2d-b98d-172832717396 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:37.326404 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-feb35feb-a974-4a2d-b98d-172832717396 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:37.422308 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 997/1981] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:30:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:30:37.427215 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06d0e8f-0501-44e7-ab35-72de9df01f04 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:37.471752 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb35feb-a974-4a2d-b98d-172832717396 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:37.482862 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b439d9-9cfe-4706-b564-dc4c2b29df5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:37.483682 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b439d9-9cfe-4706-b564-dc4c2b29df5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:37.483972 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b439d9-9cfe-4706-b564-dc4c2b29df5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:37.484252 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b439d9-9cfe-4706-b564-dc4c2b29df5c admin admin] PATH_INFO: `/v3/projects/7286192eda0e48a190040ed11c230eb6` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:37.485419 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b439d9-9cfe-4706-b564-dc4c2b29df5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7286192eda0e48a190040ed11c230eb6)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:37.487564 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b439d9-9cfe-4706-b564-dc4c2b29df5c admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:37.525888 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:37.545571 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06d0e8f-0501-44e7-ab35-72de9df01f04 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:37.551043 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab25693-16f9-49d0-bf8b-08f9bd71b0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:37.551330 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab25693-16f9-49d0-bf8b-08f9bd71b0bb admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:37.551852 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab25693-16f9-49d0-bf8b-08f9bd71b0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:37.552124 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab25693-16f9-49d0-bf8b-08f9bd71b0bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:37.553010 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab25693-16f9-49d0-bf8b-08f9bd71b0bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:37.555579 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab25693-16f9-49d0-bf8b-08f9bd71b0bb admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:37.603378 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 998/1982] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:30:37 2022] POST /identity/v3/projects => generated 385 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:30:37.605263 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab25693-16f9-49d0-bf8b-08f9bd71b0bb admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:37.630884 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-f1b439d9-9cfe-4706-b564-dc4c2b29df5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7286192eda0e48a190040ed11c230eb6', 'request_id': 'req-f1b439d9-9cfe-4706-b564-dc4c2b29df5c'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:37.653527 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-f1b439d9-9cfe-4706-b564-dc4c2b29df5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7286192eda0e48a190040ed11c230eb6', 'request_id': 'req-f1b439d9-9cfe-4706-b564-dc4c2b29df5c'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:37.662132 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-f1b439d9-9cfe-4706-b564-dc4c2b29df5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7286192eda0e48a190040ed11c230eb6', 'request_id': 'req-f1b439d9-9cfe-4706-b564-dc4c2b29df5c'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:37.690327 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-f1b439d9-9cfe-4706-b564-dc4c2b29df5c admin admin] The token cache is being invalidate because project 7286192eda0e48a190040ed11c230eb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:30:37.690659 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-f1b439d9-9cfe-4706-b564-dc4c2b29df5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:37.692340 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-f1b439d9-9cfe-4706-b564-dc4c2b29df5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:37.694406 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 985/1983] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:30:37 2022] DELETE /identity/v3/projects/7286192eda0e48a190040ed11c230eb6 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:30:37.700599 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b439d9-9cfe-4706-b564-dc4c2b29df5c admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:37.702537 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-f1b439d9-9cfe-4706-b564-dc4c2b29df5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:37.759365 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:37.760603 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab25693-16f9-49d0-bf8b-08f9bd71b0bb admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:37.772305 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0050eefd-7eab-4690-98dd-178b97953a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:37.774669 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0050eefd-7eab-4690-98dd-178b97953a92 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:37.776805 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0050eefd-7eab-4690-98dd-178b97953a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:37.777419 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0050eefd-7eab-4690-98dd-178b97953a92 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:37.778791 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0050eefd-7eab-4690-98dd-178b97953a92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:37.784396 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0050eefd-7eab-4690-98dd-178b97953a92 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:37.829893 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 999/1984] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:30:37 2022] POST /identity/v3/users => generated 299 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:30:37.834073 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0050eefd-7eab-4690-98dd-178b97953a92 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:37.836820 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b439d9-9cfe-4706-b564-dc4c2b29df5c admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:37.837932 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-0050eefd-7eab-4690-98dd-178b97953a92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:37.856370 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcabb10-bc3a-462e-aede-a21b39def5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:37.857411 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcabb10-bc3a-462e-aede-a21b39def5b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:37.857974 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcabb10-bc3a-462e-aede-a21b39def5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:37.858956 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcabb10-bc3a-462e-aede-a21b39def5b9 admin admin] PATH_INFO: `/v3/users/a51a149eca234553a8c0107eef476c47` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:37.860902 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcabb10-bc3a-462e-aede-a21b39def5b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a51a149eca234553a8c0107eef476c47)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:37.861856 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0050eefd-7eab-4690-98dd-178b97953a92 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:37.864806 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcabb10-bc3a-462e-aede-a21b39def5b9 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:37.876745 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec41a90c-4475-4e89-804a-28e974f6b943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:37.877381 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec41a90c-4475-4e89-804a-28e974f6b943 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:37.877663 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec41a90c-4475-4e89-804a-28e974f6b943 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:37.877937 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec41a90c-4475-4e89-804a-28e974f6b943 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:37.878654 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec41a90c-4475-4e89-804a-28e974f6b943 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:37.880613 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec41a90c-4475-4e89-804a-28e974f6b943 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:37.908934 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1000/1985] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:30:37 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 03:30:37.913400 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec41a90c-4475-4e89-804a-28e974f6b943 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:37.942549 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec41a90c-4475-4e89-804a-28e974f6b943 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:37.962113 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c5478f-9b12-465a-a575-119fbbdc04aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:37.963221 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c5478f-9b12-465a-a575-119fbbdc04aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:37.963877 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c5478f-9b12-465a-a575-119fbbdc04aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:37.964537 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c5478f-9b12-465a-a575-119fbbdc04aa admin admin] PATH_INFO: `/v3/projects/3ec26de497444637862d1ad22f753bce/users/6570cb9f81f94e48b313549d4ff02611/roles/fe9379cda35c4ff78576fe48b60bea3c` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:37.997831 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-5bcabb10-bc3a-462e-aede-a21b39def5b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a51a149eca234553a8c0107eef476c47'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:38.007525 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c5478f-9b12-465a-a575-119fbbdc04aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ec26de497444637862d1ad22f753bce, user_id=6570cb9f81f94e48b313549d4ff02611, role_id=fe9379cda35c4ff78576fe48b60bea3c)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:38.012349 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c5478f-9b12-465a-a575-119fbbdc04aa admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:38.017420 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-5bcabb10-bc3a-462e-aede-a21b39def5b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a51a149eca234553a8c0107eef476c47'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:38.037576 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-5bcabb10-bc3a-462e-aede-a21b39def5b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a51a149eca234553a8c0107eef476c47'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:38.038309 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-5bcabb10-bc3a-462e-aede-a21b39def5b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a51a149eca234553a8c0107eef476c47'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:38.071146 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1001/1986] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:30:37 2022] PUT /identity/v3/projects/3ec26de497444637862d1ad22f753bce/users/6570cb9f81f94e48b313549d4ff02611/roles/fe9379cda35c4ff78576fe48b60bea3c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:30:38.071146 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c5478f-9b12-465a-a575-119fbbdc04aa admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:38.071146 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-50c5478f-9b12-465a-a575-119fbbdc04aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:38.080008 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-5bcabb10-bc3a-462e-aede-a21b39def5b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a51a149eca234553a8c0107eef476c47'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:38.092860 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 986/1987] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:30:37 2022] DELETE /identity/v3/users/a51a149eca234553a8c0107eef476c47 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:30:38.094243 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcabb10-bc3a-462e-aede-a21b39def5b9 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:38.098060 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-5bcabb10-bc3a-462e-aede-a21b39def5b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:38.215544 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c5478f-9b12-465a-a575-119fbbdc04aa admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:38.254982 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcabb10-bc3a-462e-aede-a21b39def5b9 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:38.271600 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d1074c-5548-4c40-9577-2762b0363765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:38.273316 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1074c-5548-4c40-9577-2762b0363765 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:38.273316 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1074c-5548-4c40-9577-2762b0363765 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:38.273316 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1074c-5548-4c40-9577-2762b0363765 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:38.273597 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d1074c-5548-4c40-9577-2762b0363765 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:38.275461 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d1074c-5548-4c40-9577-2762b0363765 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:38.289454 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:38.295481 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 987/1988] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:30:38 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:30:38.300508 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d1074c-5548-4c40-9577-2762b0363765 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:38.322058 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d1074c-5548-4c40-9577-2762b0363765 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:38.327359 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73281491-de16-4c0b-a45a-2bca3be9b9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:38.328542 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73281491-de16-4c0b-a45a-2bca3be9b9e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:38.328838 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73281491-de16-4c0b-a45a-2bca3be9b9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:38.329118 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73281491-de16-4c0b-a45a-2bca3be9b9e5 admin admin] PATH_INFO: `/v3/projects/3ec26de497444637862d1ad22f753bce/users/6570cb9f81f94e48b313549d4ff02611/roles/fe9379cda35c4ff78576fe48b60bea3c` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:38.332700 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73281491-de16-4c0b-a45a-2bca3be9b9e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ec26de497444637862d1ad22f753bce, user_id=6570cb9f81f94e48b313549d4ff02611, role_id=fe9379cda35c4ff78576fe48b60bea3c)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:38.339950 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73281491-de16-4c0b-a45a-2bca3be9b9e5 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:38.359574 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 988/1989] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:30:38 2022] PUT /identity/v3/projects/3ec26de497444637862d1ad22f753bce/users/6570cb9f81f94e48b313549d4ff02611/roles/fe9379cda35c4ff78576fe48b60bea3c => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 03:30:38.367154 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398d49a0-9d18-423d-8c52-db5a2a0303d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:38.367919 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d49a0-9d18-423d-8c52-db5a2a0303d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:38.368204 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d49a0-9d18-423d-8c52-db5a2a0303d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:38.368484 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d49a0-9d18-423d-8c52-db5a2a0303d7 admin admin] PATH_INFO: `/v3/users/5bdb99bf98a241e096296f8ad322eb59` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:38.369323 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8b0fc-7c9b-4b67-a45e-d5462091bd2c None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:38.370406 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8b0fc-7c9b-4b67-a45e-d5462091bd2c None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:38.370671 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398d49a0-9d18-423d-8c52-db5a2a0303d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bdb99bf98a241e096296f8ad322eb59)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:38.370781 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8b0fc-7c9b-4b67-a45e-d5462091bd2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:38.374454 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398d49a0-9d18-423d-8c52-db5a2a0303d7 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:38.431454 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-2ac8b0fc-7c9b-4b67-a45e-d5462091bd2c None None] MFA Rules not processed for user `6570cb9f81f94e48b313549d4ff02611`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:30:38.432832 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-2ac8b0fc-7c9b-4b67-a45e-d5462091bd2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:38.461013 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:38.481258 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-398d49a0-9d18-423d-8c52-db5a2a0303d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bdb99bf98a241e096296f8ad322eb59'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:38.483135 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-398d49a0-9d18-423d-8c52-db5a2a0303d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bdb99bf98a241e096296f8ad322eb59'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:38.500536 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-398d49a0-9d18-423d-8c52-db5a2a0303d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bdb99bf98a241e096296f8ad322eb59'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:38.501657 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-398d49a0-9d18-423d-8c52-db5a2a0303d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bdb99bf98a241e096296f8ad322eb59'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:38.526925 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-398d49a0-9d18-423d-8c52-db5a2a0303d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bdb99bf98a241e096296f8ad322eb59'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:38.552384 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1002/1990] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:30:38 2022] DELETE /identity/v3/users/5bdb99bf98a241e096296f8ad322eb59 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:30:38.559831 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d4cf0-f256-4350-8fcf-37cb2b707659 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:38.560727 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d4cf0-f256-4350-8fcf-37cb2b707659 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:38.561008 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d4cf0-f256-4350-8fcf-37cb2b707659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:38.586740 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 989/1991] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:30:38 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:30:38.600904 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac8b0fc-7c9b-4b67-a45e-d5462091bd2c None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:38.606576 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-2ac8b0fc-7c9b-4b67-a45e-d5462091bd2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:38.620216 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-0c9d4cf0-f256-4350-8fcf-37cb2b707659 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:30:38.621866 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-0c9d4cf0-f256-4350-8fcf-37cb2b707659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:38.720729 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac8b0fc-7c9b-4b67-a45e-d5462091bd2c None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:38.747796 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1003/1992] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:30:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:30:38.747796 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9d4cf0-f256-4350-8fcf-37cb2b707659 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:38.747796 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-0c9d4cf0-f256-4350-8fcf-37cb2b707659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:38.762388 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9d4cf0-f256-4350-8fcf-37cb2b707659 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:38.771870 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83508153-3fb7-4548-8503-1dd99869d555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:38.772433 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83508153-3fb7-4548-8503-1dd99869d555 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:38.772711 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83508153-3fb7-4548-8503-1dd99869d555 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:38.772990 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83508153-3fb7-4548-8503-1dd99869d555 admin admin] PATH_INFO: `/v3/projects/9ee50aefff1f41e6a21093b78ea673d2` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:38.776389 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83508153-3fb7-4548-8503-1dd99869d555 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ee50aefff1f41e6a21093b78ea673d2)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:38.779732 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83508153-3fb7-4548-8503-1dd99869d555 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:38.812824 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fa5efa-bb81-4b5a-82ec-9641c1414d67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f537aabf3d1040ff840b02616f839975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:38.813740 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa5efa-bb81-4b5a-82ec-9641c1414d67 service cinder] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:38.814022 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa5efa-bb81-4b5a-82ec-9641c1414d67 service cinder] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:38.814294 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa5efa-bb81-4b5a-82ec-9641c1414d67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:38.817135 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-27fa5efa-bb81-4b5a-82ec-9641c1414d67 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:38.861262 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-83508153-3fb7-4548-8503-1dd99869d555 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ee50aefff1f41e6a21093b78ea673d2', 'request_id': 'req-83508153-3fb7-4548-8503-1dd99869d555'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:38.865154 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:38.874466 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-83508153-3fb7-4548-8503-1dd99869d555 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ee50aefff1f41e6a21093b78ea673d2', 'request_id': 'req-83508153-3fb7-4548-8503-1dd99869d555'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:38.885639 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-83508153-3fb7-4548-8503-1dd99869d555 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ee50aefff1f41e6a21093b78ea673d2', 'request_id': 'req-83508153-3fb7-4548-8503-1dd99869d555'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:38.903200 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fa5efa-bb81-4b5a-82ec-9641c1414d67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:38.905359 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fa5efa-bb81-4b5a-82ec-9641c1414d67 service cinder] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:38.906283 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-83508153-3fb7-4548-8503-1dd99869d555 admin admin] The token cache is being invalidate because project 9ee50aefff1f41e6a21093b78ea673d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:30:38.906762 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-83508153-3fb7-4548-8503-1dd99869d555 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:38.907907 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-83508153-3fb7-4548-8503-1dd99869d555 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:38.911518 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1004/1993] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:30:38 2022] DELETE /identity/v3/projects/9ee50aefff1f41e6a21093b78ea673d2 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:30:38.912680 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83508153-3fb7-4548-8503-1dd99869d555 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:38.914714 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-83508153-3fb7-4548-8503-1dd99869d555 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:38.930491 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 990/1994] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:30:38 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 03:30:38.932332 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f7c6d-9101-4295-ad3f-5a697c8f8ed7 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:38.933042 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f7c6d-9101-4295-ad3f-5a697c8f8ed7 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:38.934417 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f7c6d-9101-4295-ad3f-5a697c8f8ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:38.964378 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-bd4f7c6d-9101-4295-ad3f-5a697c8f8ed7 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:30:38.967228 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-bd4f7c6d-9101-4295-ad3f-5a697c8f8ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:39.001745 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:39.061246 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83508153-3fb7-4548-8503-1dd99869d555 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:39.070187 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0799b8-81b1-4e43-acc4-3fdccae96576 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:39.071479 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0799b8-81b1-4e43-acc4-3fdccae96576 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:39.071788 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0799b8-81b1-4e43-acc4-3fdccae96576 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:39.072066 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0799b8-81b1-4e43-acc4-3fdccae96576 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:39.076795 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-6e0799b8-81b1-4e43-acc4-3fdccae96576 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:39.107210 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 991/1995] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:30:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:30:39.109236 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d65a5fa-7dd8-43ed-9b09-abaeee4b8b34 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:39.109531 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d65a5fa-7dd8-43ed-9b09-abaeee4b8b34 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:39.109813 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d65a5fa-7dd8-43ed-9b09-abaeee4b8b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:39.163307 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-2d65a5fa-7dd8-43ed-9b09-abaeee4b8b34 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:30:39.164917 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-2d65a5fa-7dd8-43ed-9b09-abaeee4b8b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:39.198338 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 992/1996] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:30:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 03:30:39.199420 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d65a5fa-7dd8-43ed-9b09-abaeee4b8b34 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:39.216333 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d65a5fa-7dd8-43ed-9b09-abaeee4b8b34 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:39.227752 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f44e73c-5722-4e37-9248-5a6541b0b7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:39.229050 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44e73c-5722-4e37-9248-5a6541b0b7fa admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:39.230564 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44e73c-5722-4e37-9248-5a6541b0b7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:39.231072 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44e73c-5722-4e37-9248-5a6541b0b7fa admin admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:39.232026 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f44e73c-5722-4e37-9248-5a6541b0b7fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:30:39.232627 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f44e73c-5722-4e37-9248-5a6541b0b7fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:39.236193 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f44e73c-5722-4e37-9248-5a6541b0b7fa admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:39.237862 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0799b8-81b1-4e43-acc4-3fdccae96576 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:39.240259 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0799b8-81b1-4e43-acc4-3fdccae96576 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:39.252164 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1005/1997] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:30:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:30:39.258408 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 993/1998] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 03:30:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:30:39.260337 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0799b8-81b1-4e43-acc4-3fdccae96576 service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:39.274266 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0799b8-81b1-4e43-acc4-3fdccae96576 service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:39.280473 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3002f553-550a-4a7a-aa38-51cfe6820efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:39.281093 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3002f553-550a-4a7a-aa38-51cfe6820efe admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:39.281445 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3002f553-550a-4a7a-aa38-51cfe6820efe admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:39.281782 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3002f553-550a-4a7a-aa38-51cfe6820efe admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:39.282815 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3002f553-550a-4a7a-aa38-51cfe6820efe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:39.284527 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3002f553-550a-4a7a-aa38-51cfe6820efe admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:39.345567 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f44e73c-5722-4e37-9248-5a6541b0b7fa admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:39.348518 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1006/1999] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:30:39 2022] POST /identity/v3/projects => generated 399 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:30:39.369329 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f44e73c-5722-4e37-9248-5a6541b0b7fa admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:39.521747 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eb21a0-f4a1-403f-8e67-17a60c791d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:39.522382 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eb21a0-f4a1-403f-8e67-17a60c791d88 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:39.522668 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eb21a0-f4a1-403f-8e67-17a60c791d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:39.522963 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eb21a0-f4a1-403f-8e67-17a60c791d88 admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:39.523799 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eb21a0-f4a1-403f-8e67-17a60c791d88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:39.525745 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eb21a0-f4a1-403f-8e67-17a60c791d88 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:39.586338 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 994/2000] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:30:39 2022] POST /identity/v3/users => generated 300 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:30:39.590174 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3002f553-550a-4a7a-aa38-51cfe6820efe admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:39.606349 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3002f553-550a-4a7a-aa38-51cfe6820efe admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:39.614436 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6916c7-6a10-4b19-9905-dfc2b31be64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:39.615213 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6916c7-6a10-4b19-9905-dfc2b31be64f admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:39.615611 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6916c7-6a10-4b19-9905-dfc2b31be64f admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:39.615995 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6916c7-6a10-4b19-9905-dfc2b31be64f admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:39.616804 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6916c7-6a10-4b19-9905-dfc2b31be64f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:39.619163 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6916c7-6a10-4b19-9905-dfc2b31be64f admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:39.655045 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1007/2001] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:30:39 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:30:39.659645 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eb21a0-f4a1-403f-8e67-17a60c791d88 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:39.677804 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eb21a0-f4a1-403f-8e67-17a60c791d88 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:39.681888 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfab91e2-ee1b-425a-a081-ed34ff148c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:39.682505 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab91e2-ee1b-425a-a081-ed34ff148c9f admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:39.682789 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab91e2-ee1b-425a-a081-ed34ff148c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:39.683067 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab91e2-ee1b-425a-a081-ed34ff148c9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:39.683817 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfab91e2-ee1b-425a-a081-ed34ff148c9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:39.685428 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfab91e2-ee1b-425a-a081-ed34ff148c9f admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:39.697112 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 995/2002] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:30:39 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:30:39.701398 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6916c7-6a10-4b19-9905-dfc2b31be64f admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:39.715282 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6916c7-6a10-4b19-9905-dfc2b31be64f admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:39.725813 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7377446e-ded8-4137-8e66-1a20cb9b0a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:39.726781 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7377446e-ded8-4137-8e66-1a20cb9b0a95 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:39.727133 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7377446e-ded8-4137-8e66-1a20cb9b0a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:39.727562 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7377446e-ded8-4137-8e66-1a20cb9b0a95 admin admin] PATH_INFO: `/v3/projects/8f8eb45ab18d462d9b1a00b0cdf4f22a/users/e9ac4b59eb5448c7bfa8ba15ec315695/roles/04d0e4575a28440eb4349b4a6565e8b8` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:39.746464 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7377446e-ded8-4137-8e66-1a20cb9b0a95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f8eb45ab18d462d9b1a00b0cdf4f22a, user_id=e9ac4b59eb5448c7bfa8ba15ec315695, role_id=04d0e4575a28440eb4349b4a6565e8b8)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:39.749527 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7377446e-ded8-4137-8e66-1a20cb9b0a95 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:39.770934 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1008/2003] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:30:39 2022] PUT /identity/v3/projects/8f8eb45ab18d462d9b1a00b0cdf4f22a/users/e9ac4b59eb5448c7bfa8ba15ec315695/roles/04d0e4575a28440eb4349b4a6565e8b8 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:30:39.780949 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a5154-dd19-4065-b3bd-14f9fb44088a None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:39.781759 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a5154-dd19-4065-b3bd-14f9fb44088a None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:39.782334 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a5154-dd19-4065-b3bd-14f9fb44088a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:39.854990 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-1a0a5154-dd19-4065-b3bd-14f9fb44088a None None] MFA Rules not processed for user `e9ac4b59eb5448c7bfa8ba15ec315695`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:30:39.856546 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-1a0a5154-dd19-4065-b3bd-14f9fb44088a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:39.935531 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 996/2004] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:30:39 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:30:39.938222 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7377446e-ded8-4137-8e66-1a20cb9b0a95 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:39.985419 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:40.009926 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0a5154-dd19-4065-b3bd-14f9fb44088a None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:40.014570 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-1a0a5154-dd19-4065-b3bd-14f9fb44088a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:40.034798 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0a5154-dd19-4065-b3bd-14f9fb44088a None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:40.041025 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7377446e-ded8-4137-8e66-1a20cb9b0a95 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:40.046442 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409e7e1c-916a-4672-94f6-f3bb89c41816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:40.047451 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e7e1c-916a-4672-94f6-f3bb89c41816 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:40.047718 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba471b9-1c66-415b-b650-c5b1cfb03a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:40.048210 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e7e1c-916a-4672-94f6-f3bb89c41816 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:40.048331 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba471b9-1c66-415b-b650-c5b1cfb03a72 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:40.048604 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba471b9-1c66-415b-b650-c5b1cfb03a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:40.048879 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba471b9-1c66-415b-b650-c5b1cfb03a72 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:40.049786 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e7e1c-916a-4672-94f6-f3bb89c41816 admin admin] PATH_INFO: `/v3/projects/66f902eeb78943fdb8bfaf3712eace9d` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:40.051369 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba471b9-1c66-415b-b650-c5b1cfb03a72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:40.052282 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409e7e1c-916a-4672-94f6-f3bb89c41816 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66f902eeb78943fdb8bfaf3712eace9d)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:40.054288 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba471b9-1c66-415b-b650-c5b1cfb03a72 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:40.054915 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409e7e1c-916a-4672-94f6-f3bb89c41816 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:40.057914 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:40.092440 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1009/2005] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:30:39 2022] POST /identity/v3/projects => generated 399 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:30:40.096338 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba471b9-1c66-415b-b650-c5b1cfb03a72 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:40.149905 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-409e7e1c-916a-4672-94f6-f3bb89c41816 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66f902eeb78943fdb8bfaf3712eace9d', 'request_id': 'req-409e7e1c-916a-4672-94f6-f3bb89c41816'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:40.159890 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-409e7e1c-916a-4672-94f6-f3bb89c41816 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66f902eeb78943fdb8bfaf3712eace9d', 'request_id': 'req-409e7e1c-916a-4672-94f6-f3bb89c41816'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:40.168141 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-409e7e1c-916a-4672-94f6-f3bb89c41816 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66f902eeb78943fdb8bfaf3712eace9d', 'request_id': 'req-409e7e1c-916a-4672-94f6-f3bb89c41816'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:40.192023 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba471b9-1c66-415b-b650-c5b1cfb03a72 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:40.197722 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-409e7e1c-916a-4672-94f6-f3bb89c41816 admin admin] The token cache is being invalidate because project 66f902eeb78943fdb8bfaf3712eace9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:30:40.198189 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-409e7e1c-916a-4672-94f6-f3bb89c41816 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:40.199647 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-409e7e1c-916a-4672-94f6-f3bb89c41816 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:40.204077 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 997/2006] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:30:40 2022] DELETE /identity/v3/projects/66f902eeb78943fdb8bfaf3712eace9d => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:30:40.283777 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cd8a49-12cc-4595-805e-86770b9ce6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:40.288237 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd8a49-12cc-4595-805e-86770b9ce6f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:40.289506 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd8a49-12cc-4595-805e-86770b9ce6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:40.290873 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd8a49-12cc-4595-805e-86770b9ce6f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:40.293239 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cd8a49-12cc-4595-805e-86770b9ce6f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:40.300061 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cd8a49-12cc-4595-805e-86770b9ce6f1 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:40.337551 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1010/2007] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:30:40 2022] POST /identity/v3/users => generated 306 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:30:40.343544 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409e7e1c-916a-4672-94f6-f3bb89c41816 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:40.343544 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-409e7e1c-916a-4672-94f6-f3bb89c41816 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:40.391211 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409e7e1c-916a-4672-94f6-f3bb89c41816 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:40.405995 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188ef3ff-104f-4041-a4d5-48bb2fcc6acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:40.407383 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ef3ff-104f-4041-a4d5-48bb2fcc6acc admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:40.407699 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ef3ff-104f-4041-a4d5-48bb2fcc6acc admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:40.407957 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ef3ff-104f-4041-a4d5-48bb2fcc6acc admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:40.408618 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188ef3ff-104f-4041-a4d5-48bb2fcc6acc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:40.410803 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188ef3ff-104f-4041-a4d5-48bb2fcc6acc admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:40.425139 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 998/2008] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:30:40 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:30:40.429132 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cd8a49-12cc-4595-805e-86770b9ce6f1 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:40.457393 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cd8a49-12cc-4595-805e-86770b9ce6f1 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:40.468003 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c703ca2-8fdd-4537-a949-98220ff00af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:40.468737 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c703ca2-8fdd-4537-a949-98220ff00af1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:40.469024 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c703ca2-8fdd-4537-a949-98220ff00af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:40.469442 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c703ca2-8fdd-4537-a949-98220ff00af1 admin admin] PATH_INFO: `/v3/projects/f06697e1a939445081dffc986df291cd/users/afbf5c9b70874f8a9c082c1e63fff01e/roles/fe9379cda35c4ff78576fe48b60bea3c` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:40.487436 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c703ca2-8fdd-4537-a949-98220ff00af1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f06697e1a939445081dffc986df291cd, user_id=afbf5c9b70874f8a9c082c1e63fff01e, role_id=fe9379cda35c4ff78576fe48b60bea3c)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:40.491137 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c703ca2-8fdd-4537-a949-98220ff00af1 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:40.505579 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1011/2009] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:30:40 2022] PUT /identity/v3/projects/f06697e1a939445081dffc986df291cd/users/afbf5c9b70874f8a9c082c1e63fff01e/roles/fe9379cda35c4ff78576fe48b60bea3c => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:30:40.509513 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188ef3ff-104f-4041-a4d5-48bb2fcc6acc admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:40.520358 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188ef3ff-104f-4041-a4d5-48bb2fcc6acc admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:40.600020 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f48039-66bb-46ce-8748-d3c49744cbb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:40.600864 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f48039-66bb-46ce-8748-d3c49744cbb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:40.601216 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f48039-66bb-46ce-8748-d3c49744cbb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:40.601557 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f48039-66bb-46ce-8748-d3c49744cbb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:40.602379 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f48039-66bb-46ce-8748-d3c49744cbb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:40.604267 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f48039-66bb-46ce-8748-d3c49744cbb3 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:40.622547 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 999/2010] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:30:40 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:30:40.623778 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c703ca2-8fdd-4537-a949-98220ff00af1 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:40.637293 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c703ca2-8fdd-4537-a949-98220ff00af1 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:40.642006 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a726e6-7e1e-4062-b003-1379566d1317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:40.642697 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a726e6-7e1e-4062-b003-1379566d1317 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:40.643159 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a726e6-7e1e-4062-b003-1379566d1317 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:40.643443 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a726e6-7e1e-4062-b003-1379566d1317 admin admin] PATH_INFO: `/v3/projects/f06697e1a939445081dffc986df291cd/users/afbf5c9b70874f8a9c082c1e63fff01e/roles/fe9379cda35c4ff78576fe48b60bea3c` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:40.649590 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a726e6-7e1e-4062-b003-1379566d1317 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f06697e1a939445081dffc986df291cd, user_id=afbf5c9b70874f8a9c082c1e63fff01e, role_id=fe9379cda35c4ff78576fe48b60bea3c)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:40.653596 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a726e6-7e1e-4062-b003-1379566d1317 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:40.671349 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1012/2011] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:30:40 2022] PUT /identity/v3/projects/f06697e1a939445081dffc986df291cd/users/afbf5c9b70874f8a9c082c1e63fff01e/roles/fe9379cda35c4ff78576fe48b60bea3c => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 03:30:40.678737 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1674c-622b-4bc4-a654-4840eacd7b8f None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:40.679028 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1674c-622b-4bc4-a654-4840eacd7b8f None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:40.679310 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1674c-622b-4bc4-a654-4840eacd7b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:40.723221 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-73f1674c-622b-4bc4-a654-4840eacd7b8f None None] MFA Rules not processed for user `afbf5c9b70874f8a9c082c1e63fff01e`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:30:40.725024 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-73f1674c-622b-4bc4-a654-4840eacd7b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:40.838493 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1000/2012] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:30:40 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:30:40.858246 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a726e6-7e1e-4062-b003-1379566d1317 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:40.868991 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-43a726e6-7e1e-4062-b003-1379566d1317 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:40.875119 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f1674c-622b-4bc4-a654-4840eacd7b8f None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:40.876558 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-73f1674c-622b-4bc4-a654-4840eacd7b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:40.882411 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:40.896509 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:40.941676 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a726e6-7e1e-4062-b003-1379566d1317 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:40.946501 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbaec57-bcbc-40cf-a9f2-8647a0600221 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f537aabf3d1040ff840b02616f839975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:40.947693 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbaec57-bcbc-40cf-a9f2-8647a0600221 service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:40.948086 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbaec57-bcbc-40cf-a9f2-8647a0600221 service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:40.948467 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbaec57-bcbc-40cf-a9f2-8647a0600221 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:40.950093 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f1674c-622b-4bc4-a654-4840eacd7b8f None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:40.954626 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181e11c1-206a-4b96-aa24-efa97046e38d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f537aabf3d1040ff840b02616f839975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:40.955295 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e11c1-206a-4b96-aa24-efa97046e38d service cinder] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:40.955624 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e11c1-206a-4b96-aa24-efa97046e38d service cinder] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:40.955910 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e11c1-206a-4b96-aa24-efa97046e38d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:40.961180 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbaec57-bcbc-40cf-a9f2-8647a0600221 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:40.961330 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-181e11c1-206a-4b96-aa24-efa97046e38d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:40.962804 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbaec57-bcbc-40cf-a9f2-8647a0600221 service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:40.974732 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1013/2013] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:30:40 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:30:41.041598 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181e11c1-206a-4b96-aa24-efa97046e38d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:41.043952 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181e11c1-206a-4b96-aa24-efa97046e38d service cinder] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:41.056271 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1001/2014] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:30:40 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 03:30:41.075936 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbaec57-bcbc-40cf-a9f2-8647a0600221 service cinder] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:41.087171 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbaec57-bcbc-40cf-a9f2-8647a0600221 service cinder] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:41.092423 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119d13d6-95e3-4b3f-9c18-f23d37bd759e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f537aabf3d1040ff840b02616f839975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:41.093034 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119d13d6-95e3-4b3f-9c18-f23d37bd759e service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:41.093824 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119d13d6-95e3-4b3f-9c18-f23d37bd759e service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:41.094036 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119d13d6-95e3-4b3f-9c18-f23d37bd759e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:41.097860 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-119d13d6-95e3-4b3f-9c18-f23d37bd759e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:41.179963 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119d13d6-95e3-4b3f-9c18-f23d37bd759e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:41.182738 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119d13d6-95e3-4b3f-9c18-f23d37bd759e service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:41.196939 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1014/2015] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:30:41 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:30:41.856193 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181e11c1-206a-4b96-aa24-efa97046e38d service cinder] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:41.867984 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181e11c1-206a-4b96-aa24-efa97046e38d service cinder] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:41.876094 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c137c8e0-f23d-41c1-9438-83b6ac16f3d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f537aabf3d1040ff840b02616f839975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:41.877165 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137c8e0-f23d-41c1-9438-83b6ac16f3d1 service cinder] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:41.877868 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137c8e0-f23d-41c1-9438-83b6ac16f3d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:41.878342 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137c8e0-f23d-41c1-9438-83b6ac16f3d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:41.881102 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-c137c8e0-f23d-41c1-9438-83b6ac16f3d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:41.999154 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c137c8e0-f23d-41c1-9438-83b6ac16f3d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:42.000867 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c137c8e0-f23d-41c1-9438-83b6ac16f3d1 service cinder] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:42.016632 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1002/2016] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:30:41 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 03:30:42.849556 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b835fb-0aa9-4093-959a-a002c582a24d None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:42.850637 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b835fb-0aa9-4093-959a-a002c582a24d None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:42.851043 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b835fb-0aa9-4093-959a-a002c582a24d None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:42.853367 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1015/2017] 10.222.0.25 () {54 vars in 921 bytes} [Tue Oct 4 03:30:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:30:42.863718 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d1d142-ba44-4ae8-9a0b-1c94a9e00f47 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:42.864171 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d1d142-ba44-4ae8-9a0b-1c94a9e00f47 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:42.864269 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d1d142-ba44-4ae8-9a0b-1c94a9e00f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:42.893086 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-41d1d142-ba44-4ae8-9a0b-1c94a9e00f47 None None] MFA Rules not processed for user `94513f6cd19f495e842deb3c13c3e4d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:30:42.893872 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-41d1d142-ba44-4ae8-9a0b-1c94a9e00f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:42.943851 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b835fb-0aa9-4093-959a-a002c582a24d None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:42.946030 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-b5b835fb-0aa9-4093-959a-a002c582a24d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:42.966967 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:42.994210 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1003/2018] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Oct 4 03:30:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:30:43.009343 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d1d142-ba44-4ae8-9a0b-1c94a9e00f47 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:43.010932 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-41d1d142-ba44-4ae8-9a0b-1c94a9e00f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:43.032068 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b835fb-0aa9-4093-959a-a002c582a24d None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:43.036059 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc72a9c-ff01-40b4-b9b4-a6b17b4a08cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:43.036772 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc72a9c-ff01-40b4-b9b4-a6b17b4a08cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:43.037055 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc72a9c-ff01-40b4-b9b4-a6b17b4a08cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:43.037312 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d1d142-ba44-4ae8-9a0b-1c94a9e00f47 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:43.037423 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc72a9c-ff01-40b4-b9b4-a6b17b4a08cb admin admin] PATH_INFO: `/v3/users/3e1b3303d5ca4f5e90176c05f35e70cd` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:43.038514 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc72a9c-ff01-40b4-b9b4-a6b17b4a08cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e1b3303d5ca4f5e90176c05f35e70cd)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:43.040529 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc72a9c-ff01-40b4-b9b4-a6b17b4a08cb admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:43.044190 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8ce24c-23ba-4b71-a050-3833b38e6de9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94513f6cd19f495e842deb3c13c3e4d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:43.045057 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ce24c-23ba-4b71-a050-3833b38e6de9 service placement] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:43.045436 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ce24c-23ba-4b71-a050-3833b38e6de9 service placement] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:43.045536 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ce24c-23ba-4b71-a050-3833b38e6de9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:43.060661 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8ce24c-23ba-4b71-a050-3833b38e6de9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:43.062252 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8ce24c-23ba-4b71-a050-3833b38e6de9 service placement] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:43.076236 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1004/2019] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:30:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 03:30:43.101230 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-afc72a9c-ff01-40b4-b9b4-a6b17b4a08cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e1b3303d5ca4f5e90176c05f35e70cd'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:43.102259 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-afc72a9c-ff01-40b4-b9b4-a6b17b4a08cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e1b3303d5ca4f5e90176c05f35e70cd'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:43.110195 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-afc72a9c-ff01-40b4-b9b4-a6b17b4a08cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e1b3303d5ca4f5e90176c05f35e70cd'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:43.110851 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-afc72a9c-ff01-40b4-b9b4-a6b17b4a08cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e1b3303d5ca4f5e90176c05f35e70cd'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:43.121128 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:43.133324 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-afc72a9c-ff01-40b4-b9b4-a6b17b4a08cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e1b3303d5ca4f5e90176c05f35e70cd'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:43.145840 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1016/2020] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:30:42 2022] DELETE /identity/v3/users/3e1b3303d5ca4f5e90176c05f35e70cd => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 03:30:43.343881 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8ce24c-23ba-4b71-a050-3833b38e6de9 service placement] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:43.358294 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8ce24c-23ba-4b71-a050-3833b38e6de9 service placement] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:43.430644 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc57b7db-a64f-42ac-ae8d-f8bda8811179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:43.431282 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57b7db-a64f-42ac-ae8d-f8bda8811179 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:43.431603 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57b7db-a64f-42ac-ae8d-f8bda8811179 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:43.431883 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57b7db-a64f-42ac-ae8d-f8bda8811179 admin admin] PATH_INFO: `/v3/projects/caaf5d7d94d442c28466101666bdcab0` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:43.433195 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc57b7db-a64f-42ac-ae8d-f8bda8811179 admin admin] RBAC: Authorizing `identity:delete_project(project_id=caaf5d7d94d442c28466101666bdcab0)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:43.435301 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc57b7db-a64f-42ac-ae8d-f8bda8811179 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:43.492809 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-fc57b7db-a64f-42ac-ae8d-f8bda8811179 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'caaf5d7d94d442c28466101666bdcab0', 'request_id': 'req-fc57b7db-a64f-42ac-ae8d-f8bda8811179'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:43.498722 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-fc57b7db-a64f-42ac-ae8d-f8bda8811179 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'caaf5d7d94d442c28466101666bdcab0', 'request_id': 'req-fc57b7db-a64f-42ac-ae8d-f8bda8811179'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:43.506166 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-fc57b7db-a64f-42ac-ae8d-f8bda8811179 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'caaf5d7d94d442c28466101666bdcab0', 'request_id': 'req-fc57b7db-a64f-42ac-ae8d-f8bda8811179'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:43.528238 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-fc57b7db-a64f-42ac-ae8d-f8bda8811179 admin admin] The token cache is being invalidate because project caaf5d7d94d442c28466101666bdcab0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:30:43.528680 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-fc57b7db-a64f-42ac-ae8d-f8bda8811179 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:43.529568 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-fc57b7db-a64f-42ac-ae8d-f8bda8811179 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:43.531841 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1005/2021] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:30:43 2022] DELETE /identity/v3/projects/caaf5d7d94d442c28466101666bdcab0 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:30:43.536454 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f9e2f-67ed-422e-bb4f-f6201d5482ba None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:43.537059 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f9e2f-67ed-422e-bb4f-f6201d5482ba None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:43.537335 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f9e2f-67ed-422e-bb4f-f6201d5482ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:43.559257 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-a82f9e2f-67ed-422e-bb4f-f6201d5482ba None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:30:43.560539 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-a82f9e2f-67ed-422e-bb4f-f6201d5482ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:43.628208 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1017/2022] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:30:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 03:30:43.636608 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c2444-7780-4c4a-a0f9-ba221aa6891a None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:43.636828 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c2444-7780-4c4a-a0f9-ba221aa6891a None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:43.637108 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c2444-7780-4c4a-a0f9-ba221aa6891a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:43.657544 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-0f2c2444-7780-4c4a-a0f9-ba221aa6891a None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:30:43.658923 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-0f2c2444-7780-4c4a-a0f9-ba221aa6891a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:43.667772 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1006/2023] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:30:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:30:43.672063 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82f9e2f-67ed-422e-bb4f-f6201d5482ba None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:43.681866 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82f9e2f-67ed-422e-bb4f-f6201d5482ba None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:43.686360 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444e1f34-b807-457c-b15f-25fdf5d85e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:43.686957 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e1f34-b807-457c-b15f-25fdf5d85e63 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:43.687238 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e1f34-b807-457c-b15f-25fdf5d85e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:43.687544 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e1f34-b807-457c-b15f-25fdf5d85e63 admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:43.688190 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444e1f34-b807-457c-b15f-25fdf5d85e63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:30:43.688494 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444e1f34-b807-457c-b15f-25fdf5d85e63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:43.690080 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444e1f34-b807-457c-b15f-25fdf5d85e63 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:43.701678 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1018/2024] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 03:30:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:30:43.705874 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2c2444-7780-4c4a-a0f9-ba221aa6891a None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:43.715795 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2c2444-7780-4c4a-a0f9-ba221aa6891a None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:43.720461 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffbec5e-6db1-4462-b97c-92bfdaf03cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:43.721045 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffbec5e-6db1-4462-b97c-92bfdaf03cb4 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:43.721329 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffbec5e-6db1-4462-b97c-92bfdaf03cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:43.721606 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffbec5e-6db1-4462-b97c-92bfdaf03cb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:43.722229 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffbec5e-6db1-4462-b97c-92bfdaf03cb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:43.724990 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffbec5e-6db1-4462-b97c-92bfdaf03cb4 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:43.753248 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1007/2025] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:30:43 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:30:43.757500 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444e1f34-b807-457c-b15f-25fdf5d85e63 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:43.767288 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444e1f34-b807-457c-b15f-25fdf5d85e63 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:43.825720 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d107c49e-d6f3-4053-a83d-5c31aa95bf90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:43.826320 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107c49e-d6f3-4053-a83d-5c31aa95bf90 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:43.826601 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107c49e-d6f3-4053-a83d-5c31aa95bf90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:43.826870 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107c49e-d6f3-4053-a83d-5c31aa95bf90 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:43.827517 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d107c49e-d6f3-4053-a83d-5c31aa95bf90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:43.829416 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d107c49e-d6f3-4053-a83d-5c31aa95bf90 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:43.850286 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1019/2026] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:30:43 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:30:43.854419 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffbec5e-6db1-4462-b97c-92bfdaf03cb4 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:43.866035 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffbec5e-6db1-4462-b97c-92bfdaf03cb4 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:43.870610 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e526644-036d-4d24-838a-725841b67e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:43.871224 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e526644-036d-4d24-838a-725841b67e0d admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:43.871523 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e526644-036d-4d24-838a-725841b67e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:43.871797 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e526644-036d-4d24-838a-725841b67e0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:43.872430 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e526644-036d-4d24-838a-725841b67e0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:43.874076 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e526644-036d-4d24-838a-725841b67e0d admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:43.883881 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1008/2027] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:30:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 03:30:43.887799 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d107c49e-d6f3-4053-a83d-5c31aa95bf90 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:43.897719 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d107c49e-d6f3-4053-a83d-5c31aa95bf90 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:43.902299 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b181741e-5bdc-476b-8dd6-09a688d75f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:43.902888 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181741e-5bdc-476b-8dd6-09a688d75f26 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:43.903170 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181741e-5bdc-476b-8dd6-09a688d75f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:43.903446 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181741e-5bdc-476b-8dd6-09a688d75f26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:43.904121 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b181741e-5bdc-476b-8dd6-09a688d75f26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:43.905684 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b181741e-5bdc-476b-8dd6-09a688d75f26 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:43.916623 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1020/2028] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:30:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:30:43.920578 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e526644-036d-4d24-838a-725841b67e0d admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:43.931172 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e526644-036d-4d24-838a-725841b67e0d admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:43.935808 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed50f66b-8a7c-49cb-83ed-1f62b35cb728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:43.936442 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50f66b-8a7c-49cb-83ed-1f62b35cb728 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:43.936720 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50f66b-8a7c-49cb-83ed-1f62b35cb728 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:43.936991 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50f66b-8a7c-49cb-83ed-1f62b35cb728 admin admin] PATH_INFO: `/v3/projects/d0d26936c0274ab599e3b7a8e8bf4350/users/1ae0221c8106472789c5bc8a13aa7fef/roles/04d0e4575a28440eb4349b4a6565e8b8` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:43.951913 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed50f66b-8a7c-49cb-83ed-1f62b35cb728 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0d26936c0274ab599e3b7a8e8bf4350, user_id=1ae0221c8106472789c5bc8a13aa7fef, role_id=04d0e4575a28440eb4349b4a6565e8b8)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:43.954619 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed50f66b-8a7c-49cb-83ed-1f62b35cb728 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:43.963389 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:43.968361 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1009/2029] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:30:43 2022] PUT /identity/v3/projects/d0d26936c0274ab599e3b7a8e8bf4350/users/1ae0221c8106472789c5bc8a13aa7fef/roles/04d0e4575a28440eb4349b4a6565e8b8 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:30:43.978723 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ecf50-0759-4528-b5e9-9c7a743e3b8f None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:43.979033 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ecf50-0759-4528-b5e9-9c7a743e3b8f None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:43.979312 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ecf50-0759-4528-b5e9-9c7a743e3b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:44.006842 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-ab6ecf50-0759-4528-b5e9-9c7a743e3b8f None None] MFA Rules not processed for user `1ae0221c8106472789c5bc8a13aa7fef`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:30:44.008083 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-ab6ecf50-0759-4528-b5e9-9c7a743e3b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:44.042017 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:44.080323 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1021/2030] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:30:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 03:30:44.087177 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed50f66b-8a7c-49cb-83ed-1f62b35cb728 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:44.153798 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed50f66b-8a7c-49cb-83ed-1f62b35cb728 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:44.158913 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e1f8fc-31a0-4d35-ae96-f2804d8e71b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:44.159626 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e1f8fc-31a0-4d35-ae96-f2804d8e71b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:44.160463 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e1f8fc-31a0-4d35-ae96-f2804d8e71b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:44.160733 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e1f8fc-31a0-4d35-ae96-f2804d8e71b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:44.161371 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e1f8fc-31a0-4d35-ae96-f2804d8e71b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:44.163274 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e1f8fc-31a0-4d35-ae96-f2804d8e71b8 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:44.191856 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1010/2031] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:30:44 2022] POST /identity/v3/projects => generated 371 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 03:30:44.196288 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6ecf50-0759-4528-b5e9-9c7a743e3b8f None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:44.207645 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6ecf50-0759-4528-b5e9-9c7a743e3b8f None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:44.268845 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d4964d-0e91-4a14-afa5-3e0e8eaebe01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:44.270243 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d4964d-0e91-4a14-afa5-3e0e8eaebe01 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:44.270550 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d4964d-0e91-4a14-afa5-3e0e8eaebe01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:44.270830 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d4964d-0e91-4a14-afa5-3e0e8eaebe01 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:44.272544 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d4964d-0e91-4a14-afa5-3e0e8eaebe01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:44.277707 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d4964d-0e91-4a14-afa5-3e0e8eaebe01 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:44.307343 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1022/2032] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:30:44 2022] POST /identity/v3/users => generated 292 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:30:44.313475 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e1f8fc-31a0-4d35-ae96-f2804d8e71b8 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:44.331432 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e1f8fc-31a0-4d35-ae96-f2804d8e71b8 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:44.338127 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b59a2e-5449-411c-80f5-ea3c94771591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:44.338939 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b59a2e-5449-411c-80f5-ea3c94771591 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:44.339283 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b59a2e-5449-411c-80f5-ea3c94771591 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:44.340237 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b59a2e-5449-411c-80f5-ea3c94771591 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:44.340352 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b59a2e-5449-411c-80f5-ea3c94771591 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:44.341968 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b59a2e-5449-411c-80f5-ea3c94771591 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:44.353648 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1011/2033] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:30:44 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:30:44.358606 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d4964d-0e91-4a14-afa5-3e0e8eaebe01 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:44.370615 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d4964d-0e91-4a14-afa5-3e0e8eaebe01 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:44.375749 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515836c2-7866-40ae-af5e-ffd1d559825d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:44.376593 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515836c2-7866-40ae-af5e-ffd1d559825d admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:44.376885 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515836c2-7866-40ae-af5e-ffd1d559825d admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:44.377156 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515836c2-7866-40ae-af5e-ffd1d559825d admin admin] PATH_INFO: `/v3/projects/55245d5b55ed4119a8c31044943103cb/users/9b378b2609d446d698c95c0de0f0cedc/roles/fe9379cda35c4ff78576fe48b60bea3c` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:44.394281 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515836c2-7866-40ae-af5e-ffd1d559825d admin admin] RBAC: Authorizing `identity:create_grant(project_id=55245d5b55ed4119a8c31044943103cb, user_id=9b378b2609d446d698c95c0de0f0cedc, role_id=fe9379cda35c4ff78576fe48b60bea3c)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:44.398073 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515836c2-7866-40ae-af5e-ffd1d559825d admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:44.412566 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1023/2034] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:30:44 2022] PUT /identity/v3/projects/55245d5b55ed4119a8c31044943103cb/users/9b378b2609d446d698c95c0de0f0cedc/roles/fe9379cda35c4ff78576fe48b60bea3c => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:30:44.416810 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b59a2e-5449-411c-80f5-ea3c94771591 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:44.428273 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b59a2e-5449-411c-80f5-ea3c94771591 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:44.490757 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab1acc4-626d-4d57-be18-a3392ef2ef60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:44.491391 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1acc4-626d-4d57-be18-a3392ef2ef60 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:44.491724 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1acc4-626d-4d57-be18-a3392ef2ef60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:44.491986 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1acc4-626d-4d57-be18-a3392ef2ef60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:44.492683 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab1acc4-626d-4d57-be18-a3392ef2ef60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:44.494271 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab1acc4-626d-4d57-be18-a3392ef2ef60 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:44.504300 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1012/2035] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:30:44 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:30:44.508629 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515836c2-7866-40ae-af5e-ffd1d559825d admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:44.518862 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515836c2-7866-40ae-af5e-ffd1d559825d admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:44.524215 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a716188-28bc-435c-aad5-307cdeba28d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:44.524875 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a716188-28bc-435c-aad5-307cdeba28d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:44.525476 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a716188-28bc-435c-aad5-307cdeba28d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:44.525594 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a716188-28bc-435c-aad5-307cdeba28d2 admin admin] PATH_INFO: `/v3/projects/55245d5b55ed4119a8c31044943103cb/users/9b378b2609d446d698c95c0de0f0cedc/roles/fe9379cda35c4ff78576fe48b60bea3c` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:44.527506 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a716188-28bc-435c-aad5-307cdeba28d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55245d5b55ed4119a8c31044943103cb, user_id=9b378b2609d446d698c95c0de0f0cedc, role_id=fe9379cda35c4ff78576fe48b60bea3c)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:44.530141 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a716188-28bc-435c-aad5-307cdeba28d2 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:44.543654 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1024/2036] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:30:44 2022] PUT /identity/v3/projects/55245d5b55ed4119a8c31044943103cb/users/9b378b2609d446d698c95c0de0f0cedc/roles/fe9379cda35c4ff78576fe48b60bea3c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 03:30:44.555324 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c3bfd7-95be-4683-ba28-07a7b7a5170b None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:44.556280 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c3bfd7-95be-4683-ba28-07a7b7a5170b None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:44.556560 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c3bfd7-95be-4683-ba28-07a7b7a5170b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:44.585830 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-08c3bfd7-95be-4683-ba28-07a7b7a5170b None None] MFA Rules not processed for user `9b378b2609d446d698c95c0de0f0cedc`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:30:44.587079 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-08c3bfd7-95be-4683-ba28-07a7b7a5170b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:44.654786 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:44.666392 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1013/2037] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:30:44 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:30:44.678906 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a716188-28bc-435c-aad5-307cdeba28d2 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:44.692100 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-6a716188-28bc-435c-aad5-307cdeba28d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:44.750710 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a716188-28bc-435c-aad5-307cdeba28d2 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:44.755645 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b5b72e-d823-4c44-8aae-b2134b31c012 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f537aabf3d1040ff840b02616f839975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:44.756356 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b5b72e-d823-4c44-8aae-b2134b31c012 service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:44.756761 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b5b72e-d823-4c44-8aae-b2134b31c012 service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:44.756931 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b5b72e-d823-4c44-8aae-b2134b31c012 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:44.766683 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b5b72e-d823-4c44-8aae-b2134b31c012 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:44.768200 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b5b72e-d823-4c44-8aae-b2134b31c012 service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:44.779098 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1025/2038] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:30:44 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:30:44.855774 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c3bfd7-95be-4683-ba28-07a7b7a5170b None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:44.857195 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-08c3bfd7-95be-4683-ba28-07a7b7a5170b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:44.869646 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c3bfd7-95be-4683-ba28-07a7b7a5170b None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:44.873859 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c68c44c-3dc8-4334-91bf-f6dffa910200 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f537aabf3d1040ff840b02616f839975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:44.874426 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68c44c-3dc8-4334-91bf-f6dffa910200 service cinder] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:44.874708 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68c44c-3dc8-4334-91bf-f6dffa910200 service cinder] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:44.874981 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68c44c-3dc8-4334-91bf-f6dffa910200 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:44.937413 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c68c44c-3dc8-4334-91bf-f6dffa910200 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:44.938843 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c68c44c-3dc8-4334-91bf-f6dffa910200 service cinder] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:44.948099 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1014/2039] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:30:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:30:45.500524 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b5b72e-d823-4c44-8aae-b2134b31c012 service cinder] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:45.502013 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-f3b5b72e-d823-4c44-8aae-b2134b31c012 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:45.537944 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:45.573770 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b5b72e-d823-4c44-8aae-b2134b31c012 service cinder] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:45.578335 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87164eb7-edf4-408d-bc76-7445ef8d2f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:45.578961 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87164eb7-edf4-408d-bc76-7445ef8d2f80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:45.579246 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87164eb7-edf4-408d-bc76-7445ef8d2f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:45.579550 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87164eb7-edf4-408d-bc76-7445ef8d2f80 admin admin] PATH_INFO: `/v3/users/e9ac4b59eb5448c7bfa8ba15ec315695` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:45.580683 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87164eb7-edf4-408d-bc76-7445ef8d2f80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9ac4b59eb5448c7bfa8ba15ec315695)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:45.583478 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87164eb7-edf4-408d-bc76-7445ef8d2f80 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:45.633612 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-87164eb7-edf4-408d-bc76-7445ef8d2f80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9ac4b59eb5448c7bfa8ba15ec315695'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:45.634271 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-87164eb7-edf4-408d-bc76-7445ef8d2f80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9ac4b59eb5448c7bfa8ba15ec315695'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:45.647551 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-87164eb7-edf4-408d-bc76-7445ef8d2f80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9ac4b59eb5448c7bfa8ba15ec315695'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:45.648290 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-87164eb7-edf4-408d-bc76-7445ef8d2f80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9ac4b59eb5448c7bfa8ba15ec315695'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:45.661497 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-87164eb7-edf4-408d-bc76-7445ef8d2f80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9ac4b59eb5448c7bfa8ba15ec315695'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:45.673367 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1026/2040] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:30:45 2022] DELETE /identity/v3/users/e9ac4b59eb5448c7bfa8ba15ec315695 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:30:45.678531 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99239d92-861d-4457-a298-1d649c0fa241 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:45.678817 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99239d92-861d-4457-a298-1d649c0fa241 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:45.679092 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99239d92-861d-4457-a298-1d649c0fa241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:45.698363 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-99239d92-861d-4457-a298-1d649c0fa241 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:30:45.699674 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-99239d92-861d-4457-a298-1d649c0fa241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:45.758325 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1015/2041] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:30:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:30:45.767984 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87164eb7-edf4-408d-bc76-7445ef8d2f80 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:45.769961 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-87164eb7-edf4-408d-bc76-7445ef8d2f80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:45.826358 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87164eb7-edf4-408d-bc76-7445ef8d2f80 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:45.829998 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba0d07a-2241-448d-a40b-9ab286416a86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:45.830595 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0d07a-2241-448d-a40b-9ab286416a86 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:45.830882 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0d07a-2241-448d-a40b-9ab286416a86 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:45.831155 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0d07a-2241-448d-a40b-9ab286416a86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:45.840902 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba0d07a-2241-448d-a40b-9ab286416a86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:45.842311 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba0d07a-2241-448d-a40b-9ab286416a86 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:45.852581 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1027/2042] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:30:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:30:46.027221 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99239d92-861d-4457-a298-1d649c0fa241 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:46.029209 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-99239d92-861d-4457-a298-1d649c0fa241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:46.041406 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99239d92-861d-4457-a298-1d649c0fa241 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:46.046480 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d85b67-9dce-499a-bfa9-cc5c6b6e75d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:46.047193 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d85b67-9dce-499a-bfa9-cc5c6b6e75d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:46.047573 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d85b67-9dce-499a-bfa9-cc5c6b6e75d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:46.048020 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d85b67-9dce-499a-bfa9-cc5c6b6e75d8 admin admin] PATH_INFO: `/v3/users/bb40abb0dd224dbea955ca6e35f07374` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:46.049223 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d85b67-9dce-499a-bfa9-cc5c6b6e75d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb40abb0dd224dbea955ca6e35f07374)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:46.051959 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d85b67-9dce-499a-bfa9-cc5c6b6e75d8 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:46.109472 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-b8d85b67-9dce-499a-bfa9-cc5c6b6e75d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb40abb0dd224dbea955ca6e35f07374'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:46.119157 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-b8d85b67-9dce-499a-bfa9-cc5c6b6e75d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb40abb0dd224dbea955ca6e35f07374'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:46.130703 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-b8d85b67-9dce-499a-bfa9-cc5c6b6e75d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb40abb0dd224dbea955ca6e35f07374'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:46.131793 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-b8d85b67-9dce-499a-bfa9-cc5c6b6e75d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb40abb0dd224dbea955ca6e35f07374'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:46.143959 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba0d07a-2241-448d-a40b-9ab286416a86 service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:46.146813 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-cba0d07a-2241-448d-a40b-9ab286416a86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:46.149232 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-b8d85b67-9dce-499a-bfa9-cc5c6b6e75d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb40abb0dd224dbea955ca6e35f07374'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:46.158692 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1016/2043] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:30:46 2022] DELETE /identity/v3/users/bb40abb0dd224dbea955ca6e35f07374 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:30:46.165241 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705df0b3-8325-4e92-b269-fbe6bf1efa3a None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:46.165742 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705df0b3-8325-4e92-b269-fbe6bf1efa3a None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:46.166168 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705df0b3-8325-4e92-b269-fbe6bf1efa3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:46.181023 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba0d07a-2241-448d-a40b-9ab286416a86 service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:46.182654 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:46.189234 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-705df0b3-8325-4e92-b269-fbe6bf1efa3a None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:30:46.192162 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-705df0b3-8325-4e92-b269-fbe6bf1efa3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:46.241315 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:46.255033 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f2529e-71ca-4275-9cc5-3d496964e3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:46.255838 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f2529e-71ca-4275-9cc5-3d496964e3b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:46.256252 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f2529e-71ca-4275-9cc5-3d496964e3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:46.256534 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f2529e-71ca-4275-9cc5-3d496964e3b8 admin admin] PATH_INFO: `/v3/projects/8f8eb45ab18d462d9b1a00b0cdf4f22a` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:46.257693 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f2529e-71ca-4275-9cc5-3d496964e3b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f8eb45ab18d462d9b1a00b0cdf4f22a)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:46.259618 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f2529e-71ca-4275-9cc5-3d496964e3b8 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:46.263317 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1017/2044] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:30:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:30:46.275823 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705df0b3-8325-4e92-b269-fbe6bf1efa3a None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:46.277241 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-705df0b3-8325-4e92-b269-fbe6bf1efa3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:46.320775 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-f2f2529e-71ca-4275-9cc5-3d496964e3b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f8eb45ab18d462d9b1a00b0cdf4f22a', 'request_id': 'req-f2f2529e-71ca-4275-9cc5-3d496964e3b8'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:46.332087 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-f2f2529e-71ca-4275-9cc5-3d496964e3b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f8eb45ab18d462d9b1a00b0cdf4f22a', 'request_id': 'req-f2f2529e-71ca-4275-9cc5-3d496964e3b8'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:46.339434 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-f2f2529e-71ca-4275-9cc5-3d496964e3b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f8eb45ab18d462d9b1a00b0cdf4f22a', 'request_id': 'req-f2f2529e-71ca-4275-9cc5-3d496964e3b8'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:46.344103 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705df0b3-8325-4e92-b269-fbe6bf1efa3a None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:46.356209 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-f2f2529e-71ca-4275-9cc5-3d496964e3b8 admin admin] The token cache is being invalidate because project 8f8eb45ab18d462d9b1a00b0cdf4f22a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:30:46.356533 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-f2f2529e-71ca-4275-9cc5-3d496964e3b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:46.357316 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-f2f2529e-71ca-4275-9cc5-3d496964e3b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:46.359165 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1028/2045] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:30:46 2022] DELETE /identity/v3/projects/8f8eb45ab18d462d9b1a00b0cdf4f22a => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:30:46.364381 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f2529e-71ca-4275-9cc5-3d496964e3b8 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:46.365689 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-f2f2529e-71ca-4275-9cc5-3d496964e3b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:46.407723 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6740eaee-04ac-4a7f-af6d-69bafb98153e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:46.408555 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6740eaee-04ac-4a7f-af6d-69bafb98153e service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:46.409031 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6740eaee-04ac-4a7f-af6d-69bafb98153e service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:46.409388 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6740eaee-04ac-4a7f-af6d-69bafb98153e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:46.412013 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-6740eaee-04ac-4a7f-af6d-69bafb98153e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:46.451360 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f2529e-71ca-4275-9cc5-3d496964e3b8 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:46.465812 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a96862d-6225-47ea-ad72-8c65449d4c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:46.466675 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a96862d-6225-47ea-ad72-8c65449d4c82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:46.466967 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a96862d-6225-47ea-ad72-8c65449d4c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:46.467302 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a96862d-6225-47ea-ad72-8c65449d4c82 admin admin] PATH_INFO: `/v3/users/afbf5c9b70874f8a9c082c1e63fff01e` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:46.468653 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a96862d-6225-47ea-ad72-8c65449d4c82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afbf5c9b70874f8a9c082c1e63fff01e)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:46.471000 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a96862d-6225-47ea-ad72-8c65449d4c82 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:46.498386 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6740eaee-04ac-4a7f-af6d-69bafb98153e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:46.500273 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6740eaee-04ac-4a7f-af6d-69bafb98153e service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:46.513894 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1018/2046] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:30:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:30:46.544202 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-9a96862d-6225-47ea-ad72-8c65449d4c82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afbf5c9b70874f8a9c082c1e63fff01e'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:46.545623 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-9a96862d-6225-47ea-ad72-8c65449d4c82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afbf5c9b70874f8a9c082c1e63fff01e'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:46.556969 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-9a96862d-6225-47ea-ad72-8c65449d4c82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afbf5c9b70874f8a9c082c1e63fff01e'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:46.558546 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-9a96862d-6225-47ea-ad72-8c65449d4c82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afbf5c9b70874f8a9c082c1e63fff01e'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:46.573548 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-9a96862d-6225-47ea-ad72-8c65449d4c82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afbf5c9b70874f8a9c082c1e63fff01e'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:46.583565 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:46.589031 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1029/2047] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:30:46 2022] DELETE /identity/v3/users/afbf5c9b70874f8a9c082c1e63fff01e => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 03:30:46.836048 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6740eaee-04ac-4a7f-af6d-69bafb98153e service neutron] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:46.838684 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-6740eaee-04ac-4a7f-af6d-69bafb98153e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:46.853760 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6740eaee-04ac-4a7f-af6d-69bafb98153e service neutron] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:46.886414 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:46.936706 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78ff594-277f-45e3-9b8d-0bd0791797bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:46.937336 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ff594-277f-45e3-9b8d-0bd0791797bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:46.937618 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ff594-277f-45e3-9b8d-0bd0791797bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:46.937892 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ff594-277f-45e3-9b8d-0bd0791797bf admin admin] PATH_INFO: `/v3/projects/960758d5affe4ef5ab2d36f93bbde53d` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:46.939123 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78ff594-277f-45e3-9b8d-0bd0791797bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=960758d5affe4ef5ab2d36f93bbde53d)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:46.941574 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78ff594-277f-45e3-9b8d-0bd0791797bf admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:46.976319 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a96862d-6225-47ea-ad72-8c65449d4c82 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:46.977912 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-9a96862d-6225-47ea-ad72-8c65449d4c82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:46.995743 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a96862d-6225-47ea-ad72-8c65449d4c82 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:46.997167 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-a78ff594-277f-45e3-9b8d-0bd0791797bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '960758d5affe4ef5ab2d36f93bbde53d', 'request_id': 'req-a78ff594-277f-45e3-9b8d-0bd0791797bf'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:47.003288 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-a78ff594-277f-45e3-9b8d-0bd0791797bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '960758d5affe4ef5ab2d36f93bbde53d', 'request_id': 'req-a78ff594-277f-45e3-9b8d-0bd0791797bf'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:47.010203 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-a78ff594-277f-45e3-9b8d-0bd0791797bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '960758d5affe4ef5ab2d36f93bbde53d', 'request_id': 'req-a78ff594-277f-45e3-9b8d-0bd0791797bf'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:47.023521 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-a78ff594-277f-45e3-9b8d-0bd0791797bf admin admin] The token cache is being invalidate because project 960758d5affe4ef5ab2d36f93bbde53d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:30:47.023830 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-a78ff594-277f-45e3-9b8d-0bd0791797bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:47.024462 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-a78ff594-277f-45e3-9b8d-0bd0791797bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:47.026533 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1019/2048] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:30:46 2022] DELETE /identity/v3/projects/960758d5affe4ef5ab2d36f93bbde53d => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:30:47.030384 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78ff594-277f-45e3-9b8d-0bd0791797bf admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:47.031734 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-a78ff594-277f-45e3-9b8d-0bd0791797bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:47.058871 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8637eaed-47a0-4753-93ce-69d07ec51588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:47.059674 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637eaed-47a0-4753-93ce-69d07ec51588 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:47.060033 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637eaed-47a0-4753-93ce-69d07ec51588 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:47.060388 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637eaed-47a0-4753-93ce-69d07ec51588 admin admin] PATH_INFO: `/v3/projects/f06697e1a939445081dffc986df291cd` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:47.061546 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8637eaed-47a0-4753-93ce-69d07ec51588 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f06697e1a939445081dffc986df291cd)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:47.063454 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8637eaed-47a0-4753-93ce-69d07ec51588 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:47.098833 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78ff594-277f-45e3-9b8d-0bd0791797bf admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:47.114279 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-8637eaed-47a0-4753-93ce-69d07ec51588 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f06697e1a939445081dffc986df291cd', 'request_id': 'req-8637eaed-47a0-4753-93ce-69d07ec51588'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:47.120267 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-8637eaed-47a0-4753-93ce-69d07ec51588 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f06697e1a939445081dffc986df291cd', 'request_id': 'req-8637eaed-47a0-4753-93ce-69d07ec51588'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:47.126951 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-8637eaed-47a0-4753-93ce-69d07ec51588 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f06697e1a939445081dffc986df291cd', 'request_id': 'req-8637eaed-47a0-4753-93ce-69d07ec51588'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:47.141410 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-8637eaed-47a0-4753-93ce-69d07ec51588 admin admin] The token cache is being invalidate because project f06697e1a939445081dffc986df291cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:30:47.141701 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-8637eaed-47a0-4753-93ce-69d07ec51588 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:47.142784 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-8637eaed-47a0-4753-93ce-69d07ec51588 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:47.145006 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1030/2049] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:30:46 2022] DELETE /identity/v3/projects/f06697e1a939445081dffc986df291cd => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:30:47.149622 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa457ee-615d-4da4-963a-68112d9497ae None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:47.149910 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa457ee-615d-4da4-963a-68112d9497ae None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:47.150186 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa457ee-615d-4da4-963a-68112d9497ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:47.151394 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:47.164614 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89902f3e-b688-4077-b43f-e7486d8759ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:47.165248 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89902f3e-b688-4077-b43f-e7486d8759ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:47.165530 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89902f3e-b688-4077-b43f-e7486d8759ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:47.166158 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89902f3e-b688-4077-b43f-e7486d8759ad admin admin] PATH_INFO: `/v3/users/612bac3be4c040e88853193b3e3853c1` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:47.167066 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89902f3e-b688-4077-b43f-e7486d8759ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=612bac3be4c040e88853193b3e3853c1)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:47.169109 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89902f3e-b688-4077-b43f-e7486d8759ad admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:47.171478 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-5fa457ee-615d-4da4-963a-68112d9497ae None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:30:47.172767 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-5fa457ee-615d-4da4-963a-68112d9497ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:47.182180 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1031/2050] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:30:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 03:30:47.189625 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e0ce41-b0fd-4e2a-9c2f-02f08d5a3d59 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:47.189909 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e0ce41-b0fd-4e2a-9c2f-02f08d5a3d59 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:47.190183 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e0ce41-b0fd-4e2a-9c2f-02f08d5a3d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:47.211807 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-13e0ce41-b0fd-4e2a-9c2f-02f08d5a3d59 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:30:47.213008 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-13e0ce41-b0fd-4e2a-9c2f-02f08d5a3d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:47.220094 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-89902f3e-b688-4077-b43f-e7486d8759ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '612bac3be4c040e88853193b3e3853c1'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:47.221133 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1032/2051] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:30:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 03:30:47.225674 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e0ce41-b0fd-4e2a-9c2f-02f08d5a3d59 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:47.227581 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-89902f3e-b688-4077-b43f-e7486d8759ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '612bac3be4c040e88853193b3e3853c1'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:47.234626 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e0ce41-b0fd-4e2a-9c2f-02f08d5a3d59 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:47.236432 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-89902f3e-b688-4077-b43f-e7486d8759ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '612bac3be4c040e88853193b3e3853c1'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:47.237137 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-89902f3e-b688-4077-b43f-e7486d8759ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '612bac3be4c040e88853193b3e3853c1'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:47.240509 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b9ff2-e2a7-42ae-98e1-b363d8049970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:47.241092 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b9ff2-e2a7-42ae-98e1-b363d8049970 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:47.241376 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b9ff2-e2a7-42ae-98e1-b363d8049970 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:47.241651 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b9ff2-e2a7-42ae-98e1-b363d8049970 admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:47.242290 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6b9ff2-e2a7-42ae-98e1-b363d8049970 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:30:47.242595 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6b9ff2-e2a7-42ae-98e1-b363d8049970 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:47.244208 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6b9ff2-e2a7-42ae-98e1-b363d8049970 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:47.250443 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-89902f3e-b688-4077-b43f-e7486d8759ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '612bac3be4c040e88853193b3e3853c1'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:47.256500 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1033/2052] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 03:30:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:30:47.257075 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1020/2053] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:30:47 2022] DELETE /identity/v3/users/612bac3be4c040e88853193b3e3853c1 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 03:30:47.260716 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b9ff2-e2a7-42ae-98e1-b363d8049970 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:47.262490 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-7e6b9ff2-e2a7-42ae-98e1-b363d8049970 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:47.276322 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b9ff2-e2a7-42ae-98e1-b363d8049970 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:47.338068 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ade021b-ca5e-4407-b1e0-a9dcdc4383f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:47.338767 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ade021b-ca5e-4407-b1e0-a9dcdc4383f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:47.338981 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ade021b-ca5e-4407-b1e0-a9dcdc4383f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:47.339302 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ade021b-ca5e-4407-b1e0-a9dcdc4383f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:47.340000 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ade021b-ca5e-4407-b1e0-a9dcdc4383f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:47.341944 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ade021b-ca5e-4407-b1e0-a9dcdc4383f2 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:47.353133 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:47.377407 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1034/2054] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:30:47 2022] POST /identity/v3/projects => generated 365 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 03:30:47.378537 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89902f3e-b688-4077-b43f-e7486d8759ad admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:47.388949 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89902f3e-b688-4077-b43f-e7486d8759ad admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:47.450866 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c41b5d7-1ec0-478a-ac2a-39699e3cd1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:47.451808 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41b5d7-1ec0-478a-ac2a-39699e3cd1b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:47.452093 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41b5d7-1ec0-478a-ac2a-39699e3cd1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:47.452371 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41b5d7-1ec0-478a-ac2a-39699e3cd1b3 admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:47.453007 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c41b5d7-1ec0-478a-ac2a-39699e3cd1b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:47.454921 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c41b5d7-1ec0-478a-ac2a-39699e3cd1b3 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:47.477454 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1021/2055] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:30:47 2022] POST /identity/v3/users => generated 283 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 03:30:47.481584 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ade021b-ca5e-4407-b1e0-a9dcdc4383f2 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:47.492949 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ade021b-ca5e-4407-b1e0-a9dcdc4383f2 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:47.497727 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e513ace-0a57-407a-9f33-4d4da49883fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:47.498329 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e513ace-0a57-407a-9f33-4d4da49883fd admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:47.498615 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e513ace-0a57-407a-9f33-4d4da49883fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:47.498895 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e513ace-0a57-407a-9f33-4d4da49883fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:47.499577 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e513ace-0a57-407a-9f33-4d4da49883fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:47.501170 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e513ace-0a57-407a-9f33-4d4da49883fd admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:47.514602 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1035/2056] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:30:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:30:47.515870 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c41b5d7-1ec0-478a-ac2a-39699e3cd1b3 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:47.526919 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c41b5d7-1ec0-478a-ac2a-39699e3cd1b3 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:47.532961 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e04df45-8c9c-4076-8bd3-5adc55a95eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:47.533569 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e04df45-8c9c-4076-8bd3-5adc55a95eac admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:47.533875 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e04df45-8c9c-4076-8bd3-5adc55a95eac admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:47.534163 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e04df45-8c9c-4076-8bd3-5adc55a95eac admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:47.535000 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e04df45-8c9c-4076-8bd3-5adc55a95eac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:47.537379 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e04df45-8c9c-4076-8bd3-5adc55a95eac admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:47.546213 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e513ace-0a57-407a-9f33-4d4da49883fd admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:47.548125 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-9e513ace-0a57-407a-9f33-4d4da49883fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:47.552508 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1022/2057] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:30:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:30:47.553495 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e04df45-8c9c-4076-8bd3-5adc55a95eac admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:47.564282 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e513ace-0a57-407a-9f33-4d4da49883fd admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:47.564911 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e04df45-8c9c-4076-8bd3-5adc55a95eac admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:47.570342 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f6849f-c461-4ff9-a25a-28cfbbbb7d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:47.570975 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6849f-c461-4ff9-a25a-28cfbbbb7d66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:47.571362 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bb386b-e412-44ee-976a-ba3efe43212b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:47.571514 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6849f-c461-4ff9-a25a-28cfbbbb7d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:47.573271 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6849f-c461-4ff9-a25a-28cfbbbb7d66 admin admin] PATH_INFO: `/v3/projects/0b1a2a2328a44c7489347da2f0a8367e` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:47.573396 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb386b-e412-44ee-976a-ba3efe43212b admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:47.573505 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f6849f-c461-4ff9-a25a-28cfbbbb7d66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b1a2a2328a44c7489347da2f0a8367e)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:47.573595 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb386b-e412-44ee-976a-ba3efe43212b admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:47.573595 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb386b-e412-44ee-976a-ba3efe43212b admin admin] PATH_INFO: `/v3/projects/1bfca5167f8a4853a654f1b7c2abfede/users/b07b8563ea614640adf503b137948755/roles/04d0e4575a28440eb4349b4a6565e8b8` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:47.575143 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f6849f-c461-4ff9-a25a-28cfbbbb7d66 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:47.590684 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bb386b-e412-44ee-976a-ba3efe43212b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bfca5167f8a4853a654f1b7c2abfede, user_id=b07b8563ea614640adf503b137948755, role_id=04d0e4575a28440eb4349b4a6565e8b8)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:47.593428 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bb386b-e412-44ee-976a-ba3efe43212b admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:47.610298 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1023/2058] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:30:47 2022] PUT /identity/v3/projects/1bfca5167f8a4853a654f1b7c2abfede/users/b07b8563ea614640adf503b137948755/roles/04d0e4575a28440eb4349b4a6565e8b8 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:30:47.623430 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d5832c-5b16-445d-b901-b26ad530b584 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:47.623430 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d5832c-5b16-445d-b901-b26ad530b584 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:47.623689 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d5832c-5b16-445d-b901-b26ad530b584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:47.648581 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-d2f6849f-c461-4ff9-a25a-28cfbbbb7d66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b1a2a2328a44c7489347da2f0a8367e', 'request_id': 'req-d2f6849f-c461-4ff9-a25a-28cfbbbb7d66'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:47.654501 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-d2f6849f-c461-4ff9-a25a-28cfbbbb7d66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b1a2a2328a44c7489347da2f0a8367e', 'request_id': 'req-d2f6849f-c461-4ff9-a25a-28cfbbbb7d66'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:47.662753 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-d2f6849f-c461-4ff9-a25a-28cfbbbb7d66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b1a2a2328a44c7489347da2f0a8367e', 'request_id': 'req-d2f6849f-c461-4ff9-a25a-28cfbbbb7d66'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:47.667043 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-58d5832c-5b16-445d-b901-b26ad530b584 None None] MFA Rules not processed for user `b07b8563ea614640adf503b137948755`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:30:47.668421 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-58d5832c-5b16-445d-b901-b26ad530b584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:47.677928 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-d2f6849f-c461-4ff9-a25a-28cfbbbb7d66 admin admin] The token cache is being invalidate because project 0b1a2a2328a44c7489347da2f0a8367e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:30:47.678388 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-d2f6849f-c461-4ff9-a25a-28cfbbbb7d66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:47.679058 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-d2f6849f-c461-4ff9-a25a-28cfbbbb7d66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:47.683449 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1036/2059] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:30:47 2022] DELETE /identity/v3/projects/0b1a2a2328a44c7489347da2f0a8367e => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 03:30:47.685537 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f6849f-c461-4ff9-a25a-28cfbbbb7d66 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:47.685886 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:47.687269 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-d2f6849f-c461-4ff9-a25a-28cfbbbb7d66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:47.756368 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1024/2060] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:30:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 03:30:47.766879 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f6849f-c461-4ff9-a25a-28cfbbbb7d66 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:47.770224 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d5832c-5b16-445d-b901-b26ad530b584 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:47.772124 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-58d5832c-5b16-445d-b901-b26ad530b584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:47.775847 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb465d1-4ef3-4bbd-85a6-658bd01c063f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:47.776994 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb465d1-4ef3-4bbd-85a6-658bd01c063f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:47.777963 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb465d1-4ef3-4bbd-85a6-658bd01c063f admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:47.778226 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb465d1-4ef3-4bbd-85a6-658bd01c063f admin admin] PATH_INFO: `/v3/users/6570cb9f81f94e48b313549d4ff02611` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:47.780195 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb465d1-4ef3-4bbd-85a6-658bd01c063f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6570cb9f81f94e48b313549d4ff02611)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:47.784882 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb465d1-4ef3-4bbd-85a6-658bd01c063f admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:47.835301 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d5832c-5b16-445d-b901-b26ad530b584 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:47.839505 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652dc478-20e8-4d98-85d9-6ffb7ab570a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f537aabf3d1040ff840b02616f839975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:47.840283 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652dc478-20e8-4d98-85d9-6ffb7ab570a0 service cinder] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:47.840566 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652dc478-20e8-4d98-85d9-6ffb7ab570a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:47.840834 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652dc478-20e8-4d98-85d9-6ffb7ab570a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:47.848166 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-feb465d1-4ef3-4bbd-85a6-658bd01c063f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6570cb9f81f94e48b313549d4ff02611'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:47.848955 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-feb465d1-4ef3-4bbd-85a6-658bd01c063f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6570cb9f81f94e48b313549d4ff02611'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:47.851070 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652dc478-20e8-4d98-85d9-6ffb7ab570a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:47.853428 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652dc478-20e8-4d98-85d9-6ffb7ab570a0 service cinder] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:47.857633 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-feb465d1-4ef3-4bbd-85a6-658bd01c063f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6570cb9f81f94e48b313549d4ff02611'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:47.859253 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-feb465d1-4ef3-4bbd-85a6-658bd01c063f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6570cb9f81f94e48b313549d4ff02611'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:47.867399 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1025/2061] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:30:47 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:30:47.869753 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=81,keystone:INSERT=3,keystone:DELETE=16 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:47.875986 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-feb465d1-4ef3-4bbd-85a6-658bd01c063f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6570cb9f81f94e48b313549d4ff02611'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:47.895812 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1037/2062] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:30:47 2022] DELETE /identity/v3/users/6570cb9f81f94e48b313549d4ff02611 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:30:48.230509 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652dc478-20e8-4d98-85d9-6ffb7ab570a0 service cinder] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:48.250215 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652dc478-20e8-4d98-85d9-6ffb7ab570a0 service cinder] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:48.341596 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c3cc59-e533-4b4c-ac05-2979a41266cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:48.342230 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c3cc59-e533-4b4c-ac05-2979a41266cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:48.342518 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c3cc59-e533-4b4c-ac05-2979a41266cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:48.342794 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c3cc59-e533-4b4c-ac05-2979a41266cd admin admin] PATH_INFO: `/v3/projects/3ec26de497444637862d1ad22f753bce` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:48.343987 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c3cc59-e533-4b4c-ac05-2979a41266cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ec26de497444637862d1ad22f753bce)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:48.345946 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c3cc59-e533-4b4c-ac05-2979a41266cd admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:48.398410 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-84c3cc59-e533-4b4c-ac05-2979a41266cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ec26de497444637862d1ad22f753bce', 'request_id': 'req-84c3cc59-e533-4b4c-ac05-2979a41266cd'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:48.404659 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-84c3cc59-e533-4b4c-ac05-2979a41266cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ec26de497444637862d1ad22f753bce', 'request_id': 'req-84c3cc59-e533-4b4c-ac05-2979a41266cd'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:48.408054 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:48.417225 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-84c3cc59-e533-4b4c-ac05-2979a41266cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ec26de497444637862d1ad22f753bce', 'request_id': 'req-84c3cc59-e533-4b4c-ac05-2979a41266cd'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:48.430826 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-84c3cc59-e533-4b4c-ac05-2979a41266cd admin admin] The token cache is being invalidate because project 3ec26de497444637862d1ad22f753bce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:30:48.431104 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-84c3cc59-e533-4b4c-ac05-2979a41266cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:48.431734 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-84c3cc59-e533-4b4c-ac05-2979a41266cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:30:48.433196 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1026/2063] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:30:48 2022] DELETE /identity/v3/projects/3ec26de497444637862d1ad22f753bce => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:30:48.437989 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7ce6e-89a6-4903-94ac-0b2c864c88e4 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:48.438278 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7ce6e-89a6-4903-94ac-0b2c864c88e4 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:48.438553 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7ce6e-89a6-4903-94ac-0b2c864c88e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:48.458652 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-feb7ce6e-89a6-4903-94ac-0b2c864c88e4 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:30:48.459942 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-feb7ce6e-89a6-4903-94ac-0b2c864c88e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:48.520422 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1038/2064] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:30:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:30:48.529403 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a91eb-c032-48f2-8db4-b1506db38fbc None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:48.529722 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a91eb-c032-48f2-8db4-b1506db38fbc None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:48.530040 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a91eb-c032-48f2-8db4-b1506db38fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:48.549589 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-b56a91eb-c032-48f2-8db4-b1506db38fbc None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:30:48.550780 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-b56a91eb-c032-48f2-8db4-b1506db38fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:48.558866 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1027/2065] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:30:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:30:48.563641 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb7ce6e-89a6-4903-94ac-0b2c864c88e4 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:48.574876 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb7ce6e-89a6-4903-94ac-0b2c864c88e4 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:48.579437 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fd2497-d27b-4e55-829b-fa5cc3549799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:48.580055 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd2497-d27b-4e55-829b-fa5cc3549799 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:48.580338 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd2497-d27b-4e55-829b-fa5cc3549799 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:48.580612 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd2497-d27b-4e55-829b-fa5cc3549799 admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:48.581255 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fd2497-d27b-4e55-829b-fa5cc3549799 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:30:48.582241 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fd2497-d27b-4e55-829b-fa5cc3549799 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:48.584368 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fd2497-d27b-4e55-829b-fa5cc3549799 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:48.595782 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1039/2066] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 03:30:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:30:48.599997 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a91eb-c032-48f2-8db4-b1506db38fbc None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:48.609060 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a91eb-c032-48f2-8db4-b1506db38fbc None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:48.613962 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26531056-1cf0-4cea-93a2-0409543fc08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:48.614539 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26531056-1cf0-4cea-93a2-0409543fc08a admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:48.614817 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26531056-1cf0-4cea-93a2-0409543fc08a admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:48.615091 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26531056-1cf0-4cea-93a2-0409543fc08a admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:48.615759 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26531056-1cf0-4cea-93a2-0409543fc08a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:48.617686 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26531056-1cf0-4cea-93a2-0409543fc08a admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:48.646383 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1028/2067] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:30:48 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 03:30:48.650473 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fd2497-d27b-4e55-829b-fa5cc3549799 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:48.660416 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fd2497-d27b-4e55-829b-fa5cc3549799 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:48.715637 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e233a9-7419-4e11-9496-607b17bd6be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:48.716213 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e233a9-7419-4e11-9496-607b17bd6be3 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:48.716485 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e233a9-7419-4e11-9496-607b17bd6be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:48.716757 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e233a9-7419-4e11-9496-607b17bd6be3 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:48.717382 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e233a9-7419-4e11-9496-607b17bd6be3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:48.719261 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e233a9-7419-4e11-9496-607b17bd6be3 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:48.740259 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1040/2068] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:30:48 2022] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:30:48.745044 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26531056-1cf0-4cea-93a2-0409543fc08a admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:48.756139 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26531056-1cf0-4cea-93a2-0409543fc08a admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:48.760684 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3facf08a-a18e-4b2d-9f91-234a842519c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:48.761266 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3facf08a-a18e-4b2d-9f91-234a842519c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:48.761545 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3facf08a-a18e-4b2d-9f91-234a842519c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:48.761813 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3facf08a-a18e-4b2d-9f91-234a842519c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:48.762568 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3facf08a-a18e-4b2d-9f91-234a842519c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:48.764252 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3facf08a-a18e-4b2d-9f91-234a842519c5 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:48.774896 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1029/2069] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:30:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:30:48.778967 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e233a9-7419-4e11-9496-607b17bd6be3 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:48.796262 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e233a9-7419-4e11-9496-607b17bd6be3 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:48.801991 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958f60a0-ced2-411e-9c93-233a2179b4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:48.802675 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f60a0-ced2-411e-9c93-233a2179b4ae admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:48.802965 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f60a0-ced2-411e-9c93-233a2179b4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:48.803245 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f60a0-ced2-411e-9c93-233a2179b4ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:48.803934 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958f60a0-ced2-411e-9c93-233a2179b4ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:48.805560 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958f60a0-ced2-411e-9c93-233a2179b4ae admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:48.817517 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1041/2070] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:30:48 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:30:48.822567 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3facf08a-a18e-4b2d-9f91-234a842519c5 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:48.833148 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3facf08a-a18e-4b2d-9f91-234a842519c5 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:48.837892 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1389a7-1ac7-441b-b2b5-a46766c9c12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:48.838488 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1389a7-1ac7-441b-b2b5-a46766c9c12d admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:48.838770 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1389a7-1ac7-441b-b2b5-a46766c9c12d admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:48.839043 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1389a7-1ac7-441b-b2b5-a46766c9c12d admin admin] PATH_INFO: `/v3/projects/5424983f421548c3b6857a0e56aa08c6/users/72b10acbb8324d1e98d17fbaf7ed732a/roles/04d0e4575a28440eb4349b4a6565e8b8` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:48.853444 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1389a7-1ac7-441b-b2b5-a46766c9c12d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5424983f421548c3b6857a0e56aa08c6, user_id=72b10acbb8324d1e98d17fbaf7ed732a, role_id=04d0e4575a28440eb4349b4a6565e8b8)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:48.856102 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1389a7-1ac7-441b-b2b5-a46766c9c12d admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:48.870227 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1030/2071] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:30:48 2022] PUT /identity/v3/projects/5424983f421548c3b6857a0e56aa08c6/users/72b10acbb8324d1e98d17fbaf7ed732a/roles/04d0e4575a28440eb4349b4a6565e8b8 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:30:48.875177 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c378c-d7cf-415d-b3f7-5d8d61e889b5 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:48.875466 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c378c-d7cf-415d-b3f7-5d8d61e889b5 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:48.875771 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c378c-d7cf-415d-b3f7-5d8d61e889b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:48.895288 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-4b2c378c-d7cf-415d-b3f7-5d8d61e889b5 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:30:48.896503 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-4b2c378c-d7cf-415d-b3f7-5d8d61e889b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:48.939128 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:30:48.963652 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1042/2072] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:30:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:30:48.973860 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1389a7-1ac7-441b-b2b5-a46766c9c12d admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:48.975742 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-8d1389a7-1ac7-441b-b2b5-a46766c9c12d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:49.032941 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1389a7-1ac7-441b-b2b5-a46766c9c12d admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:49.037292 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb8b6aa-b97f-4a11-932e-873a0d363cff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:49.037895 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb8b6aa-b97f-4a11-932e-873a0d363cff service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:49.038178 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb8b6aa-b97f-4a11-932e-873a0d363cff service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:49.038451 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb8b6aa-b97f-4a11-932e-873a0d363cff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:49.047615 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb8b6aa-b97f-4a11-932e-873a0d363cff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:49.049040 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb8b6aa-b97f-4a11-932e-873a0d363cff service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:49.058509 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1031/2073] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:30:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 03:30:49.923816 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a74b6-bd10-4bce-8b5d-8c32472ae1c4 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:49.924286 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a74b6-bd10-4bce-8b5d-8c32472ae1c4 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:49.924441 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a74b6-bd10-4bce-8b5d-8c32472ae1c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:49.968578 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-377a74b6-bd10-4bce-8b5d-8c32472ae1c4 None None] MFA Rules not processed for user `72b10acbb8324d1e98d17fbaf7ed732a`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:30:49.969977 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-377a74b6-bd10-4bce-8b5d-8c32472ae1c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:50.043881 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1043/2074] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:30:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:30:50.056200 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb8b6aa-b97f-4a11-932e-873a0d363cff service neutron] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:30:50.057707 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-ccb8b6aa-b97f-4a11-932e-873a0d363cff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:50.117538 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb8b6aa-b97f-4a11-932e-873a0d363cff service neutron] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:30:50.121361 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e03292-9cef-437b-861e-f4be30d034f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f537aabf3d1040ff840b02616f839975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:30:50.121965 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e03292-9cef-437b-861e-f4be30d034f0 service cinder] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:50.122247 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e03292-9cef-437b-861e-f4be30d034f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:50.122521 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e03292-9cef-437b-861e-f4be30d034f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:50.131032 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e03292-9cef-437b-861e-f4be30d034f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:30:50.132487 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e03292-9cef-437b-861e-f4be30d034f0 service cinder] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:30:50.141261 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1032/2075] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:30:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:30:51.515592 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d04e89-2993-43aa-ad9f-5ea2c9f7c9f0 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:30:51.516105 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d04e89-2993-43aa-ad9f-5ea2c9f7c9f0 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:30:51.516195 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d04e89-2993-43aa-ad9f-5ea2c9f7c9f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:30:51.536238 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-61d04e89-2993-43aa-ad9f-5ea2c9f7c9f0 None None] MFA Rules not processed for user `72b10acbb8324d1e98d17fbaf7ed732a`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:30:51.537432 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-61d04e89-2993-43aa-ad9f-5ea2c9f7c9f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:30:51.544459 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1044/2076] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:30:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:31:00.137299 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=83,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:31:01.530231 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=41 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:31:06.150367 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c18e6e-16bf-43f0-a48a-cca92b4768c6 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:06.150881 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c18e6e-16bf-43f0-a48a-cca92b4768c6 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:06.150987 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c18e6e-16bf-43f0-a48a-cca92b4768c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:06.172153 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-62c18e6e-16bf-43f0-a48a-cca92b4768c6 None None] MFA Rules not processed for user `72b10acbb8324d1e98d17fbaf7ed732a`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:31:06.173348 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-62c18e6e-16bf-43f0-a48a-cca92b4768c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:31:06.180680 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1033/2077] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:31:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:31:15.094065 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d04e89-2993-43aa-ad9f-5ea2c9f7c9f0 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:15.096405 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-61d04e89-2993-43aa-ad9f-5ea2c9f7c9f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:31:15.110356 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d04e89-2993-43aa-ad9f-5ea2c9f7c9f0 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:15.120654 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef7f77f-dbd2-44f5-b8ba-87334c5c08c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:15.121624 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef7f77f-dbd2-44f5-b8ba-87334c5c08c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:15.125488 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef7f77f-dbd2-44f5-b8ba-87334c5c08c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:15.125980 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef7f77f-dbd2-44f5-b8ba-87334c5c08c9 admin admin] PATH_INFO: `/v3/users/1ae0221c8106472789c5bc8a13aa7fef` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:15.129877 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef7f77f-dbd2-44f5-b8ba-87334c5c08c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ae0221c8106472789c5bc8a13aa7fef)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:15.133592 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef7f77f-dbd2-44f5-b8ba-87334c5c08c9 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:15.202632 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-eef7f77f-dbd2-44f5-b8ba-87334c5c08c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ae0221c8106472789c5bc8a13aa7fef'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:15.203451 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-eef7f77f-dbd2-44f5-b8ba-87334c5c08c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ae0221c8106472789c5bc8a13aa7fef'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:15.214624 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-eef7f77f-dbd2-44f5-b8ba-87334c5c08c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ae0221c8106472789c5bc8a13aa7fef'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:15.215305 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-eef7f77f-dbd2-44f5-b8ba-87334c5c08c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ae0221c8106472789c5bc8a13aa7fef'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:15.231346 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-eef7f77f-dbd2-44f5-b8ba-87334c5c08c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ae0221c8106472789c5bc8a13aa7fef'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:15.252625 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1045/2078] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:31:15 2022] DELETE /identity/v3/users/1ae0221c8106472789c5bc8a13aa7fef => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:31:15.257390 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dffb4e-1dcd-4405-8a81-582c23c06d90 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:15.258332 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dffb4e-1dcd-4405-8a81-582c23c06d90 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:15.258771 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dffb4e-1dcd-4405-8a81-582c23c06d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:15.304929 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-52dffb4e-1dcd-4405-8a81-582c23c06d90 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:31:15.308116 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-52dffb4e-1dcd-4405-8a81-582c23c06d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:31:15.417801 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1034/2079] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:31:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:31:15.431687 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef7f77f-dbd2-44f5-b8ba-87334c5c08c9 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:15.431687 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-eef7f77f-dbd2-44f5-b8ba-87334c5c08c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:31:15.501703 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef7f77f-dbd2-44f5-b8ba-87334c5c08c9 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:15.507782 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1707bf-a81d-4245-b21f-bae894c95adb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:15.508551 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1707bf-a81d-4245-b21f-bae894c95adb service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:15.508728 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1707bf-a81d-4245-b21f-bae894c95adb service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:15.509048 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1707bf-a81d-4245-b21f-bae894c95adb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:15.519995 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1707bf-a81d-4245-b21f-bae894c95adb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:15.521718 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1707bf-a81d-4245-b21f-bae894c95adb service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:15.532617 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1046/2080] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:31:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:31:15.857930 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dffb4e-1dcd-4405-8a81-582c23c06d90 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:15.859375 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-52dffb4e-1dcd-4405-8a81-582c23c06d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:31:15.874249 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dffb4e-1dcd-4405-8a81-582c23c06d90 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:15.878980 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d60b333-9959-405c-8e94-14cf190185c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:15.880763 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d60b333-9959-405c-8e94-14cf190185c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:15.881164 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d60b333-9959-405c-8e94-14cf190185c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:15.881315 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d60b333-9959-405c-8e94-14cf190185c3 admin admin] PATH_INFO: `/v3/projects/d0d26936c0274ab599e3b7a8e8bf4350` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:15.883602 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d60b333-9959-405c-8e94-14cf190185c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0d26936c0274ab599e3b7a8e8bf4350)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:15.884883 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d60b333-9959-405c-8e94-14cf190185c3 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:15.933212 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-8d60b333-9959-405c-8e94-14cf190185c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0d26936c0274ab599e3b7a8e8bf4350', 'request_id': 'req-8d60b333-9959-405c-8e94-14cf190185c3'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:15.938763 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-8d60b333-9959-405c-8e94-14cf190185c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0d26936c0274ab599e3b7a8e8bf4350', 'request_id': 'req-8d60b333-9959-405c-8e94-14cf190185c3'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:15.945286 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-8d60b333-9959-405c-8e94-14cf190185c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0d26936c0274ab599e3b7a8e8bf4350', 'request_id': 'req-8d60b333-9959-405c-8e94-14cf190185c3'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:15.957671 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-8d60b333-9959-405c-8e94-14cf190185c3 admin admin] The token cache is being invalidate because project d0d26936c0274ab599e3b7a8e8bf4350 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:31:15.957964 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-8d60b333-9959-405c-8e94-14cf190185c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:15.958582 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-8d60b333-9959-405c-8e94-14cf190185c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:15.960804 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1035/2081] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:31:15 2022] DELETE /identity/v3/projects/d0d26936c0274ab599e3b7a8e8bf4350 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 03:31:15.964757 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1707bf-a81d-4245-b21f-bae894c95adb service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:15.974689 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1707bf-a81d-4245-b21f-bae894c95adb service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:16.032494 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b588d445-0f4e-4448-bd3b-e218e1ad0615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:16.033109 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b588d445-0f4e-4448-bd3b-e218e1ad0615 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:16.033388 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b588d445-0f4e-4448-bd3b-e218e1ad0615 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:16.033658 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b588d445-0f4e-4448-bd3b-e218e1ad0615 admin admin] PATH_INFO: `/v3/users/9b378b2609d446d698c95c0de0f0cedc` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:16.034764 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b588d445-0f4e-4448-bd3b-e218e1ad0615 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b378b2609d446d698c95c0de0f0cedc)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:16.036693 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b588d445-0f4e-4448-bd3b-e218e1ad0615 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:16.052365 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:31:16.085081 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-b588d445-0f4e-4448-bd3b-e218e1ad0615 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b378b2609d446d698c95c0de0f0cedc'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:16.085819 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-b588d445-0f4e-4448-bd3b-e218e1ad0615 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b378b2609d446d698c95c0de0f0cedc'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:16.094019 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-b588d445-0f4e-4448-bd3b-e218e1ad0615 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b378b2609d446d698c95c0de0f0cedc'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:16.094810 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-b588d445-0f4e-4448-bd3b-e218e1ad0615 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b378b2609d446d698c95c0de0f0cedc'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:16.108509 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-b588d445-0f4e-4448-bd3b-e218e1ad0615 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b378b2609d446d698c95c0de0f0cedc'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:16.121946 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1047/2082] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:31:15 2022] DELETE /identity/v3/users/9b378b2609d446d698c95c0de0f0cedc => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:31:16.390594 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d60b333-9959-405c-8e94-14cf190185c3 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:16.392099 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-8d60b333-9959-405c-8e94-14cf190185c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:31:16.405394 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d60b333-9959-405c-8e94-14cf190185c3 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:16.474991 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da70508-47d7-47e5-ac44-2f14c742ea7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:16.476832 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da70508-47d7-47e5-ac44-2f14c742ea7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:16.477945 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da70508-47d7-47e5-ac44-2f14c742ea7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:16.477945 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da70508-47d7-47e5-ac44-2f14c742ea7f admin admin] PATH_INFO: `/v3/projects/55245d5b55ed4119a8c31044943103cb` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:16.481111 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da70508-47d7-47e5-ac44-2f14c742ea7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=55245d5b55ed4119a8c31044943103cb)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:16.482104 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da70508-47d7-47e5-ac44-2f14c742ea7f admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:16.505810 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:31:16.542597 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-7da70508-47d7-47e5-ac44-2f14c742ea7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55245d5b55ed4119a8c31044943103cb', 'request_id': 'req-7da70508-47d7-47e5-ac44-2f14c742ea7f'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:16.548519 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-7da70508-47d7-47e5-ac44-2f14c742ea7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55245d5b55ed4119a8c31044943103cb', 'request_id': 'req-7da70508-47d7-47e5-ac44-2f14c742ea7f'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:16.556313 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-7da70508-47d7-47e5-ac44-2f14c742ea7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55245d5b55ed4119a8c31044943103cb', 'request_id': 'req-7da70508-47d7-47e5-ac44-2f14c742ea7f'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:16.572646 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-7da70508-47d7-47e5-ac44-2f14c742ea7f admin admin] The token cache is being invalidate because project 55245d5b55ed4119a8c31044943103cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:31:16.573350 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-7da70508-47d7-47e5-ac44-2f14c742ea7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:16.574303 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-7da70508-47d7-47e5-ac44-2f14c742ea7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:16.576420 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1036/2083] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:31:16 2022] DELETE /identity/v3/projects/55245d5b55ed4119a8c31044943103cb => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:31:16.581572 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da628992-3f17-4a2c-bc31-0f56f4387028 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:16.582080 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da628992-3f17-4a2c-bc31-0f56f4387028 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:16.582503 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da628992-3f17-4a2c-bc31-0f56f4387028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:16.606699 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-da628992-3f17-4a2c-bc31-0f56f4387028 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:31:16.607942 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-da628992-3f17-4a2c-bc31-0f56f4387028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:31:16.679915 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1048/2084] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:31:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 03:31:16.688200 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a4e01-219c-4181-a6b4-ba2cd0789500 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:16.688650 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a4e01-219c-4181-a6b4-ba2cd0789500 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:16.688981 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a4e01-219c-4181-a6b4-ba2cd0789500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:16.713265 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-132a4e01-219c-4181-a6b4-ba2cd0789500 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:31:16.714704 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-132a4e01-219c-4181-a6b4-ba2cd0789500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:31:16.724328 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1037/2085] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:31:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:31:16.729478 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da628992-3f17-4a2c-bc31-0f56f4387028 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:16.739478 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da628992-3f17-4a2c-bc31-0f56f4387028 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:16.745368 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97952c5-8f5e-47b1-b45d-79ee37cd586d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:16.745971 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97952c5-8f5e-47b1-b45d-79ee37cd586d admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:16.746256 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97952c5-8f5e-47b1-b45d-79ee37cd586d admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:16.746530 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97952c5-8f5e-47b1-b45d-79ee37cd586d admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:16.747177 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97952c5-8f5e-47b1-b45d-79ee37cd586d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:31:16.747508 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97952c5-8f5e-47b1-b45d-79ee37cd586d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:16.749094 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97952c5-8f5e-47b1-b45d-79ee37cd586d admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:16.765241 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1049/2086] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 03:31:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:31:16.766279 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132a4e01-219c-4181-a6b4-ba2cd0789500 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:16.776124 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132a4e01-219c-4181-a6b4-ba2cd0789500 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:16.781296 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d94882-390a-4f58-82bd-79a7fbaa79f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:16.781976 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d94882-390a-4f58-82bd-79a7fbaa79f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:16.782343 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d94882-390a-4f58-82bd-79a7fbaa79f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:16.782695 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d94882-390a-4f58-82bd-79a7fbaa79f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:16.783405 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d94882-390a-4f58-82bd-79a7fbaa79f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:16.785435 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d94882-390a-4f58-82bd-79a7fbaa79f6 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:16.819909 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1038/2087] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:31:16 2022] POST /identity/v3/projects => generated 363 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 03:31:16.821138 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97952c5-8f5e-47b1-b45d-79ee37cd586d admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:16.831284 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97952c5-8f5e-47b1-b45d-79ee37cd586d admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:16.890580 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a11d3-61c6-48d5-893c-a444f76f23a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:16.891182 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a11d3-61c6-48d5-893c-a444f76f23a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:16.891464 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a11d3-61c6-48d5-893c-a444f76f23a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:16.891765 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a11d3-61c6-48d5-893c-a444f76f23a7 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:16.892395 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6a11d3-61c6-48d5-893c-a444f76f23a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:16.894285 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6a11d3-61c6-48d5-893c-a444f76f23a7 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:16.920356 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1050/2088] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:31:16 2022] POST /identity/v3/users => generated 282 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:31:16.924772 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d94882-390a-4f58-82bd-79a7fbaa79f6 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:16.935302 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d94882-390a-4f58-82bd-79a7fbaa79f6 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:16.940044 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b64f61a-8a30-443b-a67a-a7d59329f4de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:16.940669 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b64f61a-8a30-443b-a67a-a7d59329f4de admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:16.940972 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b64f61a-8a30-443b-a67a-a7d59329f4de admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:16.941209 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b64f61a-8a30-443b-a67a-a7d59329f4de admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:16.941849 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b64f61a-8a30-443b-a67a-a7d59329f4de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:16.943733 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b64f61a-8a30-443b-a67a-a7d59329f4de admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:16.957153 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1039/2089] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:31:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:31:16.959396 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a11d3-61c6-48d5-893c-a444f76f23a7 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:16.975535 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a11d3-61c6-48d5-893c-a444f76f23a7 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:16.979261 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe59d02-36d5-4ff3-9ecc-6587ce678256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:16.979899 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe59d02-36d5-4ff3-9ecc-6587ce678256 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:16.980186 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe59d02-36d5-4ff3-9ecc-6587ce678256 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:16.980462 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe59d02-36d5-4ff3-9ecc-6587ce678256 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:16.981109 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe59d02-36d5-4ff3-9ecc-6587ce678256 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:16.982737 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe59d02-36d5-4ff3-9ecc-6587ce678256 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:16.988219 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:31:16.994652 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1051/2090] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:31:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:31:16.998840 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b64f61a-8a30-443b-a67a-a7d59329f4de admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:17.009539 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b64f61a-8a30-443b-a67a-a7d59329f4de admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:17.014207 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00947ed-c633-4b10-b5d2-90d9773d022a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:17.014846 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00947ed-c633-4b10-b5d2-90d9773d022a admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:17.015129 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00947ed-c633-4b10-b5d2-90d9773d022a admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:17.015456 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00947ed-c633-4b10-b5d2-90d9773d022a admin admin] PATH_INFO: `/v3/projects/78307f02663b41ddace0ca5b9ba845d0/users/295488210e8e49c18fee77df6ff26220/roles/04d0e4575a28440eb4349b4a6565e8b8` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:17.030355 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00947ed-c633-4b10-b5d2-90d9773d022a admin admin] RBAC: Authorizing `identity:create_grant(project_id=78307f02663b41ddace0ca5b9ba845d0, user_id=295488210e8e49c18fee77df6ff26220, role_id=04d0e4575a28440eb4349b4a6565e8b8)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:17.033015 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00947ed-c633-4b10-b5d2-90d9773d022a admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:17.046957 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1040/2091] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:31:16 2022] PUT /identity/v3/projects/78307f02663b41ddace0ca5b9ba845d0/users/295488210e8e49c18fee77df6ff26220/roles/04d0e4575a28440eb4349b4a6565e8b8 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:31:17.058514 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2ce85-02be-4ade-abeb-f32cdc9c462f None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:17.058805 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2ce85-02be-4ade-abeb-f32cdc9c462f None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:17.059088 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2ce85-02be-4ade-abeb-f32cdc9c462f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:17.087657 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-f4a2ce85-02be-4ade-abeb-f32cdc9c462f None None] MFA Rules not processed for user `295488210e8e49c18fee77df6ff26220`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:31:17.088872 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-f4a2ce85-02be-4ade-abeb-f32cdc9c462f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:31:17.151565 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1052/2092] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:31:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:31:17.156342 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00947ed-c633-4b10-b5d2-90d9773d022a admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:17.217821 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00947ed-c633-4b10-b5d2-90d9773d022a admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:17.222502 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e20a9c3-19fe-45c6-8481-13a9aeaa1de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:17.223092 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20a9c3-19fe-45c6-8481-13a9aeaa1de9 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:17.223372 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20a9c3-19fe-45c6-8481-13a9aeaa1de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:17.223675 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20a9c3-19fe-45c6-8481-13a9aeaa1de9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:17.224307 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e20a9c3-19fe-45c6-8481-13a9aeaa1de9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:17.226344 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e20a9c3-19fe-45c6-8481-13a9aeaa1de9 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:17.252245 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1041/2093] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:31:17 2022] POST /identity/v3/projects => generated 365 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:31:17.256494 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a2ce85-02be-4ade-abeb-f32cdc9c462f None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:17.268178 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a2ce85-02be-4ade-abeb-f32cdc9c462f None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:17.325186 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c54c645-2847-4247-b062-179ef244e259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:17.325787 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54c645-2847-4247-b062-179ef244e259 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:17.326070 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54c645-2847-4247-b062-179ef244e259 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:17.326346 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54c645-2847-4247-b062-179ef244e259 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:17.326987 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c54c645-2847-4247-b062-179ef244e259 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:17.328936 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c54c645-2847-4247-b062-179ef244e259 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:17.349429 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1053/2094] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:31:17 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:31:17.354145 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e20a9c3-19fe-45c6-8481-13a9aeaa1de9 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:17.364821 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e20a9c3-19fe-45c6-8481-13a9aeaa1de9 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:17.369781 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f49f69-52d7-4c5d-b76b-6dc91a4b39d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:17.370379 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f49f69-52d7-4c5d-b76b-6dc91a4b39d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:17.370657 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f49f69-52d7-4c5d-b76b-6dc91a4b39d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:17.370928 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f49f69-52d7-4c5d-b76b-6dc91a4b39d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:17.371587 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f49f69-52d7-4c5d-b76b-6dc91a4b39d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:17.373183 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f49f69-52d7-4c5d-b76b-6dc91a4b39d7 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:17.384458 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1042/2095] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:31:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:31:17.388804 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c54c645-2847-4247-b062-179ef244e259 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:17.399260 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c54c645-2847-4247-b062-179ef244e259 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:17.404095 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e025f2fe-a2e6-4616-9691-bda204be6334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:17.404750 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e025f2fe-a2e6-4616-9691-bda204be6334 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:17.405093 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e025f2fe-a2e6-4616-9691-bda204be6334 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:17.405373 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e025f2fe-a2e6-4616-9691-bda204be6334 admin admin] PATH_INFO: `/v3/projects/f78afcf033e24ae09e28a057a71a5fb2/users/12529cf4b4dc4b05b5125c056f12c6f1/roles/fe9379cda35c4ff78576fe48b60bea3c` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:17.421466 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e025f2fe-a2e6-4616-9691-bda204be6334 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f78afcf033e24ae09e28a057a71a5fb2, user_id=12529cf4b4dc4b05b5125c056f12c6f1, role_id=fe9379cda35c4ff78576fe48b60bea3c)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:17.424115 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e025f2fe-a2e6-4616-9691-bda204be6334 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:17.436829 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1054/2096] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:31:17 2022] PUT /identity/v3/projects/f78afcf033e24ae09e28a057a71a5fb2/users/12529cf4b4dc4b05b5125c056f12c6f1/roles/fe9379cda35c4ff78576fe48b60bea3c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 03:31:17.440920 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f49f69-52d7-4c5d-b76b-6dc91a4b39d7 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:17.451373 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f49f69-52d7-4c5d-b76b-6dc91a4b39d7 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:17.464307 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:31:17.510412 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5260003-4bbd-4baa-88e0-c1f392bb6d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:17.511020 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5260003-4bbd-4baa-88e0-c1f392bb6d2a admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:17.511334 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5260003-4bbd-4baa-88e0-c1f392bb6d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:17.511645 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5260003-4bbd-4baa-88e0-c1f392bb6d2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:17.512293 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5260003-4bbd-4baa-88e0-c1f392bb6d2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:17.514002 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5260003-4bbd-4baa-88e0-c1f392bb6d2a admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:17.525045 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1043/2097] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:31:17 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:31:17.529604 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e025f2fe-a2e6-4616-9691-bda204be6334 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:17.541071 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e025f2fe-a2e6-4616-9691-bda204be6334 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:17.546895 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a687f9-c0c2-40c8-b0c3-d662234ed0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:17.548180 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a687f9-c0c2-40c8-b0c3-d662234ed0e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:17.548467 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a687f9-c0c2-40c8-b0c3-d662234ed0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:17.548739 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a687f9-c0c2-40c8-b0c3-d662234ed0e7 admin admin] PATH_INFO: `/v3/projects/f78afcf033e24ae09e28a057a71a5fb2/users/12529cf4b4dc4b05b5125c056f12c6f1/roles/fe9379cda35c4ff78576fe48b60bea3c` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:17.550673 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a687f9-c0c2-40c8-b0c3-d662234ed0e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f78afcf033e24ae09e28a057a71a5fb2, user_id=12529cf4b4dc4b05b5125c056f12c6f1, role_id=fe9379cda35c4ff78576fe48b60bea3c)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:17.553515 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a687f9-c0c2-40c8-b0c3-d662234ed0e7 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:17.564369 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1055/2098] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:31:17 2022] PUT /identity/v3/projects/f78afcf033e24ae09e28a057a71a5fb2/users/12529cf4b4dc4b05b5125c056f12c6f1/roles/fe9379cda35c4ff78576fe48b60bea3c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:31:17.575787 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce687463-829f-4703-8b6d-b235cd0d0871 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:17.576105 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce687463-829f-4703-8b6d-b235cd0d0871 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:17.576415 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce687463-829f-4703-8b6d-b235cd0d0871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:17.608632 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-ce687463-829f-4703-8b6d-b235cd0d0871 None None] MFA Rules not processed for user `12529cf4b4dc4b05b5125c056f12c6f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:31:17.609875 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-ce687463-829f-4703-8b6d-b235cd0d0871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:31:17.750951 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1044/2099] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:31:17 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:31:17.764160 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a687f9-c0c2-40c8-b0c3-d662234ed0e7 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:17.765904 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-36a687f9-c0c2-40c8-b0c3-d662234ed0e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:31:17.822427 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:31:17.837811 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a687f9-c0c2-40c8-b0c3-d662234ed0e7 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:17.842019 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ede92a8-4b76-4b57-92a4-128a19d76a3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f537aabf3d1040ff840b02616f839975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:17.842648 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede92a8-4b76-4b57-92a4-128a19d76a3e service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:17.842925 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede92a8-4b76-4b57-92a4-128a19d76a3e service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:17.843261 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede92a8-4b76-4b57-92a4-128a19d76a3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:17.853163 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ede92a8-4b76-4b57-92a4-128a19d76a3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:17.854613 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ede92a8-4b76-4b57-92a4-128a19d76a3e service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:17.864113 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1056/2100] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:31:17 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:31:17.945704 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce687463-829f-4703-8b6d-b235cd0d0871 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:17.960752 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce687463-829f-4703-8b6d-b235cd0d0871 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:17.968544 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f01168-6631-446d-b044-65715ce14cc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f537aabf3d1040ff840b02616f839975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:17.969159 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f01168-6631-446d-b044-65715ce14cc8 service cinder] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:17.969442 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f01168-6631-446d-b044-65715ce14cc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:17.969738 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f01168-6631-446d-b044-65715ce14cc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:18.032780 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f01168-6631-446d-b044-65715ce14cc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:18.034340 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f01168-6631-446d-b044-65715ce14cc8 service cinder] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:18.044302 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1045/2101] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:31:17 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 03:31:20.949066 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ede92a8-4b76-4b57-92a4-128a19d76a3e service cinder] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:21.012090 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ede92a8-4b76-4b57-92a4-128a19d76a3e service cinder] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:21.016576 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0721bb24-a741-4821-8606-aa99b03b50eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:21.017183 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721bb24-a741-4821-8606-aa99b03b50eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:21.017460 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721bb24-a741-4821-8606-aa99b03b50eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:21.017754 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721bb24-a741-4821-8606-aa99b03b50eb admin admin] PATH_INFO: `/v3/users/295488210e8e49c18fee77df6ff26220` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:21.018872 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0721bb24-a741-4821-8606-aa99b03b50eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=295488210e8e49c18fee77df6ff26220)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:21.020795 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0721bb24-a741-4821-8606-aa99b03b50eb admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:21.068390 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-0721bb24-a741-4821-8606-aa99b03b50eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '295488210e8e49c18fee77df6ff26220'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:21.068980 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-0721bb24-a741-4821-8606-aa99b03b50eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '295488210e8e49c18fee77df6ff26220'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:21.077267 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-0721bb24-a741-4821-8606-aa99b03b50eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '295488210e8e49c18fee77df6ff26220'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:21.077893 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-0721bb24-a741-4821-8606-aa99b03b50eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '295488210e8e49c18fee77df6ff26220'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:21.091892 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-0721bb24-a741-4821-8606-aa99b03b50eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '295488210e8e49c18fee77df6ff26220'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:21.103986 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1057/2102] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:31:20 2022] DELETE /identity/v3/users/295488210e8e49c18fee77df6ff26220 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:31:21.108498 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf1ca5-3f84-4771-84c1-88f4f586926e None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:21.108965 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf1ca5-3f84-4771-84c1-88f4f586926e None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:21.109056 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf1ca5-3f84-4771-84c1-88f4f586926e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:21.129111 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-8bcf1ca5-3f84-4771-84c1-88f4f586926e None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:31:21.130306 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-8bcf1ca5-3f84-4771-84c1-88f4f586926e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:31:21.164661 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:31:21.193436 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1046/2103] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:31:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:31:21.204639 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0721bb24-a741-4821-8606-aa99b03b50eb admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:21.206703 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-0721bb24-a741-4821-8606-aa99b03b50eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:31:21.266216 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0721bb24-a741-4821-8606-aa99b03b50eb admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:21.269964 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64673f7-b2a2-4337-a689-e50853d0d227 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:21.270596 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64673f7-b2a2-4337-a689-e50853d0d227 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:21.270879 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64673f7-b2a2-4337-a689-e50853d0d227 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:21.271158 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64673f7-b2a2-4337-a689-e50853d0d227 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:21.280918 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64673f7-b2a2-4337-a689-e50853d0d227 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:21.282333 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64673f7-b2a2-4337-a689-e50853d0d227 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:21.292023 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1058/2104] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:31:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:31:21.587363 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcf1ca5-3f84-4771-84c1-88f4f586926e None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:21.589194 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-8bcf1ca5-3f84-4771-84c1-88f4f586926e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:31:21.625648 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcf1ca5-3f84-4771-84c1-88f4f586926e None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:21.640383 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689a2111-e0b1-4044-a2ef-201208d49006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:21.641030 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a2111-e0b1-4044-a2ef-201208d49006 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:21.641316 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a2111-e0b1-4044-a2ef-201208d49006 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:21.641887 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a2111-e0b1-4044-a2ef-201208d49006 admin admin] PATH_INFO: `/v3/projects/78307f02663b41ddace0ca5b9ba845d0` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:21.642756 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689a2111-e0b1-4044-a2ef-201208d49006 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78307f02663b41ddace0ca5b9ba845d0)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:21.650341 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689a2111-e0b1-4044-a2ef-201208d49006 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:21.729771 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-689a2111-e0b1-4044-a2ef-201208d49006 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78307f02663b41ddace0ca5b9ba845d0', 'request_id': 'req-689a2111-e0b1-4044-a2ef-201208d49006'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:21.739559 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-689a2111-e0b1-4044-a2ef-201208d49006 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78307f02663b41ddace0ca5b9ba845d0', 'request_id': 'req-689a2111-e0b1-4044-a2ef-201208d49006'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:21.747690 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-689a2111-e0b1-4044-a2ef-201208d49006 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78307f02663b41ddace0ca5b9ba845d0', 'request_id': 'req-689a2111-e0b1-4044-a2ef-201208d49006'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:21.765808 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-689a2111-e0b1-4044-a2ef-201208d49006 admin admin] The token cache is being invalidate because project 78307f02663b41ddace0ca5b9ba845d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:31:21.766123 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-689a2111-e0b1-4044-a2ef-201208d49006 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:21.766952 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-689a2111-e0b1-4044-a2ef-201208d49006 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:21.768728 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1047/2105] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:31:21 2022] DELETE /identity/v3/projects/78307f02663b41ddace0ca5b9ba845d0 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 03:31:21.773456 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64673f7-b2a2-4337-a689-e50853d0d227 service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:21.783919 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64673f7-b2a2-4337-a689-e50853d0d227 service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:21.788896 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:31:21.875843 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4739a65a-4c7c-448a-a475-97875cdf9299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:21.876489 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4739a65a-4c7c-448a-a475-97875cdf9299 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:21.876777 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4739a65a-4c7c-448a-a475-97875cdf9299 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:21.877056 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4739a65a-4c7c-448a-a475-97875cdf9299 admin admin] PATH_INFO: `/v3/users/12529cf4b4dc4b05b5125c056f12c6f1` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:21.878732 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4739a65a-4c7c-448a-a475-97875cdf9299 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12529cf4b4dc4b05b5125c056f12c6f1)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:21.882493 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4739a65a-4c7c-448a-a475-97875cdf9299 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:21.973550 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-4739a65a-4c7c-448a-a475-97875cdf9299 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12529cf4b4dc4b05b5125c056f12c6f1'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:21.974513 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-4739a65a-4c7c-448a-a475-97875cdf9299 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12529cf4b4dc4b05b5125c056f12c6f1'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:21.984514 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-4739a65a-4c7c-448a-a475-97875cdf9299 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12529cf4b4dc4b05b5125c056f12c6f1'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:21.985215 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-4739a65a-4c7c-448a-a475-97875cdf9299 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12529cf4b4dc4b05b5125c056f12c6f1'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:22.004968 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-4739a65a-4c7c-448a-a475-97875cdf9299 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12529cf4b4dc4b05b5125c056f12c6f1'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:22.020238 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1059/2106] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:31:21 2022] DELETE /identity/v3/users/12529cf4b4dc4b05b5125c056f12c6f1 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:31:22.564222 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689a2111-e0b1-4044-a2ef-201208d49006 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:22.566342 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-689a2111-e0b1-4044-a2ef-201208d49006 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:31:22.599672 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689a2111-e0b1-4044-a2ef-201208d49006 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:22.684137 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a336c12-786f-42d1-89f8-24a1a95508eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:22.684905 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a336c12-786f-42d1-89f8-24a1a95508eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:22.685181 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a336c12-786f-42d1-89f8-24a1a95508eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:22.685636 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a336c12-786f-42d1-89f8-24a1a95508eb admin admin] PATH_INFO: `/v3/projects/f78afcf033e24ae09e28a057a71a5fb2` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:22.686807 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a336c12-786f-42d1-89f8-24a1a95508eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f78afcf033e24ae09e28a057a71a5fb2)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:22.688771 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a336c12-786f-42d1-89f8-24a1a95508eb admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:22.750917 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-1a336c12-786f-42d1-89f8-24a1a95508eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f78afcf033e24ae09e28a057a71a5fb2', 'request_id': 'req-1a336c12-786f-42d1-89f8-24a1a95508eb'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:22.759620 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-1a336c12-786f-42d1-89f8-24a1a95508eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f78afcf033e24ae09e28a057a71a5fb2', 'request_id': 'req-1a336c12-786f-42d1-89f8-24a1a95508eb'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:22.767105 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-1a336c12-786f-42d1-89f8-24a1a95508eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f78afcf033e24ae09e28a057a71a5fb2', 'request_id': 'req-1a336c12-786f-42d1-89f8-24a1a95508eb'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:22.769297 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:31:22.792352 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-1a336c12-786f-42d1-89f8-24a1a95508eb admin admin] The token cache is being invalidate because project f78afcf033e24ae09e28a057a71a5fb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:31:22.792784 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-1a336c12-786f-42d1-89f8-24a1a95508eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:22.793941 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-1a336c12-786f-42d1-89f8-24a1a95508eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:22.796677 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1048/2107] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:31:22 2022] DELETE /identity/v3/projects/f78afcf033e24ae09e28a057a71a5fb2 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:31:22.802414 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0510cb-5322-4c09-bc94-4fe0dc094931 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:22.802779 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0510cb-5322-4c09-bc94-4fe0dc094931 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:22.803120 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0510cb-5322-4c09-bc94-4fe0dc094931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:22.831294 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-7d0510cb-5322-4c09-bc94-4fe0dc094931 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:31:22.831294 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-7d0510cb-5322-4c09-bc94-4fe0dc094931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:31:22.901637 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1060/2108] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:31:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:31:22.909670 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705b4c2-1183-46f9-9ac7-c816ea39b1cf None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:22.909963 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705b4c2-1183-46f9-9ac7-c816ea39b1cf None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:22.910247 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705b4c2-1183-46f9-9ac7-c816ea39b1cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:22.932754 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-7705b4c2-1183-46f9-9ac7-c816ea39b1cf None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:31:22.934130 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-7705b4c2-1183-46f9-9ac7-c816ea39b1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:31:22.942213 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1049/2109] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:31:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:31:22.947806 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0510cb-5322-4c09-bc94-4fe0dc094931 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:22.958585 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0510cb-5322-4c09-bc94-4fe0dc094931 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:22.964454 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3638c823-eacc-478f-be35-4b2150b3e296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:22.965313 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638c823-eacc-478f-be35-4b2150b3e296 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:22.965690 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638c823-eacc-478f-be35-4b2150b3e296 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:22.966084 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638c823-eacc-478f-be35-4b2150b3e296 admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:22.966871 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3638c823-eacc-478f-be35-4b2150b3e296 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:31:22.967298 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3638c823-eacc-478f-be35-4b2150b3e296 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:22.969201 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3638c823-eacc-478f-be35-4b2150b3e296 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:22.985440 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1061/2110] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 03:31:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:31:22.986750 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7705b4c2-1183-46f9-9ac7-c816ea39b1cf None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:22.998432 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7705b4c2-1183-46f9-9ac7-c816ea39b1cf None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:23.003879 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecab10fb-9331-4b04-b0ef-76905b3329ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:23.004578 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab10fb-9331-4b04-b0ef-76905b3329ce admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:23.004831 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab10fb-9331-4b04-b0ef-76905b3329ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:23.005170 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab10fb-9331-4b04-b0ef-76905b3329ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:23.005804 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecab10fb-9331-4b04-b0ef-76905b3329ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:23.008554 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecab10fb-9331-4b04-b0ef-76905b3329ce admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:23.043620 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1050/2111] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:31:22 2022] POST /identity/v3/projects => generated 379 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 03:31:23.045298 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3638c823-eacc-478f-be35-4b2150b3e296 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:23.056599 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3638c823-eacc-478f-be35-4b2150b3e296 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:23.068441 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:31:23.136194 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb974d4-bffa-4abb-b5da-c2d6b8ccecad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:23.136817 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb974d4-bffa-4abb-b5da-c2d6b8ccecad admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:23.137105 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb974d4-bffa-4abb-b5da-c2d6b8ccecad admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:23.137397 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb974d4-bffa-4abb-b5da-c2d6b8ccecad admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:23.138041 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb974d4-bffa-4abb-b5da-c2d6b8ccecad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:23.140245 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb974d4-bffa-4abb-b5da-c2d6b8ccecad admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:23.171228 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1062/2112] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:31:23 2022] POST /identity/v3/users => generated 290 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:31:23.172438 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecab10fb-9331-4b04-b0ef-76905b3329ce admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:23.185459 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecab10fb-9331-4b04-b0ef-76905b3329ce admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:23.190669 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2921539f-0ac5-4615-97e3-90b3e7c58e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:23.192227 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921539f-0ac5-4615-97e3-90b3e7c58e09 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:23.192779 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921539f-0ac5-4615-97e3-90b3e7c58e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:23.193347 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921539f-0ac5-4615-97e3-90b3e7c58e09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:23.193951 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2921539f-0ac5-4615-97e3-90b3e7c58e09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:23.196071 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2921539f-0ac5-4615-97e3-90b3e7c58e09 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:23.211640 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1051/2113] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:31:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 03:31:23.213268 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb974d4-bffa-4abb-b5da-c2d6b8ccecad admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:23.225237 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb974d4-bffa-4abb-b5da-c2d6b8ccecad admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:23.230976 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1184ef18-41f4-40ba-b2f6-37c0342db223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:23.231736 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1184ef18-41f4-40ba-b2f6-37c0342db223 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:23.232095 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1184ef18-41f4-40ba-b2f6-37c0342db223 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:23.232371 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1184ef18-41f4-40ba-b2f6-37c0342db223 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:23.233016 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1184ef18-41f4-40ba-b2f6-37c0342db223 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:23.234607 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1184ef18-41f4-40ba-b2f6-37c0342db223 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:23.249498 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1063/2114] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:31:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:31:23.253989 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2921539f-0ac5-4615-97e3-90b3e7c58e09 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:23.265505 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2921539f-0ac5-4615-97e3-90b3e7c58e09 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:23.270992 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fe85fa-ee10-428a-86ce-33a7a7ce81e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:23.271704 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe85fa-ee10-428a-86ce-33a7a7ce81e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:23.271988 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe85fa-ee10-428a-86ce-33a7a7ce81e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:23.272339 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe85fa-ee10-428a-86ce-33a7a7ce81e2 admin admin] PATH_INFO: `/v3/projects/f1dc3d5f5ff14e8fb02980f78b523a23/users/818fcf6957ab4258a48e1775d918bdc1/roles/04d0e4575a28440eb4349b4a6565e8b8` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:23.288448 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fe85fa-ee10-428a-86ce-33a7a7ce81e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1dc3d5f5ff14e8fb02980f78b523a23, user_id=818fcf6957ab4258a48e1775d918bdc1, role_id=04d0e4575a28440eb4349b4a6565e8b8)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:23.291217 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fe85fa-ee10-428a-86ce-33a7a7ce81e2 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:23.304442 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1052/2115] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:31:23 2022] PUT /identity/v3/projects/f1dc3d5f5ff14e8fb02980f78b523a23/users/818fcf6957ab4258a48e1775d918bdc1/roles/04d0e4575a28440eb4349b4a6565e8b8 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:31:23.315841 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5036e0c-4d25-4b19-8142-6047ba005434 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:23.316158 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5036e0c-4d25-4b19-8142-6047ba005434 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:23.316438 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5036e0c-4d25-4b19-8142-6047ba005434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:23.350885 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-b5036e0c-4d25-4b19-8142-6047ba005434 None None] MFA Rules not processed for user `818fcf6957ab4258a48e1775d918bdc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:31:23.352269 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-b5036e0c-4d25-4b19-8142-6047ba005434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:31:23.452792 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1064/2116] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:31:23 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:31:23.457069 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fe85fa-ee10-428a-86ce-33a7a7ce81e2 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:23.531877 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fe85fa-ee10-428a-86ce-33a7a7ce81e2 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:23.539761 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9903f70-a2a0-4336-bf7a-0e3d9ca0a201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:23.540411 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9903f70-a2a0-4336-bf7a-0e3d9ca0a201 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:23.540695 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9903f70-a2a0-4336-bf7a-0e3d9ca0a201 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:23.540974 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9903f70-a2a0-4336-bf7a-0e3d9ca0a201 admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:23.541748 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9903f70-a2a0-4336-bf7a-0e3d9ca0a201 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:23.544164 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9903f70-a2a0-4336-bf7a-0e3d9ca0a201 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:23.576667 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1053/2117] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:31:23 2022] POST /identity/v3/projects => generated 379 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:31:23.580874 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5036e0c-4d25-4b19-8142-6047ba005434 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:23.592434 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5036e0c-4d25-4b19-8142-6047ba005434 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:23.657956 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e54701-1ef9-42ce-bb05-9b508e3a9247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:23.658567 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e54701-1ef9-42ce-bb05-9b508e3a9247 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:23.658885 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e54701-1ef9-42ce-bb05-9b508e3a9247 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:23.659115 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e54701-1ef9-42ce-bb05-9b508e3a9247 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:23.659791 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e54701-1ef9-42ce-bb05-9b508e3a9247 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:23.661800 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e54701-1ef9-42ce-bb05-9b508e3a9247 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:23.686233 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1065/2118] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:31:23 2022] POST /identity/v3/users => generated 296 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 03:31:23.690268 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9903f70-a2a0-4336-bf7a-0e3d9ca0a201 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:23.704649 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9903f70-a2a0-4336-bf7a-0e3d9ca0a201 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:23.709605 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcefdee-b49b-4274-94d1-b579a3bf8f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:23.710997 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcefdee-b49b-4274-94d1-b579a3bf8f33 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:23.711426 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcefdee-b49b-4274-94d1-b579a3bf8f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:23.711867 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcefdee-b49b-4274-94d1-b579a3bf8f33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:23.712706 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcefdee-b49b-4274-94d1-b579a3bf8f33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:23.714696 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcefdee-b49b-4274-94d1-b579a3bf8f33 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:23.726627 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1054/2119] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:31:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 03:31:23.731458 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e54701-1ef9-42ce-bb05-9b508e3a9247 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:23.741390 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e54701-1ef9-42ce-bb05-9b508e3a9247 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:23.746400 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba806c82-0c66-4050-b01e-02465c49e09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:23.747045 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba806c82-0c66-4050-b01e-02465c49e09c admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:23.747329 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba806c82-0c66-4050-b01e-02465c49e09c admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:23.747647 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba806c82-0c66-4050-b01e-02465c49e09c admin admin] PATH_INFO: `/v3/projects/0923d477c43d4a9b9d5b3f6050d70bfc/users/5e58cf22ba264c29941ab653906b3ee9/roles/fe9379cda35c4ff78576fe48b60bea3c` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:23.756834 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:31:23.766130 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba806c82-0c66-4050-b01e-02465c49e09c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0923d477c43d4a9b9d5b3f6050d70bfc, user_id=5e58cf22ba264c29941ab653906b3ee9, role_id=fe9379cda35c4ff78576fe48b60bea3c)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:23.768733 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba806c82-0c66-4050-b01e-02465c49e09c admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:23.782627 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1066/2120] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:31:23 2022] PUT /identity/v3/projects/0923d477c43d4a9b9d5b3f6050d70bfc/users/5e58cf22ba264c29941ab653906b3ee9/roles/fe9379cda35c4ff78576fe48b60bea3c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:31:23.786583 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcefdee-b49b-4274-94d1-b579a3bf8f33 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:23.797606 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcefdee-b49b-4274-94d1-b579a3bf8f33 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:23.857429 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888dbdd4-87da-4f07-9e03-7ef57b532fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:23.858036 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888dbdd4-87da-4f07-9e03-7ef57b532fa6 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:23.858326 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888dbdd4-87da-4f07-9e03-7ef57b532fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:23.858605 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888dbdd4-87da-4f07-9e03-7ef57b532fa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:23.859279 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888dbdd4-87da-4f07-9e03-7ef57b532fa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:23.860859 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888dbdd4-87da-4f07-9e03-7ef57b532fa6 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:23.863546 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:31:23.883815 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba806c82-0c66-4050-b01e-02465c49e09c admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:23.889897 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1055/2121] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:31:23 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:31:23.896466 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba806c82-0c66-4050-b01e-02465c49e09c admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:23.902055 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c5f212-b466-4475-840d-c13cf2919cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:23.902721 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c5f212-b466-4475-840d-c13cf2919cc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:23.903198 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c5f212-b466-4475-840d-c13cf2919cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:23.903518 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c5f212-b466-4475-840d-c13cf2919cc1 admin admin] PATH_INFO: `/v3/projects/0923d477c43d4a9b9d5b3f6050d70bfc/users/5e58cf22ba264c29941ab653906b3ee9/roles/fe9379cda35c4ff78576fe48b60bea3c` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:23.905600 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c5f212-b466-4475-840d-c13cf2919cc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0923d477c43d4a9b9d5b3f6050d70bfc, user_id=5e58cf22ba264c29941ab653906b3ee9, role_id=fe9379cda35c4ff78576fe48b60bea3c)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:23.908295 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c5f212-b466-4475-840d-c13cf2919cc1 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:23.925676 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1067/2122] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:31:23 2022] PUT /identity/v3/projects/0923d477c43d4a9b9d5b3f6050d70bfc/users/5e58cf22ba264c29941ab653906b3ee9/roles/fe9379cda35c4ff78576fe48b60bea3c => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:31:23.937218 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf89d6c-e282-4f93-b2dc-d9ad4c6ed66f None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:23.937670 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf89d6c-e282-4f93-b2dc-d9ad4c6ed66f None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:23.938104 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf89d6c-e282-4f93-b2dc-d9ad4c6ed66f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:23.980425 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-abf89d6c-e282-4f93-b2dc-d9ad4c6ed66f None None] MFA Rules not processed for user `5e58cf22ba264c29941ab653906b3ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:31:23.981795 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-abf89d6c-e282-4f93-b2dc-d9ad4c6ed66f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:31:24.080936 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1056/2123] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:31:23 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:31:24.092890 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c5f212-b466-4475-840d-c13cf2919cc1 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:24.094670 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-07c5f212-b466-4475-840d-c13cf2919cc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:31:24.190840 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c5f212-b466-4475-840d-c13cf2919cc1 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:24.200797 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06319c69-f89a-4bf5-8d16-434a813d9f03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f537aabf3d1040ff840b02616f839975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:24.201957 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06319c69-f89a-4bf5-8d16-434a813d9f03 service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:24.201957 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06319c69-f89a-4bf5-8d16-434a813d9f03 service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:24.202193 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06319c69-f89a-4bf5-8d16-434a813d9f03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:24.274564 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06319c69-f89a-4bf5-8d16-434a813d9f03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:24.276549 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06319c69-f89a-4bf5-8d16-434a813d9f03 service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:24.290361 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1068/2124] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:31:24 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:31:25.082351 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf89d6c-e282-4f93-b2dc-d9ad4c6ed66f None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:25.083843 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-abf89d6c-e282-4f93-b2dc-d9ad4c6ed66f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:31:25.153041 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf89d6c-e282-4f93-b2dc-d9ad4c6ed66f None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:25.157876 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c283d57-0452-47c4-a7f0-af8d391d2d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:25.158507 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c283d57-0452-47c4-a7f0-af8d391d2d7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:25.158791 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c283d57-0452-47c4-a7f0-af8d391d2d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:25.159068 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c283d57-0452-47c4-a7f0-af8d391d2d7d admin admin] PATH_INFO: `/v3/users/b07b8563ea614640adf503b137948755` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:25.160227 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c283d57-0452-47c4-a7f0-af8d391d2d7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b07b8563ea614640adf503b137948755)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:25.162366 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c283d57-0452-47c4-a7f0-af8d391d2d7d admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:25.213363 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-2c283d57-0452-47c4-a7f0-af8d391d2d7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b07b8563ea614640adf503b137948755'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:25.220697 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-2c283d57-0452-47c4-a7f0-af8d391d2d7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b07b8563ea614640adf503b137948755'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:25.231867 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-2c283d57-0452-47c4-a7f0-af8d391d2d7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b07b8563ea614640adf503b137948755'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:25.235026 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-2c283d57-0452-47c4-a7f0-af8d391d2d7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b07b8563ea614640adf503b137948755'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:25.261093 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-2c283d57-0452-47c4-a7f0-af8d391d2d7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b07b8563ea614640adf503b137948755'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:25.269158 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1057/2125] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:31:25 2022] DELETE /identity/v3/users/b07b8563ea614640adf503b137948755 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 03:31:25.277913 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4287e39-07c3-4a81-8d9d-e89ebc1d5c3b None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:25.278831 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4287e39-07c3-4a81-8d9d-e89ebc1d5c3b None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:25.279422 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4287e39-07c3-4a81-8d9d-e89ebc1d5c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:25.299319 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-d4287e39-07c3-4a81-8d9d-e89ebc1d5c3b None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:31:25.300887 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-d4287e39-07c3-4a81-8d9d-e89ebc1d5c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:31:25.312062 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ec7bd-787b-4281-bcef-779ed2b8f1ab None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:25.312458 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ec7bd-787b-4281-bcef-779ed2b8f1ab None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:25.312812 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ec7bd-787b-4281-bcef-779ed2b8f1ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:25.321942 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:31:25.337277 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-3c7ec7bd-787b-4281-bcef-779ed2b8f1ab None None] MFA Rules not processed for user `bef61ef12079495ba72b7fcd2717aca2`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:31:25.338482 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-3c7ec7bd-787b-4281-bcef-779ed2b8f1ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:31:25.365017 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1069/2126] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:31:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:31:25.376989 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4287e39-07c3-4a81-8d9d-e89ebc1d5c3b None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:25.378727 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-d4287e39-07c3-4a81-8d9d-e89ebc1d5c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:31:25.410230 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1058/2127] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Oct 4 03:31:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 03:31:25.417129 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:31:25.458405 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7ec7bd-787b-4281-bcef-779ed2b8f1ab None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:25.458558 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4287e39-07c3-4a81-8d9d-e89ebc1d5c3b None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:25.460293 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-3c7ec7bd-787b-4281-bcef-779ed2b8f1ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:31:25.462618 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc90b92-9824-4eab-b974-784568b8c00f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:25.463328 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc90b92-9824-4eab-b974-784568b8c00f service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:25.463783 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc90b92-9824-4eab-b974-784568b8c00f service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:25.464067 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc90b92-9824-4eab-b974-784568b8c00f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:25.474536 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc90b92-9824-4eab-b974-784568b8c00f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:25.476969 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc90b92-9824-4eab-b974-784568b8c00f service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:25.487128 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1070/2128] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:31:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 03:31:25.547997 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7ec7bd-787b-4281-bcef-779ed2b8f1ab None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:25.556874 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cc534b-923b-450b-9911-10e3d7d2039e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8da6bacc8f432e8f48bb99c7aede11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:25.557553 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cc534b-923b-450b-9911-10e3d7d2039e service swift] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:25.557928 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cc534b-923b-450b-9911-10e3d7d2039e service swift] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:25.558294 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cc534b-923b-450b-9911-10e3d7d2039e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:25.567752 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cc534b-923b-450b-9911-10e3d7d2039e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:25.571531 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cc534b-923b-450b-9911-10e3d7d2039e service swift] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:25.587418 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1059/2129] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Oct 4 03:31:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 04 03:31:25.711080 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc90b92-9824-4eab-b974-784568b8c00f service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:25.713776 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-1fc90b92-9824-4eab-b974-784568b8c00f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:31:25.852011 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc90b92-9824-4eab-b974-784568b8c00f service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:25.858564 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36adbc4b-a49f-4df7-afb4-1de3dd7ca202 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f537aabf3d1040ff840b02616f839975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:25.860016 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36adbc4b-a49f-4df7-afb4-1de3dd7ca202 service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:25.860582 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36adbc4b-a49f-4df7-afb4-1de3dd7ca202 service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:25.861158 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36adbc4b-a49f-4df7-afb4-1de3dd7ca202 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:25.864072 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-36adbc4b-a49f-4df7-afb4-1de3dd7ca202 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:31:25.966851 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36adbc4b-a49f-4df7-afb4-1de3dd7ca202 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:25.969656 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36adbc4b-a49f-4df7-afb4-1de3dd7ca202 service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:25.983410 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1071/2130] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:31:25 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:31:26.116631 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cc534b-923b-450b-9911-10e3d7d2039e service swift] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:26.118214 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-a4cc534b-923b-450b-9911-10e3d7d2039e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:31:26.142147 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cc534b-923b-450b-9911-10e3d7d2039e service swift] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:26.160389 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c22772-1d66-4f04-9b9d-78a7a8e3d0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:26.160727 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c22772-1d66-4f04-9b9d-78a7a8e3d0c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:26.161027 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c22772-1d66-4f04-9b9d-78a7a8e3d0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:26.161296 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c22772-1d66-4f04-9b9d-78a7a8e3d0c9 admin admin] PATH_INFO: `/v3/projects/1bfca5167f8a4853a654f1b7c2abfede` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:26.162483 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c22772-1d66-4f04-9b9d-78a7a8e3d0c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bfca5167f8a4853a654f1b7c2abfede)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:26.165640 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c22772-1d66-4f04-9b9d-78a7a8e3d0c9 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:26.250417 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-21c22772-1d66-4f04-9b9d-78a7a8e3d0c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bfca5167f8a4853a654f1b7c2abfede', 'request_id': 'req-21c22772-1d66-4f04-9b9d-78a7a8e3d0c9'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:26.256834 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-21c22772-1d66-4f04-9b9d-78a7a8e3d0c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bfca5167f8a4853a654f1b7c2abfede', 'request_id': 'req-21c22772-1d66-4f04-9b9d-78a7a8e3d0c9'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:26.264486 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-21c22772-1d66-4f04-9b9d-78a7a8e3d0c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bfca5167f8a4853a654f1b7c2abfede', 'request_id': 'req-21c22772-1d66-4f04-9b9d-78a7a8e3d0c9'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:26.278355 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-21c22772-1d66-4f04-9b9d-78a7a8e3d0c9 admin admin] The token cache is being invalidate because project 1bfca5167f8a4853a654f1b7c2abfede was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:31:26.278791 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-21c22772-1d66-4f04-9b9d-78a7a8e3d0c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:26.279531 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-21c22772-1d66-4f04-9b9d-78a7a8e3d0c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:26.284294 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1060/2131] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:31:26 2022] DELETE /identity/v3/projects/1bfca5167f8a4853a654f1b7c2abfede => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 03:31:26.286146 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7aa44f-0cb2-4732-83ef-9b3dfa9361f1 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:26.286596 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7aa44f-0cb2-4732-83ef-9b3dfa9361f1 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:26.286790 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7aa44f-0cb2-4732-83ef-9b3dfa9361f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:26.325863 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-1e7aa44f-0cb2-4732-83ef-9b3dfa9361f1 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:31:26.329912 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-1e7aa44f-0cb2-4732-83ef-9b3dfa9361f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:31:26.414529 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1072/2132] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:31:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:31:26.422827 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01385fe-dc3a-49b3-b713-6f3a979cc1bc None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:26.423424 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01385fe-dc3a-49b3-b713-6f3a979cc1bc None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:26.424112 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01385fe-dc3a-49b3-b713-6f3a979cc1bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:26.456980 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-e01385fe-dc3a-49b3-b713-6f3a979cc1bc None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:31:26.458369 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-e01385fe-dc3a-49b3-b713-6f3a979cc1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:31:26.515187 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1061/2133] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:31:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:31:26.516457 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7aa44f-0cb2-4732-83ef-9b3dfa9361f1 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:26.528372 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7aa44f-0cb2-4732-83ef-9b3dfa9361f1 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:26.535343 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ece581d-c5dc-4a01-92fc-392b5c0c2ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:26.536360 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ece581d-c5dc-4a01-92fc-392b5c0c2ecc admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:26.536712 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ece581d-c5dc-4a01-92fc-392b5c0c2ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:26.537022 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ece581d-c5dc-4a01-92fc-392b5c0c2ecc admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:26.538038 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ece581d-c5dc-4a01-92fc-392b5c0c2ecc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:31:26.538345 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ece581d-c5dc-4a01-92fc-392b5c0c2ecc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:26.540163 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ece581d-c5dc-4a01-92fc-392b5c0c2ecc admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:26.558933 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1073/2134] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 03:31:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:31:26.560465 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01385fe-dc3a-49b3-b713-6f3a979cc1bc None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:26.572069 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01385fe-dc3a-49b3-b713-6f3a979cc1bc None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:26.577717 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f395d787-7e98-427c-a231-7c79e00ef24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:26.578547 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f395d787-7e98-427c-a231-7c79e00ef24e admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:26.578983 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f395d787-7e98-427c-a231-7c79e00ef24e admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:26.580100 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f395d787-7e98-427c-a231-7c79e00ef24e admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:26.580899 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f395d787-7e98-427c-a231-7c79e00ef24e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:26.582951 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f395d787-7e98-427c-a231-7c79e00ef24e admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:26.597306 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:31:26.632520 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ece581d-c5dc-4a01-92fc-392b5c0c2ecc admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:26.633730 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1062/2135] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:31:26 2022] POST /identity/v3/projects => generated 375 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 03:31:26.647060 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ece581d-c5dc-4a01-92fc-392b5c0c2ecc admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:26.653737 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:31:26.744850 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a676ee0b-68d0-416b-bdd3-af072329521d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:26.744850 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a676ee0b-68d0-416b-bdd3-af072329521d admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:26.744850 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a676ee0b-68d0-416b-bdd3-af072329521d admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:26.744850 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a676ee0b-68d0-416b-bdd3-af072329521d admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:26.745445 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a676ee0b-68d0-416b-bdd3-af072329521d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:26.746136 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a676ee0b-68d0-416b-bdd3-af072329521d admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:26.780919 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1074/2136] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:31:26 2022] POST /identity/v3/users => generated 288 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 03:31:26.785268 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f395d787-7e98-427c-a231-7c79e00ef24e admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:26.799453 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f395d787-7e98-427c-a231-7c79e00ef24e admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:26.808976 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b7c9d5-59d1-4698-b236-f152f4595825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:26.809940 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b7c9d5-59d1-4698-b236-f152f4595825 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:26.809940 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b7c9d5-59d1-4698-b236-f152f4595825 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:26.810364 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b7c9d5-59d1-4698-b236-f152f4595825 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:26.811099 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b7c9d5-59d1-4698-b236-f152f4595825 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:26.813161 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b7c9d5-59d1-4698-b236-f152f4595825 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:26.825362 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1063/2137] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:31:26 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:31:26.829531 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a676ee0b-68d0-416b-bdd3-af072329521d admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:26.849065 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a676ee0b-68d0-416b-bdd3-af072329521d admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:26.872740 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dcb014-e1b8-4394-b5d6-580c1fdab705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:26.873464 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dcb014-e1b8-4394-b5d6-580c1fdab705 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:26.873814 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dcb014-e1b8-4394-b5d6-580c1fdab705 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:26.874105 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dcb014-e1b8-4394-b5d6-580c1fdab705 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:26.874870 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dcb014-e1b8-4394-b5d6-580c1fdab705 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:26.878562 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dcb014-e1b8-4394-b5d6-580c1fdab705 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:26.891314 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1075/2138] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:31:26 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:31:26.895450 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b7c9d5-59d1-4698-b236-f152f4595825 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:26.911199 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b7c9d5-59d1-4698-b236-f152f4595825 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:26.921355 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e9fbb-2429-404b-9928-6a3feb2b2747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:26.922169 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e9fbb-2429-404b-9928-6a3feb2b2747 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:26.922752 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e9fbb-2429-404b-9928-6a3feb2b2747 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:26.923149 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e9fbb-2429-404b-9928-6a3feb2b2747 admin admin] PATH_INFO: `/v3/projects/c6f848838bf045e8a489232e1f98211e/users/68273aefca23463ea91e9908bc78b50d/roles/04d0e4575a28440eb4349b4a6565e8b8` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:26.946444 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6e9fbb-2429-404b-9928-6a3feb2b2747 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6f848838bf045e8a489232e1f98211e, user_id=68273aefca23463ea91e9908bc78b50d, role_id=04d0e4575a28440eb4349b4a6565e8b8)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:26.951115 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6e9fbb-2429-404b-9928-6a3feb2b2747 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:26.979751 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1064/2139] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:31:26 2022] PUT /identity/v3/projects/c6f848838bf045e8a489232e1f98211e/users/68273aefca23463ea91e9908bc78b50d/roles/04d0e4575a28440eb4349b4a6565e8b8 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:31:26.988127 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7391f89d-f46c-464b-a794-e81f176c416d None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:26.989303 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7391f89d-f46c-464b-a794-e81f176c416d None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:26.989829 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7391f89d-f46c-464b-a794-e81f176c416d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:27.026736 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-7391f89d-f46c-464b-a794-e81f176c416d None None] MFA Rules not processed for user `68273aefca23463ea91e9908bc78b50d`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:31:27.028345 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-7391f89d-f46c-464b-a794-e81f176c416d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:31:27.159389 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1076/2140] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:31:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:31:27.175404 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e9fbb-2429-404b-9928-6a3feb2b2747 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:27.177512 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-4b6e9fbb-2429-404b-9928-6a3feb2b2747 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:31:27.316387 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e9fbb-2429-404b-9928-6a3feb2b2747 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:27.325545 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1d495e-0b82-43d5-9edd-4d5d245b75d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f537aabf3d1040ff840b02616f839975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:27.327216 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d495e-0b82-43d5-9edd-4d5d245b75d9 service cinder] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:27.327216 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d495e-0b82-43d5-9edd-4d5d245b75d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:27.327216 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d495e-0b82-43d5-9edd-4d5d245b75d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:27.347694 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1d495e-0b82-43d5-9edd-4d5d245b75d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:27.359675 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1d495e-0b82-43d5-9edd-4d5d245b75d9 service cinder] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:27.374966 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1065/2141] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:31:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:31:30.696512 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7391f89d-f46c-464b-a794-e81f176c416d None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:30.698003 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-7391f89d-f46c-464b-a794-e81f176c416d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:31:30.793085 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7391f89d-f46c-464b-a794-e81f176c416d None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:30.798852 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c6b570-94b3-4326-8220-9b27b5203d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:30.799874 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6b570-94b3-4326-8220-9b27b5203d51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:30.800233 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6b570-94b3-4326-8220-9b27b5203d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:30.800602 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6b570-94b3-4326-8220-9b27b5203d51 admin admin] PATH_INFO: `/v3/users/818fcf6957ab4258a48e1775d918bdc1` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:30.801877 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c6b570-94b3-4326-8220-9b27b5203d51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=818fcf6957ab4258a48e1775d918bdc1)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:30.805199 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c6b570-94b3-4326-8220-9b27b5203d51 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:30.836213 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:31:30.884306 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-70c6b570-94b3-4326-8220-9b27b5203d51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '818fcf6957ab4258a48e1775d918bdc1'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:30.885241 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-70c6b570-94b3-4326-8220-9b27b5203d51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '818fcf6957ab4258a48e1775d918bdc1'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:30.915753 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-70c6b570-94b3-4326-8220-9b27b5203d51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '818fcf6957ab4258a48e1775d918bdc1'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:30.915753 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-70c6b570-94b3-4326-8220-9b27b5203d51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '818fcf6957ab4258a48e1775d918bdc1'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:30.931286 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-70c6b570-94b3-4326-8220-9b27b5203d51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '818fcf6957ab4258a48e1775d918bdc1'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:30.979837 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1077/2142] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:31:30 2022] DELETE /identity/v3/users/818fcf6957ab4258a48e1775d918bdc1 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:31:30.981610 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5761905-ebf8-4ef9-8197-e18e3b114060 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:30.982694 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5761905-ebf8-4ef9-8197-e18e3b114060 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:30.983234 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5761905-ebf8-4ef9-8197-e18e3b114060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:31.048640 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-b5761905-ebf8-4ef9-8197-e18e3b114060 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:31:31.050195 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-b5761905-ebf8-4ef9-8197-e18e3b114060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:31:31.213094 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1066/2143] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:31:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:31:31.238641 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c6b570-94b3-4326-8220-9b27b5203d51 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:31.240133 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-70c6b570-94b3-4326-8220-9b27b5203d51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:31:31.502673 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c6b570-94b3-4326-8220-9b27b5203d51 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:31.517395 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8fd747-876e-4e1b-8850-c97051a99263 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:31.520090 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8fd747-876e-4e1b-8850-c97051a99263 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:31.520774 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8fd747-876e-4e1b-8850-c97051a99263 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:31.520774 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8fd747-876e-4e1b-8850-c97051a99263 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:31.548320 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8fd747-876e-4e1b-8850-c97051a99263 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:31.550104 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8fd747-876e-4e1b-8850-c97051a99263 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:31.575202 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1078/2144] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:31:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:31:32.042798 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5761905-ebf8-4ef9-8197-e18e3b114060 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:32.044808 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-b5761905-ebf8-4ef9-8197-e18e3b114060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:31:32.099998 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5761905-ebf8-4ef9-8197-e18e3b114060 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:32.106101 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08186bb-3f1f-4fc7-837e-8c1d65b20ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:32.106806 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08186bb-3f1f-4fc7-837e-8c1d65b20ffa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:32.107092 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08186bb-3f1f-4fc7-837e-8c1d65b20ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:32.107363 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08186bb-3f1f-4fc7-837e-8c1d65b20ffa admin admin] PATH_INFO: `/v3/projects/f1dc3d5f5ff14e8fb02980f78b523a23` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:32.109022 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08186bb-3f1f-4fc7-837e-8c1d65b20ffa admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1dc3d5f5ff14e8fb02980f78b523a23)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:32.110988 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08186bb-3f1f-4fc7-837e-8c1d65b20ffa admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:32.177359 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-e08186bb-3f1f-4fc7-837e-8c1d65b20ffa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1dc3d5f5ff14e8fb02980f78b523a23', 'request_id': 'req-e08186bb-3f1f-4fc7-837e-8c1d65b20ffa'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:32.183545 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:31:32.186575 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-e08186bb-3f1f-4fc7-837e-8c1d65b20ffa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1dc3d5f5ff14e8fb02980f78b523a23', 'request_id': 'req-e08186bb-3f1f-4fc7-837e-8c1d65b20ffa'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:32.205735 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-e08186bb-3f1f-4fc7-837e-8c1d65b20ffa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1dc3d5f5ff14e8fb02980f78b523a23', 'request_id': 'req-e08186bb-3f1f-4fc7-837e-8c1d65b20ffa'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:32.234049 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-e08186bb-3f1f-4fc7-837e-8c1d65b20ffa admin admin] The token cache is being invalidate because project f1dc3d5f5ff14e8fb02980f78b523a23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:31:32.234405 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-e08186bb-3f1f-4fc7-837e-8c1d65b20ffa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:32.235161 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-e08186bb-3f1f-4fc7-837e-8c1d65b20ffa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:32.237133 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1067/2145] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:31:32 2022] DELETE /identity/v3/projects/f1dc3d5f5ff14e8fb02980f78b523a23 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:31:32.240840 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8fd747-876e-4e1b-8850-c97051a99263 service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:32.252042 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8fd747-876e-4e1b-8850-c97051a99263 service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:32.341041 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c99040-06b7-41d8-bd12-4e21532337da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:32.341877 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c99040-06b7-41d8-bd12-4e21532337da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:32.342271 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c99040-06b7-41d8-bd12-4e21532337da admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:32.342668 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c99040-06b7-41d8-bd12-4e21532337da admin admin] PATH_INFO: `/v3/users/5e58cf22ba264c29941ab653906b3ee9` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:32.344792 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c99040-06b7-41d8-bd12-4e21532337da admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e58cf22ba264c29941ab653906b3ee9)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:32.346863 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c99040-06b7-41d8-bd12-4e21532337da admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:32.427450 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:31:32.438719 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-d4c99040-06b7-41d8-bd12-4e21532337da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e58cf22ba264c29941ab653906b3ee9'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:32.439701 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-d4c99040-06b7-41d8-bd12-4e21532337da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e58cf22ba264c29941ab653906b3ee9'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:32.452186 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-d4c99040-06b7-41d8-bd12-4e21532337da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e58cf22ba264c29941ab653906b3ee9'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:32.453270 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-d4c99040-06b7-41d8-bd12-4e21532337da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e58cf22ba264c29941ab653906b3ee9'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:32.471263 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-d4c99040-06b7-41d8-bd12-4e21532337da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e58cf22ba264c29941ab653906b3ee9'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:32.486958 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1079/2146] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:31:32 2022] DELETE /identity/v3/users/5e58cf22ba264c29941ab653906b3ee9 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:31:32.955927 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08186bb-3f1f-4fc7-837e-8c1d65b20ffa admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:32.957787 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-e08186bb-3f1f-4fc7-837e-8c1d65b20ffa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:31:32.982204 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08186bb-3f1f-4fc7-837e-8c1d65b20ffa admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:33.135959 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a6a5a-bdf7-4206-913d-e1062cff81fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:33.136533 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a6a5a-bdf7-4206-913d-e1062cff81fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:33.136671 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a6a5a-bdf7-4206-913d-e1062cff81fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:33.136945 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a6a5a-bdf7-4206-913d-e1062cff81fb admin admin] PATH_INFO: `/v3/projects/0923d477c43d4a9b9d5b3f6050d70bfc` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:33.139434 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745a6a5a-bdf7-4206-913d-e1062cff81fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=0923d477c43d4a9b9d5b3f6050d70bfc)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:33.141913 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745a6a5a-bdf7-4206-913d-e1062cff81fb admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:33.215783 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-745a6a5a-bdf7-4206-913d-e1062cff81fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0923d477c43d4a9b9d5b3f6050d70bfc', 'request_id': 'req-745a6a5a-bdf7-4206-913d-e1062cff81fb'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:33.223811 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-745a6a5a-bdf7-4206-913d-e1062cff81fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0923d477c43d4a9b9d5b3f6050d70bfc', 'request_id': 'req-745a6a5a-bdf7-4206-913d-e1062cff81fb'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:33.236312 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-745a6a5a-bdf7-4206-913d-e1062cff81fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0923d477c43d4a9b9d5b3f6050d70bfc', 'request_id': 'req-745a6a5a-bdf7-4206-913d-e1062cff81fb'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:33.263757 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-745a6a5a-bdf7-4206-913d-e1062cff81fb admin admin] The token cache is being invalidate because project 0923d477c43d4a9b9d5b3f6050d70bfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:31:33.264291 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-745a6a5a-bdf7-4206-913d-e1062cff81fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:33.265653 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-745a6a5a-bdf7-4206-913d-e1062cff81fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:33.271925 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1068/2147] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:31:32 2022] DELETE /identity/v3/projects/0923d477c43d4a9b9d5b3f6050d70bfc => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:31:33.281240 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c333539-9172-436b-8d2e-346abc130ff7 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:33.283449 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c333539-9172-436b-8d2e-346abc130ff7 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:33.286466 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c333539-9172-436b-8d2e-346abc130ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:33.338509 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-6c333539-9172-436b-8d2e-346abc130ff7 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:31:33.342143 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-6c333539-9172-436b-8d2e-346abc130ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:31:33.478146 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1080/2148] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:31:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:31:33.487195 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b295d00-909b-4a72-9eff-2de85e4d16e2 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:33.488024 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b295d00-909b-4a72-9eff-2de85e4d16e2 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:33.488513 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b295d00-909b-4a72-9eff-2de85e4d16e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:33.519502 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5980efa-332a-4514-8e1c-5da320c8d956 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:33.519804 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5980efa-332a-4514-8e1c-5da320c8d956 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:33.520084 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5980efa-332a-4514-8e1c-5da320c8d956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:33.540892 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-9b295d00-909b-4a72-9eff-2de85e4d16e2 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:31:33.545303 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-9b295d00-909b-4a72-9eff-2de85e4d16e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:31:33.559918 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1069/2149] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:31:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:31:33.568308 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-e5980efa-332a-4514-8e1c-5da320c8d956 None None] MFA Rules not processed for user `b8795829c34046628cae345dd4d45e75`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:31:33.569582 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-e5980efa-332a-4514-8e1c-5da320c8d956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:31:33.576169 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b295d00-909b-4a72-9eff-2de85e4d16e2 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:33.595676 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b295d00-909b-4a72-9eff-2de85e4d16e2 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:33.604241 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906cf869-70e6-4616-b0ce-45078f16c09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:33.607049 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906cf869-70e6-4616-b0ce-45078f16c09b admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:33.608477 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906cf869-70e6-4616-b0ce-45078f16c09b admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:33.611204 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906cf869-70e6-4616-b0ce-45078f16c09b admin admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:33.612779 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906cf869-70e6-4616-b0ce-45078f16c09b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:31:33.613816 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906cf869-70e6-4616-b0ce-45078f16c09b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:33.617668 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906cf869-70e6-4616-b0ce-45078f16c09b admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:33.645534 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1070/2150] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 03:31:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:31:33.651464 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906cf869-70e6-4616-b0ce-45078f16c09b admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:33.673860 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906cf869-70e6-4616-b0ce-45078f16c09b admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:33.688322 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a566795-4c04-44d1-87e8-0b2e6a2f9f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:33.689205 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a566795-4c04-44d1-87e8-0b2e6a2f9f62 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:33.690328 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a566795-4c04-44d1-87e8-0b2e6a2f9f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:33.690877 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a566795-4c04-44d1-87e8-0b2e6a2f9f62 admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:33.691706 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a566795-4c04-44d1-87e8-0b2e6a2f9f62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:33.695273 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a566795-4c04-44d1-87e8-0b2e6a2f9f62 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:33.704798 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1081/2151] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:31:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:31:33.773123 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1071/2152] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:31:33 2022] POST /identity/v3/projects => generated 365 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:31:33.774290 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5980efa-332a-4514-8e1c-5da320c8d956 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:33.797588 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5980efa-332a-4514-8e1c-5da320c8d956 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:34.055967 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412b9383-85f1-4129-aaa0-e337ed79d189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:34.057279 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b9383-85f1-4129-aaa0-e337ed79d189 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:34.057567 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b9383-85f1-4129-aaa0-e337ed79d189 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:34.058332 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b9383-85f1-4129-aaa0-e337ed79d189 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:34.058979 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412b9383-85f1-4129-aaa0-e337ed79d189 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:34.061434 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412b9383-85f1-4129-aaa0-e337ed79d189 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:34.077063 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:31:34.102586 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1082/2153] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:31:33 2022] POST /identity/v3/users => generated 283 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:31:34.113149 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a566795-4c04-44d1-87e8-0b2e6a2f9f62 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:34.130427 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a566795-4c04-44d1-87e8-0b2e6a2f9f62 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:34.139612 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb511350-709d-42d0-b9f9-f262b7c21db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:34.140934 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb511350-709d-42d0-b9f9-f262b7c21db2 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:34.141370 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb511350-709d-42d0-b9f9-f262b7c21db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:34.141839 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb511350-709d-42d0-b9f9-f262b7c21db2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:34.142878 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb511350-709d-42d0-b9f9-f262b7c21db2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:34.144652 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb511350-709d-42d0-b9f9-f262b7c21db2 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:34.161607 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1072/2154] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:31:34 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:31:34.162491 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412b9383-85f1-4129-aaa0-e337ed79d189 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:34.197669 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412b9383-85f1-4129-aaa0-e337ed79d189 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:34.210665 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be163d5c-d383-463d-b907-9bae5d1628a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:34.211419 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be163d5c-d383-463d-b907-9bae5d1628a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:34.211729 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be163d5c-d383-463d-b907-9bae5d1628a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:34.212002 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be163d5c-d383-463d-b907-9bae5d1628a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:34.212648 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be163d5c-d383-463d-b907-9bae5d1628a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:34.214454 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be163d5c-d383-463d-b907-9bae5d1628a5 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:34.235010 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1083/2155] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:31:34 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:31:34.239648 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb511350-709d-42d0-b9f9-f262b7c21db2 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:34.251567 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb511350-709d-42d0-b9f9-f262b7c21db2 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:34.257070 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11496693-7c7f-4055-98c3-7920e4b43de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:34.258222 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11496693-7c7f-4055-98c3-7920e4b43de7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:34.258611 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11496693-7c7f-4055-98c3-7920e4b43de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:34.259005 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11496693-7c7f-4055-98c3-7920e4b43de7 admin admin] PATH_INFO: `/v3/projects/2008cdc5ba9c49018f0e276610251cb4/users/d3328254181245a0b27416936a0ec97e/roles/04d0e4575a28440eb4349b4a6565e8b8` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:34.343956 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11496693-7c7f-4055-98c3-7920e4b43de7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2008cdc5ba9c49018f0e276610251cb4, user_id=d3328254181245a0b27416936a0ec97e, role_id=04d0e4575a28440eb4349b4a6565e8b8)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:34.343956 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11496693-7c7f-4055-98c3-7920e4b43de7 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:34.343956 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:31:34.380872 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1073/2156] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:31:34 2022] PUT /identity/v3/projects/2008cdc5ba9c49018f0e276610251cb4/users/d3328254181245a0b27416936a0ec97e/roles/04d0e4575a28440eb4349b4a6565e8b8 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 03:31:34.394833 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29a735-e361-4e90-93d6-f26663b76aa1 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:34.395471 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29a735-e361-4e90-93d6-f26663b76aa1 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:34.395471 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29a735-e361-4e90-93d6-f26663b76aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:34.466221 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-af29a735-e361-4e90-93d6-f26663b76aa1 None None] MFA Rules not processed for user `d3328254181245a0b27416936a0ec97e`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:31:34.467777 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-af29a735-e361-4e90-93d6-f26663b76aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:31:34.644026 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1084/2157] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:31:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:31:34.646834 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11496693-7c7f-4055-98c3-7920e4b43de7 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:34.776834 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11496693-7c7f-4055-98c3-7920e4b43de7 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:34.783518 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1581671e-daeb-441b-9144-ece1caeb82d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:34.784240 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1581671e-daeb-441b-9144-ece1caeb82d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:34.784530 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1581671e-daeb-441b-9144-ece1caeb82d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:34.784806 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1581671e-daeb-441b-9144-ece1caeb82d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:34.785533 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1581671e-daeb-441b-9144-ece1caeb82d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:34.787943 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1581671e-daeb-441b-9144-ece1caeb82d4 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:34.851574 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1074/2158] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:31:34 2022] POST /identity/v3/projects => generated 367 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:31:34.853018 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af29a735-e361-4e90-93d6-f26663b76aa1 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:34.869020 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af29a735-e361-4e90-93d6-f26663b76aa1 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:35.048681 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42509fa-c7a1-41c9-b126-6ac33bd988dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:35.049511 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42509fa-c7a1-41c9-b126-6ac33bd988dd admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:35.050196 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42509fa-c7a1-41c9-b126-6ac33bd988dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:35.050480 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42509fa-c7a1-41c9-b126-6ac33bd988dd admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:35.051709 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42509fa-c7a1-41c9-b126-6ac33bd988dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:35.054366 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42509fa-c7a1-41c9-b126-6ac33bd988dd admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:35.103362 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1085/2159] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:31:34 2022] POST /identity/v3/users => generated 290 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:31:35.104574 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1581671e-daeb-441b-9144-ece1caeb82d4 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:35.119764 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1581671e-daeb-441b-9144-ece1caeb82d4 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:35.134433 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daaae55-f222-4926-92d5-9ec8e071e98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:35.135301 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daaae55-f222-4926-92d5-9ec8e071e98c admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:35.135627 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daaae55-f222-4926-92d5-9ec8e071e98c admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:35.135936 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daaae55-f222-4926-92d5-9ec8e071e98c admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:35.137267 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daaae55-f222-4926-92d5-9ec8e071e98c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:35.141482 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daaae55-f222-4926-92d5-9ec8e071e98c admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:35.160767 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1075/2160] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:31:35 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:31:35.161253 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42509fa-c7a1-41c9-b126-6ac33bd988dd admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:35.200724 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42509fa-c7a1-41c9-b126-6ac33bd988dd admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:35.208211 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c5419e-e08e-49d5-a823-49eb04fba5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:35.209283 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5419e-e08e-49d5-a823-49eb04fba5fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:35.210400 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5419e-e08e-49d5-a823-49eb04fba5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:35.210746 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5419e-e08e-49d5-a823-49eb04fba5fb admin admin] PATH_INFO: `/v3/projects/12f57de34293430cb7c37fb30dc1f16d/users/47a552202bab4d06b6b2b72b2d58db51/roles/fe9379cda35c4ff78576fe48b60bea3c` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:35.256124 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c5419e-e08e-49d5-a823-49eb04fba5fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=12f57de34293430cb7c37fb30dc1f16d, user_id=47a552202bab4d06b6b2b72b2d58db51, role_id=fe9379cda35c4ff78576fe48b60bea3c)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:35.259790 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c5419e-e08e-49d5-a823-49eb04fba5fb admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:35.296359 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1086/2161] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:31:35 2022] PUT /identity/v3/projects/12f57de34293430cb7c37fb30dc1f16d/users/47a552202bab4d06b6b2b72b2d58db51/roles/fe9379cda35c4ff78576fe48b60bea3c => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 03:31:35.297966 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daaae55-f222-4926-92d5-9ec8e071e98c admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:35.311105 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daaae55-f222-4926-92d5-9ec8e071e98c admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:35.425699 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fccf324-c7f6-4642-8021-9eb390b015be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:35.426580 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fccf324-c7f6-4642-8021-9eb390b015be admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:35.426961 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fccf324-c7f6-4642-8021-9eb390b015be admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:35.427356 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fccf324-c7f6-4642-8021-9eb390b015be admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:35.428241 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fccf324-c7f6-4642-8021-9eb390b015be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:35.433837 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fccf324-c7f6-4642-8021-9eb390b015be admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:35.458151 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c5419e-e08e-49d5-a823-49eb04fba5fb admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:35.458670 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1076/2162] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:31:35 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:31:35.486416 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c5419e-e08e-49d5-a823-49eb04fba5fb admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:35.500743 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b603e6-422d-405a-a203-5e6d27418b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:35.502935 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b603e6-422d-405a-a203-5e6d27418b8d admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:35.503322 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b603e6-422d-405a-a203-5e6d27418b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:35.507910 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b603e6-422d-405a-a203-5e6d27418b8d admin admin] PATH_INFO: `/v3/projects/12f57de34293430cb7c37fb30dc1f16d/users/47a552202bab4d06b6b2b72b2d58db51/roles/fe9379cda35c4ff78576fe48b60bea3c` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:35.512343 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b603e6-422d-405a-a203-5e6d27418b8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=12f57de34293430cb7c37fb30dc1f16d, user_id=47a552202bab4d06b6b2b72b2d58db51, role_id=fe9379cda35c4ff78576fe48b60bea3c)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:35.521354 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b603e6-422d-405a-a203-5e6d27418b8d admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:35.548283 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1087/2163] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:31:35 2022] PUT /identity/v3/projects/12f57de34293430cb7c37fb30dc1f16d/users/47a552202bab4d06b6b2b72b2d58db51/roles/fe9379cda35c4ff78576fe48b60bea3c => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 03:31:35.561271 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033bf141-5ee7-4ba3-b46b-5fb7e84b2f0d None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:35.561593 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033bf141-5ee7-4ba3-b46b-5fb7e84b2f0d None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:35.561997 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033bf141-5ee7-4ba3-b46b-5fb7e84b2f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:35.656489 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-033bf141-5ee7-4ba3-b46b-5fb7e84b2f0d None None] MFA Rules not processed for user `47a552202bab4d06b6b2b72b2d58db51`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:31:35.660509 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-033bf141-5ee7-4ba3-b46b-5fb7e84b2f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:31:35.783926 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:31:35.815278 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1077/2164] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:31:35 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:31:35.826083 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b603e6-422d-405a-a203-5e6d27418b8d admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:35.829119 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-b3b603e6-422d-405a-a203-5e6d27418b8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:31:35.930233 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:31:36.023043 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b603e6-422d-405a-a203-5e6d27418b8d admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:36.039127 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b37e80-effb-48a8-9f5b-88e811d1331a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f537aabf3d1040ff840b02616f839975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:36.041691 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b37e80-effb-48a8-9f5b-88e811d1331a service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:36.042004 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b37e80-effb-48a8-9f5b-88e811d1331a service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:36.042253 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b37e80-effb-48a8-9f5b-88e811d1331a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:36.068821 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b37e80-effb-48a8-9f5b-88e811d1331a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:36.075359 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b37e80-effb-48a8-9f5b-88e811d1331a service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:36.106366 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1088/2165] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:31:35 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:31:36.253287 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033bf141-5ee7-4ba3-b46b-5fb7e84b2f0d None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:36.275670 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033bf141-5ee7-4ba3-b46b-5fb7e84b2f0d None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:36.288724 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda48e3-8096-4997-a2bb-277cb6c9f0eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f537aabf3d1040ff840b02616f839975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:36.289584 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda48e3-8096-4997-a2bb-277cb6c9f0eb service cinder] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:36.289869 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda48e3-8096-4997-a2bb-277cb6c9f0eb service cinder] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:36.290583 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda48e3-8096-4997-a2bb-277cb6c9f0eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:36.403324 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fda48e3-8096-4997-a2bb-277cb6c9f0eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:36.405396 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fda48e3-8096-4997-a2bb-277cb6c9f0eb service cinder] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:36.461301 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1078/2166] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:31:36 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:31:40.621834 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b37e80-effb-48a8-9f5b-88e811d1331a service cinder] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:40.624432 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-55b37e80-effb-48a8-9f5b-88e811d1331a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:31:40.716632 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b37e80-effb-48a8-9f5b-88e811d1331a service cinder] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:40.723030 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd50e88a-eed7-4069-906a-b6cabdc8a421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:40.724018 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd50e88a-eed7-4069-906a-b6cabdc8a421 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:40.724473 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd50e88a-eed7-4069-906a-b6cabdc8a421 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:40.725487 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd50e88a-eed7-4069-906a-b6cabdc8a421 admin admin] PATH_INFO: `/v3/users/68273aefca23463ea91e9908bc78b50d` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:40.726980 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd50e88a-eed7-4069-906a-b6cabdc8a421 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68273aefca23463ea91e9908bc78b50d)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:40.729268 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd50e88a-eed7-4069-906a-b6cabdc8a421 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:40.862419 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-fd50e88a-eed7-4069-906a-b6cabdc8a421 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68273aefca23463ea91e9908bc78b50d'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:40.863774 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-fd50e88a-eed7-4069-906a-b6cabdc8a421 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68273aefca23463ea91e9908bc78b50d'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:40.884260 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-fd50e88a-eed7-4069-906a-b6cabdc8a421 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68273aefca23463ea91e9908bc78b50d'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:40.884260 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-fd50e88a-eed7-4069-906a-b6cabdc8a421 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68273aefca23463ea91e9908bc78b50d'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:40.907213 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-fd50e88a-eed7-4069-906a-b6cabdc8a421 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68273aefca23463ea91e9908bc78b50d'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:40.935006 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c2812c-790e-4a3a-bff9-2832b92c4f4d None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:40.935637 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c2812c-790e-4a3a-bff9-2832b92c4f4d None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:40.935637 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c2812c-790e-4a3a-bff9-2832b92c4f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:40.938929 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1089/2167] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:31:40 2022] DELETE /identity/v3/users/68273aefca23463ea91e9908bc78b50d => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:31:40.978574 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-83c2812c-790e-4a3a-bff9-2832b92c4f4d None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:31:40.983519 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-83c2812c-790e-4a3a-bff9-2832b92c4f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:31:41.074055 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1079/2168] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:31:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:31:41.107813 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd50e88a-eed7-4069-906a-b6cabdc8a421 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:41.109257 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-fd50e88a-eed7-4069-906a-b6cabdc8a421 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:31:41.230545 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:31:41.244375 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd50e88a-eed7-4069-906a-b6cabdc8a421 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:41.249123 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34685042-02d4-405c-a677-f7398b1af9ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:41.249886 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34685042-02d4-405c-a677-f7398b1af9ea service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:41.250174 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34685042-02d4-405c-a677-f7398b1af9ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:41.250449 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34685042-02d4-405c-a677-f7398b1af9ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:41.267138 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34685042-02d4-405c-a677-f7398b1af9ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:41.268886 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34685042-02d4-405c-a677-f7398b1af9ea service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:41.285350 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1090/2169] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:31:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 03:31:42.045455 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c2812c-790e-4a3a-bff9-2832b92c4f4d None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:42.047683 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-83c2812c-790e-4a3a-bff9-2832b92c4f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:31:42.066126 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c2812c-790e-4a3a-bff9-2832b92c4f4d None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:42.079118 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb510739-e0bd-4d48-ad85-4172c51af19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:42.079839 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb510739-e0bd-4d48-ad85-4172c51af19e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:42.080128 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb510739-e0bd-4d48-ad85-4172c51af19e admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:42.080407 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb510739-e0bd-4d48-ad85-4172c51af19e admin admin] PATH_INFO: `/v3/projects/c6f848838bf045e8a489232e1f98211e` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:42.081562 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb510739-e0bd-4d48-ad85-4172c51af19e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6f848838bf045e8a489232e1f98211e)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:42.083561 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb510739-e0bd-4d48-ad85-4172c51af19e admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:42.192828 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-fb510739-e0bd-4d48-ad85-4172c51af19e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6f848838bf045e8a489232e1f98211e', 'request_id': 'req-fb510739-e0bd-4d48-ad85-4172c51af19e'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:42.201833 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-fb510739-e0bd-4d48-ad85-4172c51af19e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6f848838bf045e8a489232e1f98211e', 'request_id': 'req-fb510739-e0bd-4d48-ad85-4172c51af19e'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:42.216590 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-fb510739-e0bd-4d48-ad85-4172c51af19e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6f848838bf045e8a489232e1f98211e', 'request_id': 'req-fb510739-e0bd-4d48-ad85-4172c51af19e'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:42.267282 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-fb510739-e0bd-4d48-ad85-4172c51af19e admin admin] The token cache is being invalidate because project c6f848838bf045e8a489232e1f98211e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:31:42.267974 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-fb510739-e0bd-4d48-ad85-4172c51af19e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:42.268967 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-fb510739-e0bd-4d48-ad85-4172c51af19e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:42.283681 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1080/2170] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:31:42 2022] DELETE /identity/v3/projects/c6f848838bf045e8a489232e1f98211e => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:31:42.729733 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34685042-02d4-405c-a677-f7398b1af9ea service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:42.731604 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-34685042-02d4-405c-a677-f7398b1af9ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:31:42.777233 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34685042-02d4-405c-a677-f7398b1af9ea service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:42.895329 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6062c2-de77-46aa-8a93-cacee6ea3e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:42.896280 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6062c2-de77-46aa-8a93-cacee6ea3e3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:42.896934 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6062c2-de77-46aa-8a93-cacee6ea3e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:42.897352 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6062c2-de77-46aa-8a93-cacee6ea3e3e admin admin] PATH_INFO: `/v3/users/d3328254181245a0b27416936a0ec97e` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:42.899624 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6062c2-de77-46aa-8a93-cacee6ea3e3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3328254181245a0b27416936a0ec97e)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:42.901903 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6062c2-de77-46aa-8a93-cacee6ea3e3e admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:42.968704 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-1b6062c2-de77-46aa-8a93-cacee6ea3e3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3328254181245a0b27416936a0ec97e'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:42.975968 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-1b6062c2-de77-46aa-8a93-cacee6ea3e3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3328254181245a0b27416936a0ec97e'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:42.990372 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-1b6062c2-de77-46aa-8a93-cacee6ea3e3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3328254181245a0b27416936a0ec97e'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:42.992010 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-1b6062c2-de77-46aa-8a93-cacee6ea3e3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3328254181245a0b27416936a0ec97e'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:43.017014 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-1b6062c2-de77-46aa-8a93-cacee6ea3e3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3328254181245a0b27416936a0ec97e'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:43.034054 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1091/2171] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:31:42 2022] DELETE /identity/v3/users/d3328254181245a0b27416936a0ec97e => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:31:43.039228 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda8db3-175f-4b38-8aff-f4708a4c40d0 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:43.039639 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda8db3-175f-4b38-8aff-f4708a4c40d0 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:43.039776 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda8db3-175f-4b38-8aff-f4708a4c40d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:43.067226 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-edda8db3-175f-4b38-8aff-f4708a4c40d0 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:31:43.069495 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-edda8db3-175f-4b38-8aff-f4708a4c40d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:31:43.079566 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:31:43.159416 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1081/2172] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:31:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:31:43.165579 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6062c2-de77-46aa-8a93-cacee6ea3e3e admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:43.167547 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-1b6062c2-de77-46aa-8a93-cacee6ea3e3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:31:43.265343 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6062c2-de77-46aa-8a93-cacee6ea3e3e admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:43.266803 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26b88f7-9b56-4aa5-9b88-8a37100bc783 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:43.267412 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b88f7-9b56-4aa5-9b88-8a37100bc783 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:43.267726 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b88f7-9b56-4aa5-9b88-8a37100bc783 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:43.267997 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b88f7-9b56-4aa5-9b88-8a37100bc783 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:43.279360 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26b88f7-9b56-4aa5-9b88-8a37100bc783 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:43.280811 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26b88f7-9b56-4aa5-9b88-8a37100bc783 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:43.306111 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1092/2173] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:31:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:31:43.685884 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edda8db3-175f-4b38-8aff-f4708a4c40d0 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:43.687462 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-edda8db3-175f-4b38-8aff-f4708a4c40d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:31:43.726317 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edda8db3-175f-4b38-8aff-f4708a4c40d0 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:43.751777 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e0572-31d4-4e6f-b9d2-0d5162aa5643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:43.752528 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e0572-31d4-4e6f-b9d2-0d5162aa5643 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:43.752884 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e0572-31d4-4e6f-b9d2-0d5162aa5643 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:43.753249 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e0572-31d4-4e6f-b9d2-0d5162aa5643 admin admin] PATH_INFO: `/v3/projects/2008cdc5ba9c49018f0e276610251cb4` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:43.754488 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6e0572-31d4-4e6f-b9d2-0d5162aa5643 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2008cdc5ba9c49018f0e276610251cb4)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:43.757267 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6e0572-31d4-4e6f-b9d2-0d5162aa5643 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:43.867151 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-4e6e0572-31d4-4e6f-b9d2-0d5162aa5643 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2008cdc5ba9c49018f0e276610251cb4', 'request_id': 'req-4e6e0572-31d4-4e6f-b9d2-0d5162aa5643'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:43.883527 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-4e6e0572-31d4-4e6f-b9d2-0d5162aa5643 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2008cdc5ba9c49018f0e276610251cb4', 'request_id': 'req-4e6e0572-31d4-4e6f-b9d2-0d5162aa5643'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:43.890665 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-4e6e0572-31d4-4e6f-b9d2-0d5162aa5643 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2008cdc5ba9c49018f0e276610251cb4', 'request_id': 'req-4e6e0572-31d4-4e6f-b9d2-0d5162aa5643'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:43.906100 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-4e6e0572-31d4-4e6f-b9d2-0d5162aa5643 admin admin] The token cache is being invalidate because project 2008cdc5ba9c49018f0e276610251cb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:31:43.906406 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-4e6e0572-31d4-4e6f-b9d2-0d5162aa5643 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:43.907050 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-4e6e0572-31d4-4e6f-b9d2-0d5162aa5643 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:43.912047 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1082/2174] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:31:43 2022] DELETE /identity/v3/projects/2008cdc5ba9c49018f0e276610251cb4 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:31:43.913976 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26b88f7-9b56-4aa5-9b88-8a37100bc783 service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:43.930624 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26b88f7-9b56-4aa5-9b88-8a37100bc783 service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:43.941397 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:31:44.026583 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45aecd8-a5a8-4c13-ad1f-59307547d2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:44.027454 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45aecd8-a5a8-4c13-ad1f-59307547d2e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:44.028125 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45aecd8-a5a8-4c13-ad1f-59307547d2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:44.029301 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45aecd8-a5a8-4c13-ad1f-59307547d2e6 admin admin] PATH_INFO: `/v3/users/47a552202bab4d06b6b2b72b2d58db51` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:44.051523 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45aecd8-a5a8-4c13-ad1f-59307547d2e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47a552202bab4d06b6b2b72b2d58db51)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:44.051523 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45aecd8-a5a8-4c13-ad1f-59307547d2e6 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:44.117001 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-f45aecd8-a5a8-4c13-ad1f-59307547d2e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47a552202bab4d06b6b2b72b2d58db51'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:44.118147 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-f45aecd8-a5a8-4c13-ad1f-59307547d2e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47a552202bab4d06b6b2b72b2d58db51'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:44.132443 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-f45aecd8-a5a8-4c13-ad1f-59307547d2e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47a552202bab4d06b6b2b72b2d58db51'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:44.133296 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-f45aecd8-a5a8-4c13-ad1f-59307547d2e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47a552202bab4d06b6b2b72b2d58db51'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:44.148589 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-f45aecd8-a5a8-4c13-ad1f-59307547d2e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47a552202bab4d06b6b2b72b2d58db51'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:44.165844 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1093/2175] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:31:43 2022] DELETE /identity/v3/users/47a552202bab4d06b6b2b72b2d58db51 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 03:31:44.670712 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e0572-31d4-4e6f-b9d2-0d5162aa5643 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:44.672193 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-4e6e0572-31d4-4e6f-b9d2-0d5162aa5643 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:31:44.692873 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e0572-31d4-4e6f-b9d2-0d5162aa5643 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:44.851411 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db5019e-d6fe-40d8-b429-34b943566902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:44.852182 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5019e-d6fe-40d8-b429-34b943566902 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:44.852469 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5019e-d6fe-40d8-b429-34b943566902 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:44.852784 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5019e-d6fe-40d8-b429-34b943566902 admin admin] PATH_INFO: `/v3/projects/12f57de34293430cb7c37fb30dc1f16d` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:44.854496 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db5019e-d6fe-40d8-b429-34b943566902 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12f57de34293430cb7c37fb30dc1f16d)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:44.856759 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db5019e-d6fe-40d8-b429-34b943566902 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:44.923249 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:31:44.932946 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-5db5019e-d6fe-40d8-b429-34b943566902 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12f57de34293430cb7c37fb30dc1f16d', 'request_id': 'req-5db5019e-d6fe-40d8-b429-34b943566902'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:44.941725 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-5db5019e-d6fe-40d8-b429-34b943566902 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12f57de34293430cb7c37fb30dc1f16d', 'request_id': 'req-5db5019e-d6fe-40d8-b429-34b943566902'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:44.952243 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-5db5019e-d6fe-40d8-b429-34b943566902 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12f57de34293430cb7c37fb30dc1f16d', 'request_id': 'req-5db5019e-d6fe-40d8-b429-34b943566902'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:44.971461 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-5db5019e-d6fe-40d8-b429-34b943566902 admin admin] The token cache is being invalidate because project 12f57de34293430cb7c37fb30dc1f16d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:31:44.972088 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-5db5019e-d6fe-40d8-b429-34b943566902 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:44.972991 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-5db5019e-d6fe-40d8-b429-34b943566902 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:44.975965 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1083/2176] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:31:44 2022] DELETE /identity/v3/projects/12f57de34293430cb7c37fb30dc1f16d => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:31:44.981344 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d4b12-ea2f-4667-b9c3-55cec4491347 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:44.982206 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d4b12-ea2f-4667-b9c3-55cec4491347 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:44.982646 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d4b12-ea2f-4667-b9c3-55cec4491347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:45.008309 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-432d4b12-ea2f-4667-b9c3-55cec4491347 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:31:45.010054 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-432d4b12-ea2f-4667-b9c3-55cec4491347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:31:45.171085 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1094/2177] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:31:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:31:45.172887 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef75363-edfb-4342-8e7d-18e9af04bc73 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:45.173563 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef75363-edfb-4342-8e7d-18e9af04bc73 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:45.173948 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef75363-edfb-4342-8e7d-18e9af04bc73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:45.215764 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-8ef75363-edfb-4342-8e7d-18e9af04bc73 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:31:45.217162 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-8ef75363-edfb-4342-8e7d-18e9af04bc73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:31:45.237606 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1084/2178] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:31:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:31:45.239194 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432d4b12-ea2f-4667-b9c3-55cec4491347 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:45.252552 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432d4b12-ea2f-4667-b9c3-55cec4491347 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:45.261606 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5503bc8-f83e-4ef3-b433-f65fa7d65e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:45.262945 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5503bc8-f83e-4ef3-b433-f65fa7d65e4b admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:45.263237 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5503bc8-f83e-4ef3-b433-f65fa7d65e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:45.263534 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5503bc8-f83e-4ef3-b433-f65fa7d65e4b admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:45.264359 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5503bc8-f83e-4ef3-b433-f65fa7d65e4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:31:45.264674 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5503bc8-f83e-4ef3-b433-f65fa7d65e4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:45.266396 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5503bc8-f83e-4ef3-b433-f65fa7d65e4b admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:45.284753 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1095/2179] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 03:31:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:31:45.285909 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef75363-edfb-4342-8e7d-18e9af04bc73 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:45.298621 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef75363-edfb-4342-8e7d-18e9af04bc73 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:45.306215 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5550ac8-c290-42db-a6ab-c2c28ad31156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:45.306836 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5550ac8-c290-42db-a6ab-c2c28ad31156 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:45.307128 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5550ac8-c290-42db-a6ab-c2c28ad31156 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:45.307993 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5550ac8-c290-42db-a6ab-c2c28ad31156 admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:45.308663 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5550ac8-c290-42db-a6ab-c2c28ad31156 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:45.311724 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5550ac8-c290-42db-a6ab-c2c28ad31156 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:45.358262 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1085/2180] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:31:45 2022] POST /identity/v3/projects => generated 383 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:31:45.359603 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5503bc8-f83e-4ef3-b433-f65fa7d65e4b admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:45.378292 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5503bc8-f83e-4ef3-b433-f65fa7d65e4b admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:45.401266 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:31:45.497999 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e43dfc-9c98-4e43-87dd-8e8a6fcde9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:45.498748 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e43dfc-9c98-4e43-87dd-8e8a6fcde9d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:45.499058 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e43dfc-9c98-4e43-87dd-8e8a6fcde9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:45.499308 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e43dfc-9c98-4e43-87dd-8e8a6fcde9d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:45.500166 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e43dfc-9c98-4e43-87dd-8e8a6fcde9d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:45.503150 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e43dfc-9c98-4e43-87dd-8e8a6fcde9d9 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:45.544313 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1096/2181] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:31:45 2022] POST /identity/v3/users => generated 292 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:31:45.546016 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5550ac8-c290-42db-a6ab-c2c28ad31156 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:45.573583 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5550ac8-c290-42db-a6ab-c2c28ad31156 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:45.598158 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7a64e6-0524-4126-a678-6601d62fe9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:45.598782 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a64e6-0524-4126-a678-6601d62fe9e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:45.599065 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a64e6-0524-4126-a678-6601d62fe9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:45.599341 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a64e6-0524-4126-a678-6601d62fe9e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:45.600390 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7a64e6-0524-4126-a678-6601d62fe9e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:45.602145 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7a64e6-0524-4126-a678-6601d62fe9e6 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:45.639849 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1086/2182] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:31:45 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:31:45.642415 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e43dfc-9c98-4e43-87dd-8e8a6fcde9d9 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:45.667023 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e43dfc-9c98-4e43-87dd-8e8a6fcde9d9 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:45.674822 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c26e0d-1346-40fe-8192-b158a47bb058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:45.675609 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c26e0d-1346-40fe-8192-b158a47bb058 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:45.675996 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c26e0d-1346-40fe-8192-b158a47bb058 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:45.676376 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c26e0d-1346-40fe-8192-b158a47bb058 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:45.677122 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c26e0d-1346-40fe-8192-b158a47bb058 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:45.679388 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c26e0d-1346-40fe-8192-b158a47bb058 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:45.692530 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1097/2183] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:31:45 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:31:45.696709 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7a64e6-0524-4126-a678-6601d62fe9e6 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:45.711672 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7a64e6-0524-4126-a678-6601d62fe9e6 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:45.718097 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c821edf-e4f7-4edb-98bd-1f902faa06cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:45.721415 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c821edf-e4f7-4edb-98bd-1f902faa06cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:45.721770 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c821edf-e4f7-4edb-98bd-1f902faa06cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:45.722004 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c821edf-e4f7-4edb-98bd-1f902faa06cc admin admin] PATH_INFO: `/v3/projects/3e3087acde43438cb0a969b4b9b37604/users/e51922258251410ab2308a001ad190a4/roles/04d0e4575a28440eb4349b4a6565e8b8` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:45.750958 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c821edf-e4f7-4edb-98bd-1f902faa06cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e3087acde43438cb0a969b4b9b37604, user_id=e51922258251410ab2308a001ad190a4, role_id=04d0e4575a28440eb4349b4a6565e8b8)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:45.753654 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c821edf-e4f7-4edb-98bd-1f902faa06cc admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:45.778686 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1087/2184] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:31:45 2022] PUT /identity/v3/projects/3e3087acde43438cb0a969b4b9b37604/users/e51922258251410ab2308a001ad190a4/roles/04d0e4575a28440eb4349b4a6565e8b8 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:31:45.789527 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca9249-f65c-4610-bdb9-dc405f2f9846 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:45.789975 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca9249-f65c-4610-bdb9-dc405f2f9846 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:45.790355 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca9249-f65c-4610-bdb9-dc405f2f9846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:45.888622 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-1eca9249-f65c-4610-bdb9-dc405f2f9846 None None] MFA Rules not processed for user `e51922258251410ab2308a001ad190a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:31:45.890027 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-1eca9249-f65c-4610-bdb9-dc405f2f9846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:31:45.930347 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc7dad-fdc2-48f8-bf46-1966da7c94c6 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:45.930482 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc7dad-fdc2-48f8-bf46-1966da7c94c6 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:45.930654 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc7dad-fdc2-48f8-bf46-1966da7c94c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:45.955690 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-09bc7dad-fdc2-48f8-bf46-1966da7c94c6 None None] MFA Rules not processed for user `a267cf7109c64f538824c162fedd084b`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:31:45.957099 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-09bc7dad-fdc2-48f8-bf46-1966da7c94c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:31:46.019747 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1098/2185] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:31:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:31:46.034987 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eca9249-f65c-4610-bdb9-dc405f2f9846 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:46.036700 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-1eca9249-f65c-4610-bdb9-dc405f2f9846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:31:46.067736 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1088/2186] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:31:45 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 03:31:46.139767 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eca9249-f65c-4610-bdb9-dc405f2f9846 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:46.144971 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f14d5b0-e17d-48e9-9e4a-663517e905e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f537aabf3d1040ff840b02616f839975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:46.145730 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f14d5b0-e17d-48e9-9e4a-663517e905e8 service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:46.146021 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f14d5b0-e17d-48e9-9e4a-663517e905e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:46.146295 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f14d5b0-e17d-48e9-9e4a-663517e905e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:46.156652 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f14d5b0-e17d-48e9-9e4a-663517e905e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:46.158153 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f14d5b0-e17d-48e9-9e4a-663517e905e8 service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:46.176272 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1099/2187] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:31:46 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:31:46.369008 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9821c-d10a-494a-9230-98b286f0cdbd None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:46.369620 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9821c-d10a-494a-9230-98b286f0cdbd None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:46.371685 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9821c-d10a-494a-9230-98b286f0cdbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:46.423679 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-22e9821c-d10a-494a-9230-98b286f0cdbd None None] MFA Rules not processed for user `bef61ef12079495ba72b7fcd2717aca2`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:31:46.424448 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-22e9821c-d10a-494a-9230-98b286f0cdbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:31:46.537644 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1089/2188] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Oct 4 03:31:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:31:46.546407 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f14d5b0-e17d-48e9-9e4a-663517e905e8 service cinder] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:46.548237 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-2f14d5b0-e17d-48e9-9e4a-663517e905e8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:31:46.626134 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:31:46.764802 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f14d5b0-e17d-48e9-9e4a-663517e905e8 service cinder] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:46.781623 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e688cec4-7359-4ba6-9a83-caff4e3b5bcd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8da6bacc8f432e8f48bb99c7aede11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:46.782452 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e688cec4-7359-4ba6-9a83-caff4e3b5bcd service swift] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:46.782772 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e688cec4-7359-4ba6-9a83-caff4e3b5bcd service swift] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:46.783174 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e688cec4-7359-4ba6-9a83-caff4e3b5bcd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:46.814721 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e688cec4-7359-4ba6-9a83-caff4e3b5bcd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:46.816601 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e688cec4-7359-4ba6-9a83-caff4e3b5bcd service swift] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:46.828282 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1100/2189] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Oct 4 03:31:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 03:31:49.594770 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e9821c-d10a-494a-9230-98b286f0cdbd None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:49.627942 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:31:49.832007 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e9821c-d10a-494a-9230-98b286f0cdbd None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:49.855103 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684a8ec8-ad38-4747-8326-6806cb389f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:49.855103 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a8ec8-ad38-4747-8326-6806cb389f63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:49.855103 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a8ec8-ad38-4747-8326-6806cb389f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:49.855103 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a8ec8-ad38-4747-8326-6806cb389f63 admin admin] PATH_INFO: `/v3/users/e51922258251410ab2308a001ad190a4` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:49.857087 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684a8ec8-ad38-4747-8326-6806cb389f63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e51922258251410ab2308a001ad190a4)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:49.859208 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684a8ec8-ad38-4747-8326-6806cb389f63 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:49.982691 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-684a8ec8-ad38-4747-8326-6806cb389f63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e51922258251410ab2308a001ad190a4'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:49.998896 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-684a8ec8-ad38-4747-8326-6806cb389f63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e51922258251410ab2308a001ad190a4'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:50.013769 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-684a8ec8-ad38-4747-8326-6806cb389f63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e51922258251410ab2308a001ad190a4'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:50.015021 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-684a8ec8-ad38-4747-8326-6806cb389f63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e51922258251410ab2308a001ad190a4'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:50.059945 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-684a8ec8-ad38-4747-8326-6806cb389f63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e51922258251410ab2308a001ad190a4'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:50.070155 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1090/2190] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:31:49 2022] DELETE /identity/v3/users/e51922258251410ab2308a001ad190a4 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:31:50.074446 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad7f91-ef6b-4505-a5fb-c29d3dbb47f9 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:50.075114 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad7f91-ef6b-4505-a5fb-c29d3dbb47f9 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:50.075114 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad7f91-ef6b-4505-a5fb-c29d3dbb47f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:50.114699 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-34ad7f91-ef6b-4505-a5fb-c29d3dbb47f9 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:31:50.116540 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-34ad7f91-ef6b-4505-a5fb-c29d3dbb47f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:31:50.266964 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1101/2191] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:31:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:31:50.274158 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684a8ec8-ad38-4747-8326-6806cb389f63 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:50.276279 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-684a8ec8-ad38-4747-8326-6806cb389f63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:31:50.442114 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684a8ec8-ad38-4747-8326-6806cb389f63 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:50.446847 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89251d33-a45c-403b-a83b-981722d5e592 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:50.447402 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89251d33-a45c-403b-a83b-981722d5e592 service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:50.447725 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89251d33-a45c-403b-a83b-981722d5e592 service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:50.447961 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89251d33-a45c-403b-a83b-981722d5e592 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:50.470208 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89251d33-a45c-403b-a83b-981722d5e592 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:50.471833 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89251d33-a45c-403b-a83b-981722d5e592 service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:50.497422 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1091/2192] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:31:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:31:51.137727 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad7f91-ef6b-4505-a5fb-c29d3dbb47f9 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:51.139791 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-34ad7f91-ef6b-4505-a5fb-c29d3dbb47f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:31:51.166131 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad7f91-ef6b-4505-a5fb-c29d3dbb47f9 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:51.172278 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204693dd-5b05-4e53-ae8f-fd8bfc1ec959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:51.174046 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204693dd-5b05-4e53-ae8f-fd8bfc1ec959 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:51.174645 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204693dd-5b05-4e53-ae8f-fd8bfc1ec959 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:51.175113 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204693dd-5b05-4e53-ae8f-fd8bfc1ec959 admin admin] PATH_INFO: `/v3/projects/3e3087acde43438cb0a969b4b9b37604` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:51.176775 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204693dd-5b05-4e53-ae8f-fd8bfc1ec959 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e3087acde43438cb0a969b4b9b37604)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:51.180072 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204693dd-5b05-4e53-ae8f-fd8bfc1ec959 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:51.253820 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-204693dd-5b05-4e53-ae8f-fd8bfc1ec959 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e3087acde43438cb0a969b4b9b37604', 'request_id': 'req-204693dd-5b05-4e53-ae8f-fd8bfc1ec959'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:51.261580 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-204693dd-5b05-4e53-ae8f-fd8bfc1ec959 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e3087acde43438cb0a969b4b9b37604', 'request_id': 'req-204693dd-5b05-4e53-ae8f-fd8bfc1ec959'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:51.269305 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-204693dd-5b05-4e53-ae8f-fd8bfc1ec959 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e3087acde43438cb0a969b4b9b37604', 'request_id': 'req-204693dd-5b05-4e53-ae8f-fd8bfc1ec959'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:51.289085 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-204693dd-5b05-4e53-ae8f-fd8bfc1ec959 admin admin] The token cache is being invalidate because project 3e3087acde43438cb0a969b4b9b37604 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:31:51.289383 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-204693dd-5b05-4e53-ae8f-fd8bfc1ec959 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:51.290087 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-204693dd-5b05-4e53-ae8f-fd8bfc1ec959 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:51.292022 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1102/2193] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:31:51 2022] DELETE /identity/v3/projects/3e3087acde43438cb0a969b4b9b37604 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:31:51.296594 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97bb184-fc2a-4ad9-8998-582450adf22f None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:51.297112 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97bb184-fc2a-4ad9-8998-582450adf22f None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:51.297215 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97bb184-fc2a-4ad9-8998-582450adf22f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:51.348394 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-a97bb184-fc2a-4ad9-8998-582450adf22f None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:31:51.348394 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-a97bb184-fc2a-4ad9-8998-582450adf22f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:31:51.391518 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:31:51.440499 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1092/2194] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:31:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:31:51.450459 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790cd6bf-5a34-49a0-b070-c043344a8b88 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:51.450747 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790cd6bf-5a34-49a0-b070-c043344a8b88 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:51.451040 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790cd6bf-5a34-49a0-b070-c043344a8b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:51.472664 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-790cd6bf-5a34-49a0-b070-c043344a8b88 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:31:51.474007 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-790cd6bf-5a34-49a0-b070-c043344a8b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:31:51.486984 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1103/2195] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:31:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:31:51.488668 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97bb184-fc2a-4ad9-8998-582450adf22f None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:51.503559 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97bb184-fc2a-4ad9-8998-582450adf22f None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:51.510827 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b007da6c-5b7c-4d2c-a4a3-5c579cc899c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:51.511573 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b007da6c-5b7c-4d2c-a4a3-5c579cc899c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:51.511896 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b007da6c-5b7c-4d2c-a4a3-5c579cc899c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:51.512241 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b007da6c-5b7c-4d2c-a4a3-5c579cc899c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:51.513072 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b007da6c-5b7c-4d2c-a4a3-5c579cc899c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:31:51.513480 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b007da6c-5b7c-4d2c-a4a3-5c579cc899c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:51.515574 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b007da6c-5b7c-4d2c-a4a3-5c579cc899c9 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:51.534229 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1093/2196] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 03:31:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:31:51.538319 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790cd6bf-5a34-49a0-b070-c043344a8b88 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:51.557441 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790cd6bf-5a34-49a0-b070-c043344a8b88 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:51.567544 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7b6616-e5fa-4285-9cf1-a8b197602b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:51.569427 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7b6616-e5fa-4285-9cf1-a8b197602b81 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:51.570450 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7b6616-e5fa-4285-9cf1-a8b197602b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:51.570719 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7b6616-e5fa-4285-9cf1-a8b197602b81 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:51.571372 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7b6616-e5fa-4285-9cf1-a8b197602b81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:51.573468 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7b6616-e5fa-4285-9cf1-a8b197602b81 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:51.613816 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1104/2197] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:31:51 2022] POST /identity/v3/projects => generated 381 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:31:51.620148 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b007da6c-5b7c-4d2c-a4a3-5c579cc899c9 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:51.633606 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b007da6c-5b7c-4d2c-a4a3-5c579cc899c9 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:51.767202 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61907e35-628d-4678-a952-6af40715db39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:51.768036 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61907e35-628d-4678-a952-6af40715db39 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:51.768495 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61907e35-628d-4678-a952-6af40715db39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:51.768833 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61907e35-628d-4678-a952-6af40715db39 admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:51.769484 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61907e35-628d-4678-a952-6af40715db39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:51.771477 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61907e35-628d-4678-a952-6af40715db39 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:51.805345 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1094/2198] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:31:51 2022] POST /identity/v3/users => generated 291 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:31:51.809171 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7b6616-e5fa-4285-9cf1-a8b197602b81 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:51.828588 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7b6616-e5fa-4285-9cf1-a8b197602b81 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:51.835571 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd8ebee-5347-4429-bf9b-b754e49f0ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:51.836665 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd8ebee-5347-4429-bf9b-b754e49f0ab2 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:51.837096 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd8ebee-5347-4429-bf9b-b754e49f0ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:51.837533 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd8ebee-5347-4429-bf9b-b754e49f0ab2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:51.838326 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd8ebee-5347-4429-bf9b-b754e49f0ab2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:51.841561 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd8ebee-5347-4429-bf9b-b754e49f0ab2 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:51.858218 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1105/2199] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:31:51 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:31:51.863023 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61907e35-628d-4678-a952-6af40715db39 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:51.877319 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61907e35-628d-4678-a952-6af40715db39 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:51.882704 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952b8b57-f023-457f-a79e-4e988a516f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:51.883312 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b8b57-f023-457f-a79e-4e988a516f27 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:51.883631 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b8b57-f023-457f-a79e-4e988a516f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:51.883915 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b8b57-f023-457f-a79e-4e988a516f27 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:51.884558 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952b8b57-f023-457f-a79e-4e988a516f27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:51.886146 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952b8b57-f023-457f-a79e-4e988a516f27 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:51.906890 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1095/2200] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:31:51 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:31:51.910724 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd8ebee-5347-4429-bf9b-b754e49f0ab2 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:51.918773 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:31:51.926184 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd8ebee-5347-4429-bf9b-b754e49f0ab2 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:51.937121 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4610a75b-7ba7-495a-be38-05eacd3abbe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:51.937790 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610a75b-7ba7-495a-be38-05eacd3abbe5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:51.938070 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610a75b-7ba7-495a-be38-05eacd3abbe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:51.938352 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610a75b-7ba7-495a-be38-05eacd3abbe5 admin admin] PATH_INFO: `/v3/projects/3edbcf8484374dab9697bab576e6afdb/users/4d1b67fec65345d3b7973445eab896b2/roles/04d0e4575a28440eb4349b4a6565e8b8` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:51.959773 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4610a75b-7ba7-495a-be38-05eacd3abbe5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3edbcf8484374dab9697bab576e6afdb, user_id=4d1b67fec65345d3b7973445eab896b2, role_id=04d0e4575a28440eb4349b4a6565e8b8)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:51.963027 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4610a75b-7ba7-495a-be38-05eacd3abbe5 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:51.982519 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1106/2201] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:31:51 2022] PUT /identity/v3/projects/3edbcf8484374dab9697bab576e6afdb/users/4d1b67fec65345d3b7973445eab896b2/roles/04d0e4575a28440eb4349b4a6565e8b8 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:31:51.987863 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce4898-9b58-43e2-be2d-51a43ffe63e1 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:51.989398 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce4898-9b58-43e2-be2d-51a43ffe63e1 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:51.989487 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce4898-9b58-43e2-be2d-51a43ffe63e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:52.028081 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-90ce4898-9b58-43e2-be2d-51a43ffe63e1 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:31:52.030111 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-90ce4898-9b58-43e2-be2d-51a43ffe63e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:31:52.170234 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1096/2202] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:31:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:31:52.182588 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4610a75b-7ba7-495a-be38-05eacd3abbe5 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:52.184295 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-4610a75b-7ba7-495a-be38-05eacd3abbe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:31:52.258766 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1941340d-bb91-48b2-a37d-00c1fab0b992 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:52.259262 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1941340d-bb91-48b2-a37d-00c1fab0b992 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:52.260010 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1941340d-bb91-48b2-a37d-00c1fab0b992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:52.296105 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-1941340d-bb91-48b2-a37d-00c1fab0b992 None None] MFA Rules not processed for user `bef61ef12079495ba72b7fcd2717aca2`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:31:52.297633 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-1941340d-bb91-48b2-a37d-00c1fab0b992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:31:52.298304 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4610a75b-7ba7-495a-be38-05eacd3abbe5 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:52.302140 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962d2113-32dc-4702-8409-0aa84f591875 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:52.303547 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d2113-32dc-4702-8409-0aa84f591875 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:52.304013 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d2113-32dc-4702-8409-0aa84f591875 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:52.304427 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d2113-32dc-4702-8409-0aa84f591875 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:52.314874 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962d2113-32dc-4702-8409-0aa84f591875 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:52.316782 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962d2113-32dc-4702-8409-0aa84f591875 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:52.333209 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1107/2203] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:31:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:31:52.370419 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:31:52.471414 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1097/2204] 10.222.0.25 () {58 vars in 967 bytes} [Tue Oct 4 03:31:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 03:31:52.496232 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962d2113-32dc-4702-8409-0aa84f591875 service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:52.498244 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-962d2113-32dc-4702-8409-0aa84f591875 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:31:52.663208 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962d2113-32dc-4702-8409-0aa84f591875 service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:52.690337 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d114e2-f36d-45fd-95c5-776b98ed01e9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8da6bacc8f432e8f48bb99c7aede11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:52.692883 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d114e2-f36d-45fd-95c5-776b98ed01e9 service swift] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:52.694221 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d114e2-f36d-45fd-95c5-776b98ed01e9 service swift] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:52.694749 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d114e2-f36d-45fd-95c5-776b98ed01e9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:52.715513 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d114e2-f36d-45fd-95c5-776b98ed01e9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:52.718635 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d114e2-f36d-45fd-95c5-776b98ed01e9 service swift] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:52.730971 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1108/2205] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Oct 4 03:31:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 03:31:53.793008 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a9f3a-8af9-4735-8ba6-d6a8cce98c32 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:53.793933 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a9f3a-8af9-4735-8ba6-d6a8cce98c32 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:53.794498 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a9f3a-8af9-4735-8ba6-d6a8cce98c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:53.857046 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-9f6a9f3a-8af9-4735-8ba6-d6a8cce98c32 None None] MFA Rules not processed for user `4d1b67fec65345d3b7973445eab896b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:31:53.858974 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-9f6a9f3a-8af9-4735-8ba6-d6a8cce98c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:31:54.059403 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1098/2206] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:31:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:31:54.060484 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d114e2-f36d-45fd-95c5-776b98ed01e9 service swift] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:54.062446 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-c1d114e2-f36d-45fd-95c5-776b98ed01e9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:31:54.196548 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d114e2-f36d-45fd-95c5-776b98ed01e9 service swift] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:54.202048 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f9ae34-02fd-415c-a3b5-fd3010882720 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f537aabf3d1040ff840b02616f839975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:54.202973 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9ae34-02fd-415c-a3b5-fd3010882720 service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:54.203412 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9ae34-02fd-415c-a3b5-fd3010882720 service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:54.203895 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9ae34-02fd-415c-a3b5-fd3010882720 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:54.216491 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f9ae34-02fd-415c-a3b5-fd3010882720 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:54.219016 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f9ae34-02fd-415c-a3b5-fd3010882720 service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:54.234689 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1109/2207] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:31:54 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 03:31:55.840268 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56388328-4444-4bae-9c62-199a0218352f None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:55.841234 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56388328-4444-4bae-9c62-199a0218352f None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:55.841745 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56388328-4444-4bae-9c62-199a0218352f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:55.866972 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-56388328-4444-4bae-9c62-199a0218352f None None] MFA Rules not processed for user `4d1b67fec65345d3b7973445eab896b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:31:55.868680 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-56388328-4444-4bae-9c62-199a0218352f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:31:55.887337 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f9ae34-02fd-415c-a3b5-fd3010882720 service cinder] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:55.887337 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-e2f9ae34-02fd-415c-a3b5-fd3010882720 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:31:55.888399 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1099/2208] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:31:55 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:31:55.908668 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f9ae34-02fd-415c-a3b5-fd3010882720 service cinder] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:55.914627 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc845ce6-6bf6-4588-80d1-10b8c1ba3503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:55.915730 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc845ce6-6bf6-4588-80d1-10b8c1ba3503 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:55.916188 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc845ce6-6bf6-4588-80d1-10b8c1ba3503 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:55.916742 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc845ce6-6bf6-4588-80d1-10b8c1ba3503 admin admin] PATH_INFO: `/v3/users/72b10acbb8324d1e98d17fbaf7ed732a` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:55.918773 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc845ce6-6bf6-4588-80d1-10b8c1ba3503 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72b10acbb8324d1e98d17fbaf7ed732a)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:55.926894 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc845ce6-6bf6-4588-80d1-10b8c1ba3503 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:55.938440 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:31:56.048331 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-fc845ce6-6bf6-4588-80d1-10b8c1ba3503 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72b10acbb8324d1e98d17fbaf7ed732a'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:56.049035 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-fc845ce6-6bf6-4588-80d1-10b8c1ba3503 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72b10acbb8324d1e98d17fbaf7ed732a'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:56.069385 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-fc845ce6-6bf6-4588-80d1-10b8c1ba3503 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72b10acbb8324d1e98d17fbaf7ed732a'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:56.070671 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-fc845ce6-6bf6-4588-80d1-10b8c1ba3503 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72b10acbb8324d1e98d17fbaf7ed732a'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:56.093500 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-fc845ce6-6bf6-4588-80d1-10b8c1ba3503 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72b10acbb8324d1e98d17fbaf7ed732a'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:56.110014 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1110/2209] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:31:55 2022] DELETE /identity/v3/users/72b10acbb8324d1e98d17fbaf7ed732a => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 03:31:56.514943 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56388328-4444-4bae-9c62-199a0218352f None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:56.531639 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56388328-4444-4bae-9c62-199a0218352f None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:56.624971 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119deffe-441d-437a-9dc3-9582bde2ece1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:56.626366 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119deffe-441d-437a-9dc3-9582bde2ece1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:56.626829 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119deffe-441d-437a-9dc3-9582bde2ece1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:56.627375 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119deffe-441d-437a-9dc3-9582bde2ece1 admin admin] PATH_INFO: `/v3/projects/5424983f421548c3b6857a0e56aa08c6` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:56.628857 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119deffe-441d-437a-9dc3-9582bde2ece1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5424983f421548c3b6857a0e56aa08c6)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:56.633174 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119deffe-441d-437a-9dc3-9582bde2ece1 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:56.726037 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-119deffe-441d-437a-9dc3-9582bde2ece1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5424983f421548c3b6857a0e56aa08c6', 'request_id': 'req-119deffe-441d-437a-9dc3-9582bde2ece1'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:56.735633 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-119deffe-441d-437a-9dc3-9582bde2ece1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5424983f421548c3b6857a0e56aa08c6', 'request_id': 'req-119deffe-441d-437a-9dc3-9582bde2ece1'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:56.759046 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-119deffe-441d-437a-9dc3-9582bde2ece1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5424983f421548c3b6857a0e56aa08c6', 'request_id': 'req-119deffe-441d-437a-9dc3-9582bde2ece1'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:56.781821 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:31:56.789715 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-119deffe-441d-437a-9dc3-9582bde2ece1 admin admin] The token cache is being invalidate because project 5424983f421548c3b6857a0e56aa08c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:31:56.790038 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-119deffe-441d-437a-9dc3-9582bde2ece1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:56.791858 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-119deffe-441d-437a-9dc3-9582bde2ece1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:31:56.800865 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1100/2210] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:31:56 2022] DELETE /identity/v3/projects/5424983f421548c3b6857a0e56aa08c6 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:31:56.802298 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e9f8a-b1cc-44ce-b955-6a39660cf323 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:56.802940 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e9f8a-b1cc-44ce-b955-6a39660cf323 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:56.803376 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e9f8a-b1cc-44ce-b955-6a39660cf323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:56.840959 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-174e9f8a-b1cc-44ce-b955-6a39660cf323 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:31:56.842365 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-174e9f8a-b1cc-44ce-b955-6a39660cf323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:31:57.080137 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1111/2211] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:31:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:31:57.081427 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c726d9-481d-4346-b3fe-65a32ea1ccd3 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:57.081804 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c726d9-481d-4346-b3fe-65a32ea1ccd3 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:57.087695 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c726d9-481d-4346-b3fe-65a32ea1ccd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:57.150227 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-82c726d9-481d-4346-b3fe-65a32ea1ccd3 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:31:57.151704 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-82c726d9-481d-4346-b3fe-65a32ea1ccd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:31:57.170000 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1101/2212] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:31:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:31:57.171149 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174e9f8a-b1cc-44ce-b955-6a39660cf323 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:57.195463 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174e9f8a-b1cc-44ce-b955-6a39660cf323 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:57.216954 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a8688-4ad8-4214-b157-6a6a745783df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:57.220909 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a8688-4ad8-4214-b157-6a6a745783df admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:57.223212 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a8688-4ad8-4214-b157-6a6a745783df admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:57.223752 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a8688-4ad8-4214-b157-6a6a745783df admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:57.228181 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136a8688-4ad8-4214-b157-6a6a745783df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:31:57.233067 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136a8688-4ad8-4214-b157-6a6a745783df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:57.241646 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136a8688-4ad8-4214-b157-6a6a745783df admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:57.289747 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1112/2213] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 03:31:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:31:57.306050 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c726d9-481d-4346-b3fe-65a32ea1ccd3 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:57.369757 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c726d9-481d-4346-b3fe-65a32ea1ccd3 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:57.397778 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8c411d-d30b-4373-bb57-2588bba464ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:57.397778 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c411d-d30b-4373-bb57-2588bba464ea admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:57.397778 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c411d-d30b-4373-bb57-2588bba464ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:57.397778 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c411d-d30b-4373-bb57-2588bba464ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:57.398311 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8c411d-d30b-4373-bb57-2588bba464ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:57.400442 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8c411d-d30b-4373-bb57-2588bba464ea admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:57.497266 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a8688-4ad8-4214-b157-6a6a745783df admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:57.507838 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1102/2214] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:31:57 2022] POST /identity/v3/projects => generated 371 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:31:57.511932 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a8688-4ad8-4214-b157-6a6a745783df admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:57.716179 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e46a496-2cf9-4e7e-a129-65654d92d079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:57.717470 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46a496-2cf9-4e7e-a129-65654d92d079 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:57.720323 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46a496-2cf9-4e7e-a129-65654d92d079 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:57.720835 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46a496-2cf9-4e7e-a129-65654d92d079 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:57.723396 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e46a496-2cf9-4e7e-a129-65654d92d079 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:57.732663 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e46a496-2cf9-4e7e-a129-65654d92d079 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:57.804899 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1113/2215] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:31:57 2022] POST /identity/v3/users => generated 286 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 03:31:57.806787 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8c411d-d30b-4373-bb57-2588bba464ea admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:57.839196 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8c411d-d30b-4373-bb57-2588bba464ea admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:57.848074 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa8b6d-58f4-4eac-9ab2-65dd25788939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:57.848985 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa8b6d-58f4-4eac-9ab2-65dd25788939 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:57.849474 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa8b6d-58f4-4eac-9ab2-65dd25788939 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:57.850204 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa8b6d-58f4-4eac-9ab2-65dd25788939 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:57.852231 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aa8b6d-58f4-4eac-9ab2-65dd25788939 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:57.854686 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aa8b6d-58f4-4eac-9ab2-65dd25788939 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:57.867911 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1103/2216] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:31:57 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:31:57.871982 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e46a496-2cf9-4e7e-a129-65654d92d079 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:57.926928 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:31:57.935773 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e46a496-2cf9-4e7e-a129-65654d92d079 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:57.942482 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d478b-1369-42a5-b223-230fa49dde75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:57.943976 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d478b-1369-42a5-b223-230fa49dde75 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:57.944544 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d478b-1369-42a5-b223-230fa49dde75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:57.944983 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d478b-1369-42a5-b223-230fa49dde75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:57.945911 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4d478b-1369-42a5-b223-230fa49dde75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:57.948153 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4d478b-1369-42a5-b223-230fa49dde75 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:57.968598 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1114/2217] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:31:57 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 03:31:57.981296 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa8b6d-58f4-4eac-9ab2-65dd25788939 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:58.002641 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa8b6d-58f4-4eac-9ab2-65dd25788939 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:58.009423 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d99b4ee-d6f7-4a36-92a4-95ebbde26875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:58.010422 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99b4ee-d6f7-4a36-92a4-95ebbde26875 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:58.010422 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99b4ee-d6f7-4a36-92a4-95ebbde26875 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:58.010668 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99b4ee-d6f7-4a36-92a4-95ebbde26875 admin admin] PATH_INFO: `/v3/projects/2943e72980834a9593314b7f9c6b2640/users/26e7c51833154df9b4ba249fd92fe0b1/roles/04d0e4575a28440eb4349b4a6565e8b8` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:58.037768 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d99b4ee-d6f7-4a36-92a4-95ebbde26875 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2943e72980834a9593314b7f9c6b2640, user_id=26e7c51833154df9b4ba249fd92fe0b1, role_id=04d0e4575a28440eb4349b4a6565e8b8)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:58.041364 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d99b4ee-d6f7-4a36-92a4-95ebbde26875 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:58.101144 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1104/2218] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:31:57 2022] PUT /identity/v3/projects/2943e72980834a9593314b7f9c6b2640/users/26e7c51833154df9b4ba249fd92fe0b1/roles/04d0e4575a28440eb4349b4a6565e8b8 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:31:58.113173 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2731d14-83f1-4563-8c47-2131e23999a3 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:58.113710 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2731d14-83f1-4563-8c47-2131e23999a3 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:58.113835 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2731d14-83f1-4563-8c47-2131e23999a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:58.163298 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-a2731d14-83f1-4563-8c47-2131e23999a3 None None] MFA Rules not processed for user `26e7c51833154df9b4ba249fd92fe0b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:31:58.164816 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-a2731d14-83f1-4563-8c47-2131e23999a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:31:58.269898 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1115/2219] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:31:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:31:58.283082 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d99b4ee-d6f7-4a36-92a4-95ebbde26875 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:31:58.285315 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-9d99b4ee-d6f7-4a36-92a4-95ebbde26875 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:31:58.415177 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d99b4ee-d6f7-4a36-92a4-95ebbde26875 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:31:58.420590 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd0d399-ebda-4cf5-8265-f4424ab05db3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95be0e4e1c8641709e07b115047fb4e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:31:58.421286 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd0d399-ebda-4cf5-8265-f4424ab05db3 service glance] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:31:58.421632 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd0d399-ebda-4cf5-8265-f4424ab05db3 service glance] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:31:58.421977 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd0d399-ebda-4cf5-8265-f4424ab05db3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:31:58.434480 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd0d399-ebda-4cf5-8265-f4424ab05db3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:31:58.437268 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd0d399-ebda-4cf5-8265-f4424ab05db3 service glance] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:31:58.456732 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1105/2220] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:31:58 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:32:08.263961 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=36 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:32:08.445121 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=62,keystone:INSERT=2 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:32:09.911134 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c167e22d-70a7-430c-996c-3245e726d578 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:32:09.911701 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c167e22d-70a7-430c-996c-3245e726d578 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:32:09.911784 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c167e22d-70a7-430c-996c-3245e726d578 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:32:09.913666 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1116/2221] 10.222.0.25 () {54 vars in 921 bytes} [Tue Oct 4 03:32:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:32:09.922274 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6800ca6c-068d-48d0-8c4e-9b1466a2e45d None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:32:09.922747 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6800ca6c-068d-48d0-8c4e-9b1466a2e45d None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:32:09.922971 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6800ca6c-068d-48d0-8c4e-9b1466a2e45d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:32:09.945483 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-6800ca6c-068d-48d0-8c4e-9b1466a2e45d None None] MFA Rules not processed for user `2c1f412befb9418fa66a2aabf475aa90`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:32:09.946723 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-6800ca6c-068d-48d0-8c4e-9b1466a2e45d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:32:10.030589 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1106/2222] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Oct 4 03:32:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 03:32:10.043881 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c167e22d-70a7-430c-996c-3245e726d578 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:32:10.045484 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-c167e22d-70a7-430c-996c-3245e726d578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:32:10.060334 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c167e22d-70a7-430c-996c-3245e726d578 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:32:10.064403 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412cab8b-9ee0-46b4-ba57-4bb141062efa service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95be0e4e1c8641709e07b115047fb4e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:32:10.065032 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412cab8b-9ee0-46b4-ba57-4bb141062efa service glance] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:32:10.065306 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412cab8b-9ee0-46b4-ba57-4bb141062efa service glance] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:32:10.065576 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412cab8b-9ee0-46b4-ba57-4bb141062efa service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:32:10.077077 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412cab8b-9ee0-46b4-ba57-4bb141062efa service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:32:10.079522 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412cab8b-9ee0-46b4-ba57-4bb141062efa service glance] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:32:10.100312 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1117/2223] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:32:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 03:32:10.201345 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdbbf67-19ec-438e-80d2-d4e93bb3ed75 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:32:10.201641 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdbbf67-19ec-438e-80d2-d4e93bb3ed75 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:32:10.201922 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdbbf67-19ec-438e-80d2-d4e93bb3ed75 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:32:10.203408 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1107/2224] 10.222.0.25 () {54 vars in 921 bytes} [Tue Oct 4 03:32:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:32:10.208989 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa4b67-4c50-403b-a895-dd29741b14a9 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:32:10.210643 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa4b67-4c50-403b-a895-dd29741b14a9 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:32:10.211941 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa4b67-4c50-403b-a895-dd29741b14a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:32:10.243822 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-36aa4b67-4c50-403b-a895-dd29741b14a9 None None] MFA Rules not processed for user `5e43cc9523d949a1bfa3dec882f2824f`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:32:10.248393 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-36aa4b67-4c50-403b-a895-dd29741b14a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:32:10.317355 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1118/2225] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Oct 4 03:32:10 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 03:32:10.330230 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdbbf67-19ec-438e-80d2-d4e93bb3ed75 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:32:10.331994 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-8fdbbf67-19ec-438e-80d2-d4e93bb3ed75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:32:10.345139 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdbbf67-19ec-438e-80d2-d4e93bb3ed75 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:32:10.348887 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aded46c4-95ac-43e5-9230-52d0d9c85bd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:32:10.349467 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded46c4-95ac-43e5-9230-52d0d9c85bd1 service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:32:10.349910 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded46c4-95ac-43e5-9230-52d0d9c85bd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:32:10.350555 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded46c4-95ac-43e5-9230-52d0d9c85bd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:32:10.360395 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aded46c4-95ac-43e5-9230-52d0d9c85bd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:32:10.362149 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aded46c4-95ac-43e5-9230-52d0d9c85bd1 service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:32:10.370554 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1108/2226] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:32:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:32:10.472228 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e6e2c-50ec-405a-a2fc-f173af3d0f7f None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:32:10.472521 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e6e2c-50ec-405a-a2fc-f173af3d0f7f None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:32:10.472834 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e6e2c-50ec-405a-a2fc-f173af3d0f7f None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:32:10.474277 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1119/2227] 10.222.0.25 () {54 vars in 921 bytes} [Tue Oct 4 03:32:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:32:10.480163 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c15124-7f46-499b-8a9a-55267ef89d58 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:32:10.480454 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c15124-7f46-499b-8a9a-55267ef89d58 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:32:10.480889 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c15124-7f46-499b-8a9a-55267ef89d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:32:10.502108 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-41c15124-7f46-499b-8a9a-55267ef89d58 None None] MFA Rules not processed for user `2c1f412befb9418fa66a2aabf475aa90`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:32:10.503330 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-41c15124-7f46-499b-8a9a-55267ef89d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:32:10.512802 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1109/2228] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Oct 4 03:32:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:32:10.523120 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2e6e2c-50ec-405a-a2fc-f173af3d0f7f None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:32:10.533962 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2e6e2c-50ec-405a-a2fc-f173af3d0f7f None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:32:10.537484 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1179cb16-ae4f-4e6f-9c81-bf98e2509789 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:32:10.538097 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179cb16-ae4f-4e6f-9c81-bf98e2509789 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:32:10.538372 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179cb16-ae4f-4e6f-9c81-bf98e2509789 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:32:10.538642 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179cb16-ae4f-4e6f-9c81-bf98e2509789 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:32:10.549909 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1179cb16-ae4f-4e6f-9c81-bf98e2509789 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:32:10.551354 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1179cb16-ae4f-4e6f-9c81-bf98e2509789 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:32:10.564026 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1120/2229] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:32:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:32:13.450540 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee2525a-eb9d-43f8-93c9-1716376da9f0 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:32:13.450990 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee2525a-eb9d-43f8-93c9-1716376da9f0 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:32:13.451113 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee2525a-eb9d-43f8-93c9-1716376da9f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:32:13.470696 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-0ee2525a-eb9d-43f8-93c9-1716376da9f0 None None] MFA Rules not processed for user `bef61ef12079495ba72b7fcd2717aca2`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:32:13.471908 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-0ee2525a-eb9d-43f8-93c9-1716376da9f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:32:13.526064 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1110/2230] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Oct 4 03:32:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:32:13.537872 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1179cb16-ae4f-4e6f-9c81-bf98e2509789 service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:32:13.539826 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-1179cb16-ae4f-4e6f-9c81-bf98e2509789 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:32:13.612697 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1179cb16-ae4f-4e6f-9c81-bf98e2509789 service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:32:13.618502 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060bad64-8c76-4fb4-a424-e8df1f47a065 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8da6bacc8f432e8f48bb99c7aede11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:32:13.619100 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060bad64-8c76-4fb4-a424-e8df1f47a065 service swift] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:32:13.619380 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060bad64-8c76-4fb4-a424-e8df1f47a065 service swift] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:32:13.619674 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060bad64-8c76-4fb4-a424-e8df1f47a065 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:32:13.628143 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060bad64-8c76-4fb4-a424-e8df1f47a065 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:32:13.631565 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060bad64-8c76-4fb4-a424-e8df1f47a065 service swift] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:32:13.641071 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1121/2231] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Oct 4 03:32:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 03:32:23.519003 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=65 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:32:23.638290 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=67 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:32:24.024907 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee2525a-eb9d-43f8-93c9-1716376da9f0 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:32:24.092566 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee2525a-eb9d-43f8-93c9-1716376da9f0 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:32:24.097030 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc00e2-d99b-409a-9806-20356b0c8569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:32:24.097648 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc00e2-d99b-409a-9806-20356b0c8569 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:32:24.097925 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc00e2-d99b-409a-9806-20356b0c8569 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:32:24.098196 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc00e2-d99b-409a-9806-20356b0c8569 admin admin] PATH_INFO: `/v3/users/26e7c51833154df9b4ba249fd92fe0b1` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:32:24.099386 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fc00e2-d99b-409a-9806-20356b0c8569 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26e7c51833154df9b4ba249fd92fe0b1)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:32:24.101371 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fc00e2-d99b-409a-9806-20356b0c8569 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:32:24.158462 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-02fc00e2-d99b-409a-9806-20356b0c8569 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26e7c51833154df9b4ba249fd92fe0b1'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:32:24.166934 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-02fc00e2-d99b-409a-9806-20356b0c8569 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26e7c51833154df9b4ba249fd92fe0b1'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:32:24.175011 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-02fc00e2-d99b-409a-9806-20356b0c8569 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26e7c51833154df9b4ba249fd92fe0b1'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:32:24.175831 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-02fc00e2-d99b-409a-9806-20356b0c8569 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26e7c51833154df9b4ba249fd92fe0b1'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:32:24.189837 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-02fc00e2-d99b-409a-9806-20356b0c8569 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26e7c51833154df9b4ba249fd92fe0b1'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:32:24.196715 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1111/2232] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:32:24 2022] DELETE /identity/v3/users/26e7c51833154df9b4ba249fd92fe0b1 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:32:24.201158 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d15df-f5aa-44e1-88c2-eac1eb14096e None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:32:24.201450 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d15df-f5aa-44e1-88c2-eac1eb14096e None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:32:24.201724 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d15df-f5aa-44e1-88c2-eac1eb14096e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:32:24.223643 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-649d15df-f5aa-44e1-88c2-eac1eb14096e None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:32:24.224863 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-649d15df-f5aa-44e1-88c2-eac1eb14096e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:32:24.286457 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1122/2233] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:32:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:32:24.297134 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc00e2-d99b-409a-9806-20356b0c8569 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:32:24.298902 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-02fc00e2-d99b-409a-9806-20356b0c8569 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:32:24.375238 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc00e2-d99b-409a-9806-20356b0c8569 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:32:24.382093 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bd2f6a-59c4-45b1-9f71-d6360d91f309 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:32:24.382926 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd2f6a-59c4-45b1-9f71-d6360d91f309 service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:32:24.383265 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd2f6a-59c4-45b1-9f71-d6360d91f309 service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:32:24.383899 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd2f6a-59c4-45b1-9f71-d6360d91f309 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:32:24.393822 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bd2f6a-59c4-45b1-9f71-d6360d91f309 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:32:24.395273 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bd2f6a-59c4-45b1-9f71-d6360d91f309 service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:32:24.405162 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1112/2234] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:32:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:32:24.839169 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649d15df-f5aa-44e1-88c2-eac1eb14096e None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:32:24.841780 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-649d15df-f5aa-44e1-88c2-eac1eb14096e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:32:24.869046 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649d15df-f5aa-44e1-88c2-eac1eb14096e None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:32:24.875035 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651fbf33-a850-48c3-acff-a06a10aed355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:32:24.875846 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651fbf33-a850-48c3-acff-a06a10aed355 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:32:24.876220 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651fbf33-a850-48c3-acff-a06a10aed355 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:32:24.876566 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651fbf33-a850-48c3-acff-a06a10aed355 admin admin] PATH_INFO: `/v3/projects/2943e72980834a9593314b7f9c6b2640` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:32:24.877795 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651fbf33-a850-48c3-acff-a06a10aed355 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2943e72980834a9593314b7f9c6b2640)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:32:24.880629 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651fbf33-a850-48c3-acff-a06a10aed355 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:32:24.934115 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-651fbf33-a850-48c3-acff-a06a10aed355 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2943e72980834a9593314b7f9c6b2640', 'request_id': 'req-651fbf33-a850-48c3-acff-a06a10aed355'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:32:24.939628 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-651fbf33-a850-48c3-acff-a06a10aed355 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2943e72980834a9593314b7f9c6b2640', 'request_id': 'req-651fbf33-a850-48c3-acff-a06a10aed355'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:32:24.946733 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-651fbf33-a850-48c3-acff-a06a10aed355 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2943e72980834a9593314b7f9c6b2640', 'request_id': 'req-651fbf33-a850-48c3-acff-a06a10aed355'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:32:24.958825 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-651fbf33-a850-48c3-acff-a06a10aed355 admin admin] The token cache is being invalidate because project 2943e72980834a9593314b7f9c6b2640 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:32:24.959117 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-651fbf33-a850-48c3-acff-a06a10aed355 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:32:24.959785 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-651fbf33-a850-48c3-acff-a06a10aed355 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:32:24.961299 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1123/2235] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:32:24 2022] DELETE /identity/v3/projects/2943e72980834a9593314b7f9c6b2640 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:32:34.069777 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e51e33-64eb-4652-843f-a5d0abddaafb None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:32:34.070392 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e51e33-64eb-4652-843f-a5d0abddaafb None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:32:34.070392 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e51e33-64eb-4652-843f-a5d0abddaafb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:32:34.091055 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-31e51e33-64eb-4652-843f-a5d0abddaafb None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:32:34.092337 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-31e51e33-64eb-4652-843f-a5d0abddaafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:32:34.111063 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:32:34.157691 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1113/2236] 10.222.0.33 () {58 vars in 1016 bytes} [Tue Oct 4 03:32:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:32:34.173251 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651fbf33-a850-48c3-acff-a06a10aed355 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:32:34.174710 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-651fbf33-a850-48c3-acff-a06a10aed355 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:32:34.250332 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651fbf33-a850-48c3-acff-a06a10aed355 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:32:34.256189 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31df2197-a15a-4464-b546-69442e304c7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1f412befb9418fa66a2aabf475aa90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:32:34.256797 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df2197-a15a-4464-b546-69442e304c7b service nova] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:32:34.257083 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df2197-a15a-4464-b546-69442e304c7b service nova] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:32:34.257361 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df2197-a15a-4464-b546-69442e304c7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:32:34.265627 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31df2197-a15a-4464-b546-69442e304c7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:32:34.267202 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31df2197-a15a-4464-b546-69442e304c7b service nova] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:32:34.277089 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1124/2237] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:32:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:32:37.543399 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a64706-6ffa-48da-8c5c-144e5e2b8a17 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:32:37.543967 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a64706-6ffa-48da-8c5c-144e5e2b8a17 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:32:37.544175 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a64706-6ffa-48da-8c5c-144e5e2b8a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:32:37.567345 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-42a64706-6ffa-48da-8c5c-144e5e2b8a17 None None] MFA Rules not processed for user `bef61ef12079495ba72b7fcd2717aca2`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:32:37.568843 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-42a64706-6ffa-48da-8c5c-144e5e2b8a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:32:37.624295 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1114/2238] 10.222.0.25 () {58 vars in 967 bytes} [Tue Oct 4 03:32:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:32:37.647309 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31df2197-a15a-4464-b546-69442e304c7b service nova] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:32:37.648789 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-31df2197-a15a-4464-b546-69442e304c7b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:32:37.660281 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:32:37.719948 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31df2197-a15a-4464-b546-69442e304c7b service nova] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:32:37.724925 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f09af3-28b8-4d02-a7a3-c7af9ca8a132 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8da6bacc8f432e8f48bb99c7aede11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:32:37.725529 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f09af3-28b8-4d02-a7a3-c7af9ca8a132 service swift] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:32:37.725816 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f09af3-28b8-4d02-a7a3-c7af9ca8a132 service swift] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:32:37.726093 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f09af3-28b8-4d02-a7a3-c7af9ca8a132 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:32:37.734077 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f09af3-28b8-4d02-a7a3-c7af9ca8a132 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:32:37.735657 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f09af3-28b8-4d02-a7a3-c7af9ca8a132 service swift] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:32:37.744731 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1125/2239] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Oct 4 03:32:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 03:32:38.095540 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb9a0a-5437-40d1-b692-7bcd4491befe None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:32:38.095830 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb9a0a-5437-40d1-b692-7bcd4491befe None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:32:38.096123 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb9a0a-5437-40d1-b692-7bcd4491befe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:32:38.116241 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-b5cb9a0a-5437-40d1-b692-7bcd4491befe None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:32:38.117436 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-b5cb9a0a-5437-40d1-b692-7bcd4491befe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:32:38.126361 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1115/2240] 10.222.0.33 () {58 vars in 1016 bytes} [Tue Oct 4 03:32:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 03:32:38.143267 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f09af3-28b8-4d02-a7a3-c7af9ca8a132 service swift] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:32:38.149083 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cb9a0a-5437-40d1-b692-7bcd4491befe None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:32:38.153449 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-b5cb9a0a-5437-40d1-b692-7bcd4491befe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:32:38.156846 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f09af3-28b8-4d02-a7a3-c7af9ca8a132 service swift] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:32:38.162881 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18910102-75d7-4e91-9aa4-e6904ad4bfd1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1f412befb9418fa66a2aabf475aa90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:32:38.163720 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18910102-75d7-4e91-9aa4-e6904ad4bfd1 service nova] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:32:38.164251 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18910102-75d7-4e91-9aa4-e6904ad4bfd1 service nova] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:32:38.164718 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18910102-75d7-4e91-9aa4-e6904ad4bfd1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:32:38.174291 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18910102-75d7-4e91-9aa4-e6904ad4bfd1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:32:38.176150 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18910102-75d7-4e91-9aa4-e6904ad4bfd1 service nova] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:32:38.187959 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1126/2241] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:32:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:32:38.230639 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cb9a0a-5437-40d1-b692-7bcd4491befe None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:32:38.235603 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9266a937-9249-4fec-9ff2-56781fc2e078 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94513f6cd19f495e842deb3c13c3e4d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:32:38.236201 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266a937-9249-4fec-9ff2-56781fc2e078 service placement] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:32:38.236480 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266a937-9249-4fec-9ff2-56781fc2e078 service placement] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:32:38.236751 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266a937-9249-4fec-9ff2-56781fc2e078 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:32:38.238471 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-9266a937-9249-4fec-9ff2-56781fc2e078 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:32:38.250304 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9266a937-9249-4fec-9ff2-56781fc2e078 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:32:38.251910 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9266a937-9249-4fec-9ff2-56781fc2e078 service placement] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:32:38.261704 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1116/2242] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:32:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 03:32:42.369679 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1178b5-693d-4766-ab63-66f1b065b0a1 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:32:42.370234 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1178b5-693d-4766-ab63-66f1b065b0a1 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:32:42.370234 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1178b5-693d-4766-ab63-66f1b065b0a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:32:42.391443 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-2f1178b5-693d-4766-ab63-66f1b065b0a1 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:32:42.392669 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-2f1178b5-693d-4766-ab63-66f1b065b0a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:32:42.400976 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1127/2243] 10.222.0.33 () {58 vars in 1016 bytes} [Tue Oct 4 03:32:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:32:42.417278 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9266a937-9249-4fec-9ff2-56781fc2e078 service placement] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:32:42.429172 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9266a937-9249-4fec-9ff2-56781fc2e078 service placement] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:32:42.435306 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578cc1b6-afeb-40fe-83ab-6de8d13d8e57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1f412befb9418fa66a2aabf475aa90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:32:42.435928 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578cc1b6-afeb-40fe-83ab-6de8d13d8e57 service nova] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:32:42.436210 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578cc1b6-afeb-40fe-83ab-6de8d13d8e57 service nova] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:32:42.436488 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578cc1b6-afeb-40fe-83ab-6de8d13d8e57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:32:42.444965 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578cc1b6-afeb-40fe-83ab-6de8d13d8e57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:32:42.446516 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578cc1b6-afeb-40fe-83ab-6de8d13d8e57 service nova] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:32:42.456930 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1117/2244] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:32:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:32:45.477065 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf20c7-116e-4dba-be85-b2dac52efaf2 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:32:45.477576 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf20c7-116e-4dba-be85-b2dac52efaf2 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:32:45.477671 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf20c7-116e-4dba-be85-b2dac52efaf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:32:45.497215 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-6ebf20c7-116e-4dba-be85-b2dac52efaf2 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:32:45.498395 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-6ebf20c7-116e-4dba-be85-b2dac52efaf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:32:45.506019 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1128/2245] 10.222.0.33 () {58 vars in 1016 bytes} [Tue Oct 4 03:32:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:32:45.534376 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578cc1b6-afeb-40fe-83ab-6de8d13d8e57 service nova] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:32:45.535894 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-578cc1b6-afeb-40fe-83ab-6de8d13d8e57 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:32:45.551008 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578cc1b6-afeb-40fe-83ab-6de8d13d8e57 service nova] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:32:45.556424 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56911542-5e10-4b13-9b03-59548e0dc9bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1f412befb9418fa66a2aabf475aa90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:32:45.556994 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56911542-5e10-4b13-9b03-59548e0dc9bb service nova] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:32:45.557274 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56911542-5e10-4b13-9b03-59548e0dc9bb service nova] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:32:45.557541 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56911542-5e10-4b13-9b03-59548e0dc9bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:32:45.565391 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56911542-5e10-4b13-9b03-59548e0dc9bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:32:45.566927 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56911542-5e10-4b13-9b03-59548e0dc9bb service nova] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:32:45.577079 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1118/2246] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:32:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 03:32:48.609529 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b1a12-7e2f-4174-b07e-3ad496de5687 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:32:48.610257 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b1a12-7e2f-4174-b07e-3ad496de5687 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:32:48.610257 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b1a12-7e2f-4174-b07e-3ad496de5687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:32:48.629865 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-5d0b1a12-7e2f-4174-b07e-3ad496de5687 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:32:48.631083 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-5d0b1a12-7e2f-4174-b07e-3ad496de5687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:32:48.640827 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1129/2247] 10.222.0.33 () {58 vars in 1016 bytes} [Tue Oct 4 03:32:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:32:48.665640 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56911542-5e10-4b13-9b03-59548e0dc9bb service nova] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:32:48.676678 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56911542-5e10-4b13-9b03-59548e0dc9bb service nova] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:32:48.682125 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d0423f-83dc-480c-89aa-16a3323ea4ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1f412befb9418fa66a2aabf475aa90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:32:48.682704 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d0423f-83dc-480c-89aa-16a3323ea4ff service nova] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:32:48.682986 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d0423f-83dc-480c-89aa-16a3323ea4ff service nova] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:32:48.683258 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d0423f-83dc-480c-89aa-16a3323ea4ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:32:48.691119 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d0423f-83dc-480c-89aa-16a3323ea4ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:32:48.692709 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d0423f-83dc-480c-89aa-16a3323ea4ff service nova] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:32:48.702873 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1119/2248] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:32:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 03:32:51.763476 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51267312-ea1f-49f1-90ea-1208d3521fbc None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:32:51.763997 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51267312-ea1f-49f1-90ea-1208d3521fbc None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:32:51.764133 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51267312-ea1f-49f1-90ea-1208d3521fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:32:51.783411 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-51267312-ea1f-49f1-90ea-1208d3521fbc None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:32:51.784644 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-51267312-ea1f-49f1-90ea-1208d3521fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:32:51.793208 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1130/2249] 10.222.0.33 () {58 vars in 1016 bytes} [Tue Oct 4 03:32:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:32:51.813654 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d0423f-83dc-480c-89aa-16a3323ea4ff service nova] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:32:51.825539 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d0423f-83dc-480c-89aa-16a3323ea4ff service nova] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:32:51.831234 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deb1a98-0e29-4055-a903-5320375eeca3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1f412befb9418fa66a2aabf475aa90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:32:51.831879 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb1a98-0e29-4055-a903-5320375eeca3 service nova] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:32:51.832155 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb1a98-0e29-4055-a903-5320375eeca3 service nova] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:32:51.832427 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb1a98-0e29-4055-a903-5320375eeca3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:32:51.841120 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deb1a98-0e29-4055-a903-5320375eeca3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:32:51.842901 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deb1a98-0e29-4055-a903-5320375eeca3 service nova] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:32:51.846915 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:32:51.854421 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1120/2250] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:32:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:33:01.778058 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=46 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:33:01.853123 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:33:11.845316 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c45670-00ad-46e2-8552-3599ed5e34de None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:33:11.845869 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c45670-00ad-46e2-8552-3599ed5e34de None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:33:11.845869 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c45670-00ad-46e2-8552-3599ed5e34de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:33:11.867592 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-c0c45670-00ad-46e2-8552-3599ed5e34de None None] MFA Rules not processed for user `4d1b67fec65345d3b7973445eab896b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:33:11.870048 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-c0c45670-00ad-46e2-8552-3599ed5e34de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:33:11.938394 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1131/2251] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:33:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:33:12.816400 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cac8e5-dec7-4fa0-9279-6e4df951323a None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:33:12.816952 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cac8e5-dec7-4fa0-9279-6e4df951323a None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:33:12.817050 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cac8e5-dec7-4fa0-9279-6e4df951323a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:33:12.837132 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-e8cac8e5-dec7-4fa0-9279-6e4df951323a None None] MFA Rules not processed for user `b8795829c34046628cae345dd4d45e75`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:33:12.838513 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-e8cac8e5-dec7-4fa0-9279-6e4df951323a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:33:12.897102 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1121/2252] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:33:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:33:21.927215 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=25 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:33:22.889326 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=25 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:33:29.653945 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9790e676-c794-44d9-8878-1aaea4e164e7 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:33:29.654481 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9790e676-c794-44d9-8878-1aaea4e164e7 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:33:29.654660 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9790e676-c794-44d9-8878-1aaea4e164e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:33:29.681648 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-9790e676-c794-44d9-8878-1aaea4e164e7 None None] MFA Rules not processed for user `a267cf7109c64f538824c162fedd084b`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:33:29.684967 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-9790e676-c794-44d9-8878-1aaea4e164e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:33:29.747025 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1132/2253] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:33:29 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:33:30.541704 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d36c59-0bb3-4708-b17c-1174307f46bb None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:33:30.542454 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d36c59-0bb3-4708-b17c-1174307f46bb None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:33:30.542839 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d36c59-0bb3-4708-b17c-1174307f46bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:33:30.569655 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-48d36c59-0bb3-4708-b17c-1174307f46bb None None] MFA Rules not processed for user `542b137fb8cd4d25867d95a13d2cb651`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:33:30.571458 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-48d36c59-0bb3-4708-b17c-1174307f46bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:33:30.621733 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f5aa67-06c9-4bbe-9386-793e48e99818 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:33:30.622544 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f5aa67-06c9-4bbe-9386-793e48e99818 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:33:30.623170 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f5aa67-06c9-4bbe-9386-793e48e99818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:33:30.656489 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1122/2254] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:33:30 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:33:30.671190 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-61f5aa67-06c9-4bbe-9386-793e48e99818 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:33:30.672471 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-61f5aa67-06c9-4bbe-9386-793e48e99818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:33:30.683341 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1133/2255] 10.222.0.33 () {58 vars in 1016 bytes} [Tue Oct 4 03:33:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 03:33:30.699815 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d36c59-0bb3-4708-b17c-1174307f46bb None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:33:30.716771 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d36c59-0bb3-4708-b17c-1174307f46bb None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:33:30.729469 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314f6751-ed20-4430-a343-6648513fee97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1f412befb9418fa66a2aabf475aa90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:33:30.730119 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f6751-ed20-4430-a343-6648513fee97 service nova] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:33:30.730457 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f6751-ed20-4430-a343-6648513fee97 service nova] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:33:30.730740 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f6751-ed20-4430-a343-6648513fee97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:33:30.740185 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314f6751-ed20-4430-a343-6648513fee97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:33:30.741757 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314f6751-ed20-4430-a343-6648513fee97 service nova] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:33:30.754006 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1123/2256] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:33:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:33:33.883752 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb903d-bbbe-425f-9a7d-ca1cc0df8569 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:33:33.884282 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb903d-bbbe-425f-9a7d-ca1cc0df8569 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:33:33.884282 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb903d-bbbe-425f-9a7d-ca1cc0df8569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:33:33.905209 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-3fcb903d-bbbe-425f-9a7d-ca1cc0df8569 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:33:33.906413 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-3fcb903d-bbbe-425f-9a7d-ca1cc0df8569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:33:33.915151 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1134/2257] 10.222.0.33 () {58 vars in 1016 bytes} [Tue Oct 4 03:33:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:33:33.938041 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314f6751-ed20-4430-a343-6648513fee97 service nova] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:33:33.949434 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314f6751-ed20-4430-a343-6648513fee97 service nova] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:33:33.954881 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a3689f-e100-4376-8167-dea97becc4c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1f412befb9418fa66a2aabf475aa90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:33:33.955457 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a3689f-e100-4376-8167-dea97becc4c9 service nova] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:33:33.955798 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a3689f-e100-4376-8167-dea97becc4c9 service nova] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:33:33.956049 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a3689f-e100-4376-8167-dea97becc4c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:33:33.964706 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a3689f-e100-4376-8167-dea97becc4c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:33:33.966259 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a3689f-e100-4376-8167-dea97becc4c9 service nova] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:33:33.975578 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1124/2258] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:33:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:33:38.015253 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac0c2b-e673-4969-a564-b95d6a40cb86 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:33:38.015804 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac0c2b-e673-4969-a564-b95d6a40cb86 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:33:38.015901 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac0c2b-e673-4969-a564-b95d6a40cb86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:33:38.036262 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-fcac0c2b-e673-4969-a564-b95d6a40cb86 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:33:38.037463 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-fcac0c2b-e673-4969-a564-b95d6a40cb86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:33:38.045654 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1135/2259] 10.222.0.33 () {58 vars in 1016 bytes} [Tue Oct 4 03:33:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:33:38.059840 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a3689f-e100-4376-8167-dea97becc4c9 service nova] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:33:38.071232 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a3689f-e100-4376-8167-dea97becc4c9 service nova] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:33:38.077972 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40a7421-611f-4c55-9d8d-01cb151d3d6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1f412befb9418fa66a2aabf475aa90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:33:38.078657 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a7421-611f-4c55-9d8d-01cb151d3d6c service nova] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:33:38.079010 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a7421-611f-4c55-9d8d-01cb151d3d6c service nova] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:33:38.079357 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a7421-611f-4c55-9d8d-01cb151d3d6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:33:38.088769 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40a7421-611f-4c55-9d8d-01cb151d3d6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:33:38.090575 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40a7421-611f-4c55-9d8d-01cb151d3d6c service nova] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:33:38.101253 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1125/2260] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:33:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:33:43.239817 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27808b6e-7295-4298-bf76-b68bdc10fdb8 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:33:43.240325 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27808b6e-7295-4298-bf76-b68bdc10fdb8 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:33:43.240421 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27808b6e-7295-4298-bf76-b68bdc10fdb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:33:43.260854 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-27808b6e-7295-4298-bf76-b68bdc10fdb8 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:33:43.262122 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-27808b6e-7295-4298-bf76-b68bdc10fdb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:33:43.269950 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1136/2261] 10.222.0.33 () {58 vars in 1016 bytes} [Tue Oct 4 03:33:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:33:43.284912 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40a7421-611f-4c55-9d8d-01cb151d3d6c service nova] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:33:43.297077 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40a7421-611f-4c55-9d8d-01cb151d3d6c service nova] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:33:43.303122 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24893a29-9413-4f6d-beec-8fb4dc957b2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1f412befb9418fa66a2aabf475aa90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:33:43.303758 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24893a29-9413-4f6d-beec-8fb4dc957b2e service nova] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:33:43.304039 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24893a29-9413-4f6d-beec-8fb4dc957b2e service nova] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:33:43.304318 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24893a29-9413-4f6d-beec-8fb4dc957b2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:33:43.312898 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24893a29-9413-4f6d-beec-8fb4dc957b2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:33:43.314460 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24893a29-9413-4f6d-beec-8fb4dc957b2e service nova] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:33:43.325393 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1126/2262] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:33:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:33:47.448156 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb68b7e-bb23-412b-b6df-727cda0dc71a None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:33:47.448654 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb68b7e-bb23-412b-b6df-727cda0dc71a None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:33:47.448760 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb68b7e-bb23-412b-b6df-727cda0dc71a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:33:47.468101 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-6cb68b7e-bb23-412b-b6df-727cda0dc71a None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:33:47.469330 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-6cb68b7e-bb23-412b-b6df-727cda0dc71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:33:47.477842 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1137/2263] 10.222.0.33 () {58 vars in 1016 bytes} [Tue Oct 4 03:33:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:33:47.492041 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24893a29-9413-4f6d-beec-8fb4dc957b2e service nova] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:33:47.503349 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24893a29-9413-4f6d-beec-8fb4dc957b2e service nova] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:33:47.509523 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d050e4-8682-49fe-b4f8-39ef527af4a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1f412befb9418fa66a2aabf475aa90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:33:47.510178 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d050e4-8682-49fe-b4f8-39ef527af4a5 service nova] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:33:47.510457 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d050e4-8682-49fe-b4f8-39ef527af4a5 service nova] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:33:47.510730 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d050e4-8682-49fe-b4f8-39ef527af4a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:33:47.518699 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d050e4-8682-49fe-b4f8-39ef527af4a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:33:47.520278 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d050e4-8682-49fe-b4f8-39ef527af4a5 service nova] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:33:47.529483 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1127/2264] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:33:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:33:57.462952 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=40 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:33:57.525399 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=55 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:34:03.164128 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df454cd7-1c46-44c4-a8a2-cba35d28c204 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:34:03.164613 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df454cd7-1c46-44c4-a8a2-cba35d28c204 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:34:03.164718 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df454cd7-1c46-44c4-a8a2-cba35d28c204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:34:03.183514 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-df454cd7-1c46-44c4-a8a2-cba35d28c204 None None] MFA Rules not processed for user `02f76bc3ab354c4a8e9941e1403274ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:34:03.184716 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-df454cd7-1c46-44c4-a8a2-cba35d28c204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:34:03.239716 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1138/2265] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:34:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:34:13.232936 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=25 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:34:20.133990 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d050e4-8682-49fe-b4f8-39ef527af4a5 service nova] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:34:20.135712 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-04d050e4-8682-49fe-b4f8-39ef527af4a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:34:20.149486 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d050e4-8682-49fe-b4f8-39ef527af4a5 service nova] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:34:20.154529 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb8071-0fe0-4a89-b7bf-b33cc8b12ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:34:20.155174 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb8071-0fe0-4a89-b7bf-b33cc8b12ac5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:34:20.155458 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb8071-0fe0-4a89-b7bf-b33cc8b12ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:34:20.155949 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb8071-0fe0-4a89-b7bf-b33cc8b12ac5 admin admin] PATH_INFO: `/v3/users/4d1b67fec65345d3b7973445eab896b2` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:34:20.157077 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bb8071-0fe0-4a89-b7bf-b33cc8b12ac5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d1b67fec65345d3b7973445eab896b2)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:34:20.160020 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bb8071-0fe0-4a89-b7bf-b33cc8b12ac5 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:34:20.207832 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-f0bb8071-0fe0-4a89-b7bf-b33cc8b12ac5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d1b67fec65345d3b7973445eab896b2'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:34:20.215297 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-f0bb8071-0fe0-4a89-b7bf-b33cc8b12ac5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d1b67fec65345d3b7973445eab896b2'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:34:20.222447 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-f0bb8071-0fe0-4a89-b7bf-b33cc8b12ac5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d1b67fec65345d3b7973445eab896b2'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:34:20.223121 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-f0bb8071-0fe0-4a89-b7bf-b33cc8b12ac5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d1b67fec65345d3b7973445eab896b2'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:34:20.236399 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-f0bb8071-0fe0-4a89-b7bf-b33cc8b12ac5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d1b67fec65345d3b7973445eab896b2'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:34:20.245300 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1128/2266] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:34:20 2022] DELETE /identity/v3/users/4d1b67fec65345d3b7973445eab896b2 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:34:20.437821 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df454cd7-1c46-44c4-a8a2-cba35d28c204 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:34:20.449396 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df454cd7-1c46-44c4-a8a2-cba35d28c204 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:34:20.515306 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cf802c-251f-4c50-887d-e21f3f0cc0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:34:20.516081 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf802c-251f-4c50-887d-e21f3f0cc0f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:34:20.516509 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf802c-251f-4c50-887d-e21f3f0cc0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:34:20.517015 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf802c-251f-4c50-887d-e21f3f0cc0f9 admin admin] PATH_INFO: `/v3/projects/3edbcf8484374dab9697bab576e6afdb` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:34:20.518251 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cf802c-251f-4c50-887d-e21f3f0cc0f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3edbcf8484374dab9697bab576e6afdb)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:34:20.520403 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cf802c-251f-4c50-887d-e21f3f0cc0f9 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:34:20.569928 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-54cf802c-251f-4c50-887d-e21f3f0cc0f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3edbcf8484374dab9697bab576e6afdb', 'request_id': 'req-54cf802c-251f-4c50-887d-e21f3f0cc0f9'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:34:20.576410 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-54cf802c-251f-4c50-887d-e21f3f0cc0f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3edbcf8484374dab9697bab576e6afdb', 'request_id': 'req-54cf802c-251f-4c50-887d-e21f3f0cc0f9'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:34:20.582600 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-54cf802c-251f-4c50-887d-e21f3f0cc0f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3edbcf8484374dab9697bab576e6afdb', 'request_id': 'req-54cf802c-251f-4c50-887d-e21f3f0cc0f9'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:34:20.596006 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-54cf802c-251f-4c50-887d-e21f3f0cc0f9 admin admin] The token cache is being invalidate because project 3edbcf8484374dab9697bab576e6afdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:34:20.596338 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-54cf802c-251f-4c50-887d-e21f3f0cc0f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:34:20.596943 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-54cf802c-251f-4c50-887d-e21f3f0cc0f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:34:20.598969 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1139/2267] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:34:20 2022] DELETE /identity/v3/projects/3edbcf8484374dab9697bab576e6afdb => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:34:27.519085 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb8071-0fe0-4a89-b7bf-b33cc8b12ac5 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:34:27.520764 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-f0bb8071-0fe0-4a89-b7bf-b33cc8b12ac5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:34:27.591687 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb8071-0fe0-4a89-b7bf-b33cc8b12ac5 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:34:27.672595 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57327290-a00c-45ed-a33d-81f7fc6fb2c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:34:27.673281 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57327290-a00c-45ed-a33d-81f7fc6fb2c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:34:27.673710 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57327290-a00c-45ed-a33d-81f7fc6fb2c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:34:27.674161 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57327290-a00c-45ed-a33d-81f7fc6fb2c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:34:27.676329 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-57327290-a00c-45ed-a33d-81f7fc6fb2c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:34:27.732447 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:34:27.772623 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57327290-a00c-45ed-a33d-81f7fc6fb2c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:34:27.774066 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57327290-a00c-45ed-a33d-81f7fc6fb2c7 service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:34:27.798166 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1129/2268] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:34:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:34:30.592659 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:34:30.754998 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f18f2-fd27-4faa-bc71-749bfe5aea86 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:34:30.755269 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f18f2-fd27-4faa-bc71-749bfe5aea86 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:34:30.755596 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f18f2-fd27-4faa-bc71-749bfe5aea86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:34:30.776013 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-7c9f18f2-fd27-4faa-bc71-749bfe5aea86 None None] MFA Rules not processed for user `b8795829c34046628cae345dd4d45e75`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:34:30.777221 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-7c9f18f2-fd27-4faa-bc71-749bfe5aea86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:34:30.822427 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57327290-a00c-45ed-a33d-81f7fc6fb2c7 service neutron] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:34:30.823890 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-57327290-a00c-45ed-a33d-81f7fc6fb2c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:34:30.835336 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57327290-a00c-45ed-a33d-81f7fc6fb2c7 service neutron] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:34:30.839715 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369c773f-7719-4b48-ab85-57bb68ec290d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:34:30.840308 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c773f-7719-4b48-ab85-57bb68ec290d service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:34:30.840586 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c773f-7719-4b48-ab85-57bb68ec290d service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:34:30.840862 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c773f-7719-4b48-ab85-57bb68ec290d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:34:30.842540 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-369c773f-7719-4b48-ab85-57bb68ec290d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:34:30.853806 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1140/2269] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:34:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:34:30.856899 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369c773f-7719-4b48-ab85-57bb68ec290d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:34:30.858509 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369c773f-7719-4b48-ab85-57bb68ec290d service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:34:30.870011 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1130/2270] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:34:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 03:34:39.793413 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9f18f2-fd27-4faa-bc71-749bfe5aea86 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:34:39.794802 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-7c9f18f2-fd27-4faa-bc71-749bfe5aea86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:34:39.811258 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9f18f2-fd27-4faa-bc71-749bfe5aea86 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:34:39.817152 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37be3c4-7490-44b5-b3a1-85aa9cdc98bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1f412befb9418fa66a2aabf475aa90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:34:39.817841 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37be3c4-7490-44b5-b3a1-85aa9cdc98bf service nova] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:34:39.818154 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37be3c4-7490-44b5-b3a1-85aa9cdc98bf service nova] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:34:39.818989 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37be3c4-7490-44b5-b3a1-85aa9cdc98bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:34:39.820846 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-d37be3c4-7490-44b5-b3a1-85aa9cdc98bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:34:39.885638 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37be3c4-7490-44b5-b3a1-85aa9cdc98bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:34:39.887783 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37be3c4-7490-44b5-b3a1-85aa9cdc98bf service nova] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:34:39.897808 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1141/2271] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:34:39 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:34:40.864817 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=20 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:34:41.657072 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369c773f-7719-4b48-ab85-57bb68ec290d service neutron] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:34:41.658480 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-369c773f-7719-4b48-ab85-57bb68ec290d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:34:41.668810 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369c773f-7719-4b48-ab85-57bb68ec290d service neutron] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:34:41.672367 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca76e4c-6cc0-4cb6-8624-7974228dc939 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:34:41.672945 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca76e4c-6cc0-4cb6-8624-7974228dc939 service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:34:41.673221 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca76e4c-6cc0-4cb6-8624-7974228dc939 service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:34:41.673490 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca76e4c-6cc0-4cb6-8624-7974228dc939 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:34:41.675094 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-9ca76e4c-6cc0-4cb6-8624-7974228dc939 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:34:41.739478 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca76e4c-6cc0-4cb6-8624-7974228dc939 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:34:41.740916 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca76e4c-6cc0-4cb6-8624-7974228dc939 service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:34:41.751216 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1131/2272] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:34:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:34:45.210956 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37be3c4-7490-44b5-b3a1-85aa9cdc98bf service nova] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:34:45.213349 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-d37be3c4-7490-44b5-b3a1-85aa9cdc98bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:34:45.228425 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37be3c4-7490-44b5-b3a1-85aa9cdc98bf service nova] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:34:45.232927 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665821c9-2463-4c26-8003-9bf75ee7275e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:34:45.233548 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665821c9-2463-4c26-8003-9bf75ee7275e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:34:45.233826 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665821c9-2463-4c26-8003-9bf75ee7275e admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:34:45.234097 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665821c9-2463-4c26-8003-9bf75ee7275e admin admin] PATH_INFO: `/v3/users/a267cf7109c64f538824c162fedd084b` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:34:45.235195 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665821c9-2463-4c26-8003-9bf75ee7275e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a267cf7109c64f538824c162fedd084b)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:34:45.237248 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665821c9-2463-4c26-8003-9bf75ee7275e admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:34:45.284153 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-665821c9-2463-4c26-8003-9bf75ee7275e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a267cf7109c64f538824c162fedd084b'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:34:45.284815 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-665821c9-2463-4c26-8003-9bf75ee7275e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a267cf7109c64f538824c162fedd084b'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:34:45.292986 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-665821c9-2463-4c26-8003-9bf75ee7275e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a267cf7109c64f538824c162fedd084b'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:34:45.293610 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-665821c9-2463-4c26-8003-9bf75ee7275e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a267cf7109c64f538824c162fedd084b'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:34:45.305490 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-665821c9-2463-4c26-8003-9bf75ee7275e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a267cf7109c64f538824c162fedd084b'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:34:45.317568 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1142/2273] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:34:45 2022] DELETE /identity/v3/users/a267cf7109c64f538824c162fedd084b => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:34:45.500284 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca76e4c-6cc0-4cb6-8624-7974228dc939 service neutron] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:34:45.511381 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca76e4c-6cc0-4cb6-8624-7974228dc939 service neutron] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:34:45.567265 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1d0c68-e18a-4f73-9e0a-2d356dba5aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:34:45.567915 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1d0c68-e18a-4f73-9e0a-2d356dba5aa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:34:45.568198 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1d0c68-e18a-4f73-9e0a-2d356dba5aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:34:45.568729 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1d0c68-e18a-4f73-9e0a-2d356dba5aa0 admin admin] PATH_INFO: `/v3/projects/b62fd4925f3840edb9806630cd78c9fa` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:34:45.569857 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1d0c68-e18a-4f73-9e0a-2d356dba5aa0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b62fd4925f3840edb9806630cd78c9fa)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:34:45.572428 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1d0c68-e18a-4f73-9e0a-2d356dba5aa0 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:34:45.616979 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-fc1d0c68-e18a-4f73-9e0a-2d356dba5aa0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b62fd4925f3840edb9806630cd78c9fa', 'request_id': 'req-fc1d0c68-e18a-4f73-9e0a-2d356dba5aa0'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:34:45.622673 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-fc1d0c68-e18a-4f73-9e0a-2d356dba5aa0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b62fd4925f3840edb9806630cd78c9fa', 'request_id': 'req-fc1d0c68-e18a-4f73-9e0a-2d356dba5aa0'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:34:45.628567 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-fc1d0c68-e18a-4f73-9e0a-2d356dba5aa0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b62fd4925f3840edb9806630cd78c9fa', 'request_id': 'req-fc1d0c68-e18a-4f73-9e0a-2d356dba5aa0'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:34:45.642302 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-fc1d0c68-e18a-4f73-9e0a-2d356dba5aa0 admin admin] The token cache is being invalidate because project b62fd4925f3840edb9806630cd78c9fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:34:45.642598 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-fc1d0c68-e18a-4f73-9e0a-2d356dba5aa0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:34:45.643219 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-fc1d0c68-e18a-4f73-9e0a-2d356dba5aa0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:34:45.644799 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1132/2274] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:34:45 2022] DELETE /identity/v3/projects/b62fd4925f3840edb9806630cd78c9fa => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:34:45.651557 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d665e-206e-4ef1-b6a7-be3628a606f3 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:34:45.651847 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d665e-206e-4ef1-b6a7-be3628a606f3 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:34:45.652121 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d665e-206e-4ef1-b6a7-be3628a606f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:34:45.673753 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-9a2d665e-206e-4ef1-b6a7-be3628a606f3 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:34:45.674975 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-9a2d665e-206e-4ef1-b6a7-be3628a606f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:34:45.684954 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:34:45.744663 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1143/2275] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:34:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 03:34:45.752793 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f73c5-f868-4dc0-9c07-e5e640bd9544 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:34:45.753082 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f73c5-f868-4dc0-9c07-e5e640bd9544 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:34:45.753373 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f73c5-f868-4dc0-9c07-e5e640bd9544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:34:45.773670 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-ec7f73c5-f868-4dc0-9c07-e5e640bd9544 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:34:45.775712 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-ec7f73c5-f868-4dc0-9c07-e5e640bd9544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:34:45.787558 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1133/2276] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:34:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:34:45.789127 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2d665e-206e-4ef1-b6a7-be3628a606f3 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:34:45.800867 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2d665e-206e-4ef1-b6a7-be3628a606f3 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:34:45.807000 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd817e04-af38-4bae-b74d-4ce0fd73f37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:34:45.807687 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd817e04-af38-4bae-b74d-4ce0fd73f37c admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:34:45.807926 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd817e04-af38-4bae-b74d-4ce0fd73f37c admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:34:45.808207 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd817e04-af38-4bae-b74d-4ce0fd73f37c admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:34:45.808950 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd817e04-af38-4bae-b74d-4ce0fd73f37c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:34:45.809147 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd817e04-af38-4bae-b74d-4ce0fd73f37c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:34:45.810735 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd817e04-af38-4bae-b74d-4ce0fd73f37c admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:34:45.825698 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1144/2277] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 03:34:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:34:45.829601 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7f73c5-f868-4dc0-9c07-e5e640bd9544 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:34:45.839936 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7f73c5-f868-4dc0-9c07-e5e640bd9544 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:34:45.844673 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227299bc-7de2-4b61-9918-bea12bc7bac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:34:45.845291 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227299bc-7de2-4b61-9918-bea12bc7bac1 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:34:45.845573 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227299bc-7de2-4b61-9918-bea12bc7bac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:34:45.845965 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227299bc-7de2-4b61-9918-bea12bc7bac1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:34:45.846609 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227299bc-7de2-4b61-9918-bea12bc7bac1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:34:45.848525 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227299bc-7de2-4b61-9918-bea12bc7bac1 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:34:45.864350 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:34:45.878145 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1134/2278] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:34:45 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 03:34:45.882365 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd817e04-af38-4bae-b74d-4ce0fd73f37c admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:34:45.893411 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd817e04-af38-4bae-b74d-4ce0fd73f37c admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:34:45.951779 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d1141f-92b6-4ff3-b9ba-b16b8f642cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:34:45.952389 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d1141f-92b6-4ff3-b9ba-b16b8f642cb0 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:34:45.952673 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d1141f-92b6-4ff3-b9ba-b16b8f642cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:34:45.952948 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d1141f-92b6-4ff3-b9ba-b16b8f642cb0 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:34:45.953595 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d1141f-92b6-4ff3-b9ba-b16b8f642cb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:34:45.955720 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d1141f-92b6-4ff3-b9ba-b16b8f642cb0 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:34:45.981286 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1145/2279] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:34:45 2022] POST /identity/v3/users => generated 286 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:34:45.986063 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227299bc-7de2-4b61-9918-bea12bc7bac1 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:34:45.998344 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227299bc-7de2-4b61-9918-bea12bc7bac1 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:34:46.003083 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba24869-0910-409e-9d47-c16c090650d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:34:46.003723 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba24869-0910-409e-9d47-c16c090650d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:34:46.004028 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba24869-0910-409e-9d47-c16c090650d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:34:46.004302 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba24869-0910-409e-9d47-c16c090650d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:34:46.004972 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba24869-0910-409e-9d47-c16c090650d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:34:46.006542 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba24869-0910-409e-9d47-c16c090650d5 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:34:46.017328 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1135/2280] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:34:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:34:46.021376 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d1141f-92b6-4ff3-b9ba-b16b8f642cb0 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:34:46.031826 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d1141f-92b6-4ff3-b9ba-b16b8f642cb0 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:34:46.036623 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d616c0-614d-4b95-9a1e-ef7edc83d158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:34:46.037231 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d616c0-614d-4b95-9a1e-ef7edc83d158 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:34:46.037515 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d616c0-614d-4b95-9a1e-ef7edc83d158 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:34:46.037886 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d616c0-614d-4b95-9a1e-ef7edc83d158 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:34:46.038516 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d616c0-614d-4b95-9a1e-ef7edc83d158 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:34:46.040336 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d616c0-614d-4b95-9a1e-ef7edc83d158 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:34:46.054607 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1146/2281] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:34:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 03:34:46.056838 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba24869-0910-409e-9d47-c16c090650d5 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:34:46.066837 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba24869-0910-409e-9d47-c16c090650d5 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:34:46.072526 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec148b85-868b-453f-8162-f68a45ebeae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:34:46.073176 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec148b85-868b-453f-8162-f68a45ebeae6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:34:46.073458 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec148b85-868b-453f-8162-f68a45ebeae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:34:46.073734 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec148b85-868b-453f-8162-f68a45ebeae6 admin admin] PATH_INFO: `/v3/projects/9491732700c94ee28598bbe7e38780b9/users/19d8b6cf60d84abe893799d0bbcc23d1/roles/04d0e4575a28440eb4349b4a6565e8b8` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:34:46.088968 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec148b85-868b-453f-8162-f68a45ebeae6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9491732700c94ee28598bbe7e38780b9, user_id=19d8b6cf60d84abe893799d0bbcc23d1, role_id=04d0e4575a28440eb4349b4a6565e8b8)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:34:46.091626 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec148b85-868b-453f-8162-f68a45ebeae6 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:34:46.105961 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1136/2282] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:34:46 2022] PUT /identity/v3/projects/9491732700c94ee28598bbe7e38780b9/users/19d8b6cf60d84abe893799d0bbcc23d1/roles/04d0e4575a28440eb4349b4a6565e8b8 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:34:46.115938 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c6ac2-ad16-4ecf-95fe-276b0ba910ac None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:34:46.116234 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c6ac2-ad16-4ecf-95fe-276b0ba910ac None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:34:46.116507 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c6ac2-ad16-4ecf-95fe-276b0ba910ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:34:46.144707 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-ce1c6ac2-ad16-4ecf-95fe-276b0ba910ac None None] MFA Rules not processed for user `19d8b6cf60d84abe893799d0bbcc23d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:34:46.145829 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-ce1c6ac2-ad16-4ecf-95fe-276b0ba910ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:34:46.209170 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1147/2283] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:34:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:34:46.219929 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec148b85-868b-453f-8162-f68a45ebeae6 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:34:46.221648 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-ec148b85-868b-453f-8162-f68a45ebeae6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:34:46.294772 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec148b85-868b-453f-8162-f68a45ebeae6 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:34:46.300354 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75002932-e558-42b0-93e8-6bb06bae25c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1f412befb9418fa66a2aabf475aa90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:34:46.300975 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75002932-e558-42b0-93e8-6bb06bae25c8 service nova] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:34:46.301266 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75002932-e558-42b0-93e8-6bb06bae25c8 service nova] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:34:46.301524 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75002932-e558-42b0-93e8-6bb06bae25c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:34:46.310037 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75002932-e558-42b0-93e8-6bb06bae25c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:34:46.311622 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75002932-e558-42b0-93e8-6bb06bae25c8 service nova] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:34:46.320427 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1137/2284] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:34:46 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:34:49.007664 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1c6ac2-ad16-4ecf-95fe-276b0ba910ac None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:34:49.021164 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:34:49.077149 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1c6ac2-ad16-4ecf-95fe-276b0ba910ac None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:34:49.081744 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c6d989-9f20-4271-b14f-f378e7640afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:34:49.082369 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6d989-9f20-4271-b14f-f378e7640afb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:34:49.082656 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6d989-9f20-4271-b14f-f378e7640afb admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:34:49.082936 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6d989-9f20-4271-b14f-f378e7640afb admin admin] PATH_INFO: `/v3/users/19d8b6cf60d84abe893799d0bbcc23d1` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:34:49.084096 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c6d989-9f20-4271-b14f-f378e7640afb admin admin] RBAC: Authorizing `identity:delete_user(user_id=19d8b6cf60d84abe893799d0bbcc23d1)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:34:49.086014 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c6d989-9f20-4271-b14f-f378e7640afb admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:34:49.139294 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-16c6d989-9f20-4271-b14f-f378e7640afb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19d8b6cf60d84abe893799d0bbcc23d1'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:34:49.139983 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-16c6d989-9f20-4271-b14f-f378e7640afb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19d8b6cf60d84abe893799d0bbcc23d1'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:34:49.147859 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-16c6d989-9f20-4271-b14f-f378e7640afb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19d8b6cf60d84abe893799d0bbcc23d1'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:34:49.148484 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-16c6d989-9f20-4271-b14f-f378e7640afb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19d8b6cf60d84abe893799d0bbcc23d1'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:34:49.161110 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-16c6d989-9f20-4271-b14f-f378e7640afb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19d8b6cf60d84abe893799d0bbcc23d1'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:34:49.174341 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1148/2285] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:34:49 2022] DELETE /identity/v3/users/19d8b6cf60d84abe893799d0bbcc23d1 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:34:49.178927 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8807b4fb-fa83-4db9-9730-52aa2cf98e3c None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:34:49.179423 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8807b4fb-fa83-4db9-9730-52aa2cf98e3c None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:34:49.179544 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8807b4fb-fa83-4db9-9730-52aa2cf98e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:34:49.200704 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-8807b4fb-fa83-4db9-9730-52aa2cf98e3c None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:34:49.201949 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-8807b4fb-fa83-4db9-9730-52aa2cf98e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:34:49.266620 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1138/2286] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:34:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:34:49.276450 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c6d989-9f20-4271-b14f-f378e7640afb admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:34:49.277950 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-16c6d989-9f20-4271-b14f-f378e7640afb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:34:49.340913 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c6d989-9f20-4271-b14f-f378e7640afb admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:34:49.344667 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c4e3f3-e980-472f-bace-59621e0f3ff6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:34:49.345281 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c4e3f3-e980-472f-bace-59621e0f3ff6 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:34:49.345564 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c4e3f3-e980-472f-bace-59621e0f3ff6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:34:49.345841 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c4e3f3-e980-472f-bace-59621e0f3ff6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:34:49.356492 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c4e3f3-e980-472f-bace-59621e0f3ff6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:34:49.357984 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c4e3f3-e980-472f-bace-59621e0f3ff6 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:34:49.369198 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1149/2287] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:34:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 03:34:49.732596 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8807b4fb-fa83-4db9-9730-52aa2cf98e3c None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:34:49.734182 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-8807b4fb-fa83-4db9-9730-52aa2cf98e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:34:49.748812 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8807b4fb-fa83-4db9-9730-52aa2cf98e3c None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:34:49.754114 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8edf1b-7419-4a55-bbc7-aa147d380733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:34:49.755113 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8edf1b-7419-4a55-bbc7-aa147d380733 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:34:49.755345 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8edf1b-7419-4a55-bbc7-aa147d380733 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:34:49.755651 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8edf1b-7419-4a55-bbc7-aa147d380733 admin admin] PATH_INFO: `/v3/projects/9491732700c94ee28598bbe7e38780b9` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:34:49.756799 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8edf1b-7419-4a55-bbc7-aa147d380733 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9491732700c94ee28598bbe7e38780b9)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:34:49.758698 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8edf1b-7419-4a55-bbc7-aa147d380733 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:34:49.800166 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:34:49.808739 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-ac8edf1b-7419-4a55-bbc7-aa147d380733 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9491732700c94ee28598bbe7e38780b9', 'request_id': 'req-ac8edf1b-7419-4a55-bbc7-aa147d380733'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:34:49.815894 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-ac8edf1b-7419-4a55-bbc7-aa147d380733 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9491732700c94ee28598bbe7e38780b9', 'request_id': 'req-ac8edf1b-7419-4a55-bbc7-aa147d380733'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:34:49.822338 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-ac8edf1b-7419-4a55-bbc7-aa147d380733 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9491732700c94ee28598bbe7e38780b9', 'request_id': 'req-ac8edf1b-7419-4a55-bbc7-aa147d380733'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:34:49.834298 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-ac8edf1b-7419-4a55-bbc7-aa147d380733 admin admin] The token cache is being invalidate because project 9491732700c94ee28598bbe7e38780b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:34:49.834590 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-ac8edf1b-7419-4a55-bbc7-aa147d380733 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:34:49.835238 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-ac8edf1b-7419-4a55-bbc7-aa147d380733 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:34:49.837290 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1139/2288] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:34:49 2022] DELETE /identity/v3/projects/9491732700c94ee28598bbe7e38780b9 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:34:49.842153 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1e09b3-8ba5-4b5f-a9d7-92d7b93a85ee None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:34:49.842443 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1e09b3-8ba5-4b5f-a9d7-92d7b93a85ee None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:34:49.842722 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1e09b3-8ba5-4b5f-a9d7-92d7b93a85ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:34:49.863022 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-aa1e09b3-8ba5-4b5f-a9d7-92d7b93a85ee None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:34:49.864258 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-aa1e09b3-8ba5-4b5f-a9d7-92d7b93a85ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:34:49.893377 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:34:49.925633 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1150/2289] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:34:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 03:34:49.934753 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d355f-eda1-4845-96d5-6b51821eca00 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:34:49.935046 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d355f-eda1-4845-96d5-6b51821eca00 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:34:49.935333 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d355f-eda1-4845-96d5-6b51821eca00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:34:49.955623 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-918d355f-eda1-4845-96d5-6b51821eca00 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:34:49.956823 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-918d355f-eda1-4845-96d5-6b51821eca00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:34:49.965268 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1140/2290] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:34:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:34:49.969372 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1e09b3-8ba5-4b5f-a9d7-92d7b93a85ee None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:34:49.979993 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1e09b3-8ba5-4b5f-a9d7-92d7b93a85ee None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:34:49.984662 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d5232a-e5a8-4b41-b54d-2641e24b4fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:34:49.985259 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d5232a-e5a8-4b41-b54d-2641e24b4fc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:34:49.985539 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d5232a-e5a8-4b41-b54d-2641e24b4fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:34:49.985810 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d5232a-e5a8-4b41-b54d-2641e24b4fc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:34:49.986456 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d5232a-e5a8-4b41-b54d-2641e24b4fc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:34:49.986757 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d5232a-e5a8-4b41-b54d-2641e24b4fc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:34:49.988370 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d5232a-e5a8-4b41-b54d-2641e24b4fc9 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:34:50.001587 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1151/2291] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 03:34:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:34:50.005936 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d355f-eda1-4845-96d5-6b51821eca00 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:34:50.016006 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d355f-eda1-4845-96d5-6b51821eca00 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:34:50.020698 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd2e3eb-db37-41bc-b203-aa426a65888f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:34:50.021284 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd2e3eb-db37-41bc-b203-aa426a65888f admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:34:50.021566 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd2e3eb-db37-41bc-b203-aa426a65888f admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:34:50.021842 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd2e3eb-db37-41bc-b203-aa426a65888f admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:34:50.022465 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd2e3eb-db37-41bc-b203-aa426a65888f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:34:50.025036 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd2e3eb-db37-41bc-b203-aa426a65888f admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:34:50.052818 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1141/2292] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:34:50 2022] POST /identity/v3/projects => generated 365 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:34:50.057016 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d5232a-e5a8-4b41-b54d-2641e24b4fc9 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:34:50.066764 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d5232a-e5a8-4b41-b54d-2641e24b4fc9 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:34:50.127866 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3de2d61-bd3a-40ab-97f7-42463de4449e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:34:50.128496 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de2d61-bd3a-40ab-97f7-42463de4449e admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:34:50.128778 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de2d61-bd3a-40ab-97f7-42463de4449e admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:34:50.129055 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de2d61-bd3a-40ab-97f7-42463de4449e admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:34:50.129693 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3de2d61-bd3a-40ab-97f7-42463de4449e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:34:50.131650 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3de2d61-bd3a-40ab-97f7-42463de4449e admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:34:50.154021 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1152/2293] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:34:50 2022] POST /identity/v3/users => generated 283 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:34:50.158408 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd2e3eb-db37-41bc-b203-aa426a65888f admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:34:50.168622 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd2e3eb-db37-41bc-b203-aa426a65888f admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:34:50.173163 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6b9e60-207a-4f09-86a8-c0df331ee6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:34:50.173743 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b9e60-207a-4f09-86a8-c0df331ee6f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:34:50.174022 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b9e60-207a-4f09-86a8-c0df331ee6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:34:50.174295 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b9e60-207a-4f09-86a8-c0df331ee6f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:34:50.174931 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6b9e60-207a-4f09-86a8-c0df331ee6f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:34:50.176525 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6b9e60-207a-4f09-86a8-c0df331ee6f7 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:34:50.187599 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1142/2294] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:34:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:34:50.191523 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3de2d61-bd3a-40ab-97f7-42463de4449e admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:34:50.202668 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3de2d61-bd3a-40ab-97f7-42463de4449e admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:34:50.207407 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e31b9e-10ca-4921-9c4f-9709c8f62db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:34:50.208040 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e31b9e-10ca-4921-9c4f-9709c8f62db3 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:34:50.208323 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e31b9e-10ca-4921-9c4f-9709c8f62db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:34:50.208599 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e31b9e-10ca-4921-9c4f-9709c8f62db3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:34:50.209245 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e31b9e-10ca-4921-9c4f-9709c8f62db3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:34:50.210826 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e31b9e-10ca-4921-9c4f-9709c8f62db3 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:34:50.222337 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1153/2295] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:34:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:34:50.226581 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6b9e60-207a-4f09-86a8-c0df331ee6f7 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:34:50.237142 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6b9e60-207a-4f09-86a8-c0df331ee6f7 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:34:50.241730 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295fa4b8-9010-4f0f-8f2e-ddd23a95f066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:34:50.242364 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295fa4b8-9010-4f0f-8f2e-ddd23a95f066 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:34:50.242647 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295fa4b8-9010-4f0f-8f2e-ddd23a95f066 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:34:50.243620 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295fa4b8-9010-4f0f-8f2e-ddd23a95f066 admin admin] PATH_INFO: `/v3/projects/b51b8540f54f41c2825c69eff1faa2bf/users/2379ccc822e941fea49c7b91e104915c/roles/04d0e4575a28440eb4349b4a6565e8b8` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:34:50.257795 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295fa4b8-9010-4f0f-8f2e-ddd23a95f066 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b51b8540f54f41c2825c69eff1faa2bf, user_id=2379ccc822e941fea49c7b91e104915c, role_id=04d0e4575a28440eb4349b4a6565e8b8)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:34:50.260563 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295fa4b8-9010-4f0f-8f2e-ddd23a95f066 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:34:50.275038 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1143/2296] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:34:50 2022] PUT /identity/v3/projects/b51b8540f54f41c2825c69eff1faa2bf/users/2379ccc822e941fea49c7b91e104915c/roles/04d0e4575a28440eb4349b4a6565e8b8 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:34:50.285594 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c4b0c-8a3a-45ef-adff-37071b5a796b None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:34:50.285888 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c4b0c-8a3a-45ef-adff-37071b5a796b None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:34:50.286168 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c4b0c-8a3a-45ef-adff-37071b5a796b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:34:50.314658 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-151c4b0c-8a3a-45ef-adff-37071b5a796b None None] MFA Rules not processed for user `2379ccc822e941fea49c7b91e104915c`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:34:50.315867 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-151c4b0c-8a3a-45ef-adff-37071b5a796b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:34:50.379763 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1154/2297] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:34:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 03:34:50.385056 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295fa4b8-9010-4f0f-8f2e-ddd23a95f066 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:34:50.444923 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295fa4b8-9010-4f0f-8f2e-ddd23a95f066 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:34:50.449798 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05975daf-7b95-4322-b0cb-6a6025a7567d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:34:50.450401 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05975daf-7b95-4322-b0cb-6a6025a7567d admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:34:50.450680 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05975daf-7b95-4322-b0cb-6a6025a7567d admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:34:50.450957 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05975daf-7b95-4322-b0cb-6a6025a7567d admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:34:50.451625 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05975daf-7b95-4322-b0cb-6a6025a7567d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:34:50.453570 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05975daf-7b95-4322-b0cb-6a6025a7567d admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:34:50.480856 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1144/2298] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:34:50 2022] POST /identity/v3/projects => generated 365 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:34:50.485030 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151c4b0c-8a3a-45ef-adff-37071b5a796b None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:34:50.495605 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151c4b0c-8a3a-45ef-adff-37071b5a796b None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:34:50.520813 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:34:50.552230 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28e12c7-2a53-423e-a32a-5880dce1e19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:34:50.552847 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e12c7-2a53-423e-a32a-5880dce1e19f admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:34:50.553127 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e12c7-2a53-423e-a32a-5880dce1e19f admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:34:50.553399 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e12c7-2a53-423e-a32a-5880dce1e19f admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:34:50.554031 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28e12c7-2a53-423e-a32a-5880dce1e19f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:34:50.555998 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28e12c7-2a53-423e-a32a-5880dce1e19f admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:34:50.580901 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1155/2299] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:34:50 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:34:50.581882 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05975daf-7b95-4322-b0cb-6a6025a7567d admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:34:50.592942 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05975daf-7b95-4322-b0cb-6a6025a7567d admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:34:50.598138 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bfecd9-713a-412a-8765-45866f2227a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:34:50.598737 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bfecd9-713a-412a-8765-45866f2227a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:34:50.599069 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bfecd9-713a-412a-8765-45866f2227a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:34:50.599351 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bfecd9-713a-412a-8765-45866f2227a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:34:50.600056 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bfecd9-713a-412a-8765-45866f2227a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:34:50.601657 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bfecd9-713a-412a-8765-45866f2227a2 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:34:50.613325 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1145/2300] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:34:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 03:34:50.617507 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28e12c7-2a53-423e-a32a-5880dce1e19f admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:34:50.628013 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28e12c7-2a53-423e-a32a-5880dce1e19f admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:34:50.632804 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59801884-bec3-47f8-a806-7b8241f06a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:34:50.633523 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59801884-bec3-47f8-a806-7b8241f06a16 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:34:50.634001 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59801884-bec3-47f8-a806-7b8241f06a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:34:50.634401 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59801884-bec3-47f8-a806-7b8241f06a16 admin admin] PATH_INFO: `/v3/projects/8895387149ce4188a07a6586a3ef1720/users/2e9ef66f2af444c187cb19f36bf43e1a/roles/fe9379cda35c4ff78576fe48b60bea3c` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:34:50.655323 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59801884-bec3-47f8-a806-7b8241f06a16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8895387149ce4188a07a6586a3ef1720, user_id=2e9ef66f2af444c187cb19f36bf43e1a, role_id=fe9379cda35c4ff78576fe48b60bea3c)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:34:50.658054 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59801884-bec3-47f8-a806-7b8241f06a16 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:34:50.672303 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1156/2301] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:34:50 2022] PUT /identity/v3/projects/8895387149ce4188a07a6586a3ef1720/users/2e9ef66f2af444c187cb19f36bf43e1a/roles/fe9379cda35c4ff78576fe48b60bea3c => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:34:50.676246 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bfecd9-713a-412a-8765-45866f2227a2 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:34:50.686329 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bfecd9-713a-412a-8765-45866f2227a2 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:34:50.725827 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:34:50.748019 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c2c700-0e59-4aea-ab0a-3e832df29fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:34:50.748704 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2c700-0e59-4aea-ab0a-3e832df29fe9 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:34:50.748992 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2c700-0e59-4aea-ab0a-3e832df29fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:34:50.749295 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2c700-0e59-4aea-ab0a-3e832df29fe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:34:50.749943 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c2c700-0e59-4aea-ab0a-3e832df29fe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:34:50.751583 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c2c700-0e59-4aea-ab0a-3e832df29fe9 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:34:50.764531 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1146/2302] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:34:50 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:34:50.765734 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59801884-bec3-47f8-a806-7b8241f06a16 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:34:50.775813 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59801884-bec3-47f8-a806-7b8241f06a16 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:34:50.780403 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10896e46-d4df-47e8-80e5-98ac4dc2d827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:34:50.781039 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10896e46-d4df-47e8-80e5-98ac4dc2d827 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:34:50.781316 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10896e46-d4df-47e8-80e5-98ac4dc2d827 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:34:50.781588 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10896e46-d4df-47e8-80e5-98ac4dc2d827 admin admin] PATH_INFO: `/v3/projects/8895387149ce4188a07a6586a3ef1720/users/2e9ef66f2af444c187cb19f36bf43e1a/roles/fe9379cda35c4ff78576fe48b60bea3c` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:34:50.783461 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10896e46-d4df-47e8-80e5-98ac4dc2d827 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8895387149ce4188a07a6586a3ef1720, user_id=2e9ef66f2af444c187cb19f36bf43e1a, role_id=fe9379cda35c4ff78576fe48b60bea3c)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:34:50.786061 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10896e46-d4df-47e8-80e5-98ac4dc2d827 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:34:50.796906 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1157/2303] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:34:50 2022] PUT /identity/v3/projects/8895387149ce4188a07a6586a3ef1720/users/2e9ef66f2af444c187cb19f36bf43e1a/roles/fe9379cda35c4ff78576fe48b60bea3c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 03:34:50.807390 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fca47c-afed-4cf0-8c64-af04fd914ff9 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:34:50.807708 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fca47c-afed-4cf0-8c64-af04fd914ff9 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:34:50.807993 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fca47c-afed-4cf0-8c64-af04fd914ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:34:50.835725 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-96fca47c-afed-4cf0-8c64-af04fd914ff9 None None] MFA Rules not processed for user `2e9ef66f2af444c187cb19f36bf43e1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:34:50.837185 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-96fca47c-afed-4cf0-8c64-af04fd914ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:34:50.906402 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1147/2304] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:34:50 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 03:34:50.918405 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10896e46-d4df-47e8-80e5-98ac4dc2d827 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:34:50.920130 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-10896e46-d4df-47e8-80e5-98ac4dc2d827 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:34:50.976356 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10896e46-d4df-47e8-80e5-98ac4dc2d827 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:34:50.980538 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4832bd9c-67d3-4969-a606-cb77d592246c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f537aabf3d1040ff840b02616f839975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:34:50.981156 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4832bd9c-67d3-4969-a606-cb77d592246c service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:34:50.981435 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4832bd9c-67d3-4969-a606-cb77d592246c service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:34:50.981703 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4832bd9c-67d3-4969-a606-cb77d592246c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:34:50.990430 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4832bd9c-67d3-4969-a606-cb77d592246c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:34:50.991865 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4832bd9c-67d3-4969-a606-cb77d592246c service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:34:51.001968 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1158/2305] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:34:50 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:34:51.081329 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fca47c-afed-4cf0-8c64-af04fd914ff9 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:34:51.091389 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fca47c-afed-4cf0-8c64-af04fd914ff9 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:34:51.094947 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7c08da-a196-485b-b4cf-cea1237b696e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f537aabf3d1040ff840b02616f839975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:34:51.095561 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c08da-a196-485b-b4cf-cea1237b696e service cinder] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:34:51.095841 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c08da-a196-485b-b4cf-cea1237b696e service cinder] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:34:51.096110 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c08da-a196-485b-b4cf-cea1237b696e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:34:51.151261 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7c08da-a196-485b-b4cf-cea1237b696e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:34:51.152712 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7c08da-a196-485b-b4cf-cea1237b696e service cinder] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:34:51.161293 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1148/2306] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:34:51 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:34:52.898047 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4832bd9c-67d3-4969-a606-cb77d592246c service cinder] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:34:52.900141 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-4832bd9c-67d3-4969-a606-cb77d592246c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:34:52.974958 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4832bd9c-67d3-4969-a606-cb77d592246c service cinder] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:34:52.980597 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cb9b11-1a68-4e3d-907a-cb0d6b8c8e65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1f412befb9418fa66a2aabf475aa90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:34:52.981209 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb9b11-1a68-4e3d-907a-cb0d6b8c8e65 service nova] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:34:52.981491 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb9b11-1a68-4e3d-907a-cb0d6b8c8e65 service nova] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:34:52.981768 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb9b11-1a68-4e3d-907a-cb0d6b8c8e65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:34:52.983534 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-23cb9b11-1a68-4e3d-907a-cb0d6b8c8e65 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:34:53.003205 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:34:53.047842 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cb9b11-1a68-4e3d-907a-cb0d6b8c8e65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:34:53.049423 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cb9b11-1a68-4e3d-907a-cb0d6b8c8e65 service nova] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:34:53.065269 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1159/2307] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:34:52 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:34:57.169071 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7c08da-a196-485b-b4cf-cea1237b696e service cinder] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:34:57.231619 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7c08da-a196-485b-b4cf-cea1237b696e service cinder] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:34:57.236130 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b076b-51ac-4952-8174-87d20c12749a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:34:57.236744 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b076b-51ac-4952-8174-87d20c12749a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:34:57.237023 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b076b-51ac-4952-8174-87d20c12749a admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:34:57.237295 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b076b-51ac-4952-8174-87d20c12749a admin admin] PATH_INFO: `/v3/users/2379ccc822e941fea49c7b91e104915c` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:34:57.238404 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211b076b-51ac-4952-8174-87d20c12749a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2379ccc822e941fea49c7b91e104915c)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:34:57.240314 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211b076b-51ac-4952-8174-87d20c12749a admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:34:57.241767 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:34:57.287188 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-211b076b-51ac-4952-8174-87d20c12749a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2379ccc822e941fea49c7b91e104915c'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:34:57.294024 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-211b076b-51ac-4952-8174-87d20c12749a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2379ccc822e941fea49c7b91e104915c'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:34:57.301336 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-211b076b-51ac-4952-8174-87d20c12749a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2379ccc822e941fea49c7b91e104915c'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:34:57.303169 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-211b076b-51ac-4952-8174-87d20c12749a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2379ccc822e941fea49c7b91e104915c'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:34:57.316467 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-211b076b-51ac-4952-8174-87d20c12749a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2379ccc822e941fea49c7b91e104915c'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:34:57.323974 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1149/2308] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:34:57 2022] DELETE /identity/v3/users/2379ccc822e941fea49c7b91e104915c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:34:57.328459 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5ae1a0-c39c-4f04-96fe-0987e8223ce8 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:34:57.328942 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5ae1a0-c39c-4f04-96fe-0987e8223ce8 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:34:57.329036 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5ae1a0-c39c-4f04-96fe-0987e8223ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:34:57.353782 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-1d5ae1a0-c39c-4f04-96fe-0987e8223ce8 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:34:57.355277 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-1d5ae1a0-c39c-4f04-96fe-0987e8223ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:34:57.421223 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1160/2309] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:34:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:34:57.431373 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b076b-51ac-4952-8174-87d20c12749a admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:34:57.433686 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-211b076b-51ac-4952-8174-87d20c12749a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:34:57.499270 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b076b-51ac-4952-8174-87d20c12749a admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:34:57.503894 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f83a5-4a20-4453-ba52-52af67ea070c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:34:57.504495 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f83a5-4a20-4453-ba52-52af67ea070c service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:34:57.504771 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f83a5-4a20-4453-ba52-52af67ea070c service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:34:57.505042 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f83a5-4a20-4453-ba52-52af67ea070c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:34:57.515733 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98f83a5-4a20-4453-ba52-52af67ea070c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:34:57.517547 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98f83a5-4a20-4453-ba52-52af67ea070c service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:34:57.528100 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1150/2310] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:34:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 03:34:57.930837 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5ae1a0-c39c-4f04-96fe-0987e8223ce8 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:34:57.933834 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-1d5ae1a0-c39c-4f04-96fe-0987e8223ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:34:57.947217 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5ae1a0-c39c-4f04-96fe-0987e8223ce8 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:34:57.952750 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1fdcce-491c-44a1-ab3f-841623bd9f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:34:57.953460 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1fdcce-491c-44a1-ab3f-841623bd9f9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:34:57.953958 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1fdcce-491c-44a1-ab3f-841623bd9f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:34:57.954308 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1fdcce-491c-44a1-ab3f-841623bd9f9b admin admin] PATH_INFO: `/v3/projects/b51b8540f54f41c2825c69eff1faa2bf` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:34:57.955602 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1fdcce-491c-44a1-ab3f-841623bd9f9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b51b8540f54f41c2825c69eff1faa2bf)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:34:57.957581 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1fdcce-491c-44a1-ab3f-841623bd9f9b admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:34:58.005364 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-8a1fdcce-491c-44a1-ab3f-841623bd9f9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b51b8540f54f41c2825c69eff1faa2bf', 'request_id': 'req-8a1fdcce-491c-44a1-ab3f-841623bd9f9b'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:34:58.011571 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-8a1fdcce-491c-44a1-ab3f-841623bd9f9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b51b8540f54f41c2825c69eff1faa2bf', 'request_id': 'req-8a1fdcce-491c-44a1-ab3f-841623bd9f9b'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:34:58.017689 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-8a1fdcce-491c-44a1-ab3f-841623bd9f9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b51b8540f54f41c2825c69eff1faa2bf', 'request_id': 'req-8a1fdcce-491c-44a1-ab3f-841623bd9f9b'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:34:58.029560 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-8a1fdcce-491c-44a1-ab3f-841623bd9f9b admin admin] The token cache is being invalidate because project b51b8540f54f41c2825c69eff1faa2bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:34:58.029794 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-8a1fdcce-491c-44a1-ab3f-841623bd9f9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:34:58.030412 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-8a1fdcce-491c-44a1-ab3f-841623bd9f9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:34:58.031909 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1161/2311] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:34:57 2022] DELETE /identity/v3/projects/b51b8540f54f41c2825c69eff1faa2bf => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 03:34:58.036219 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f83a5-4a20-4453-ba52-52af67ea070c service neutron] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:34:58.045230 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f83a5-4a20-4453-ba52-52af67ea070c service neutron] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:34:58.099686 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d50c1-9e62-4db2-9338-851281fe8165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:34:58.100220 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d50c1-9e62-4db2-9338-851281fe8165 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:34:58.100500 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d50c1-9e62-4db2-9338-851281fe8165 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:34:58.100773 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d50c1-9e62-4db2-9338-851281fe8165 admin admin] PATH_INFO: `/v3/users/2e9ef66f2af444c187cb19f36bf43e1a` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:34:58.101916 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2d50c1-9e62-4db2-9338-851281fe8165 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e9ef66f2af444c187cb19f36bf43e1a)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:34:58.104418 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2d50c1-9e62-4db2-9338-851281fe8165 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:34:58.127189 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:34:58.151689 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-ff2d50c1-9e62-4db2-9338-851281fe8165 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e9ef66f2af444c187cb19f36bf43e1a'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:34:58.158445 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-ff2d50c1-9e62-4db2-9338-851281fe8165 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e9ef66f2af444c187cb19f36bf43e1a'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:34:58.165794 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-ff2d50c1-9e62-4db2-9338-851281fe8165 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e9ef66f2af444c187cb19f36bf43e1a'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:34:58.167008 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-ff2d50c1-9e62-4db2-9338-851281fe8165 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e9ef66f2af444c187cb19f36bf43e1a'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:34:58.180077 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-ff2d50c1-9e62-4db2-9338-851281fe8165 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e9ef66f2af444c187cb19f36bf43e1a'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:34:58.187533 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1151/2312] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:34:58 2022] DELETE /identity/v3/users/2e9ef66f2af444c187cb19f36bf43e1a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:34:58.468098 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1fdcce-491c-44a1-ab3f-841623bd9f9b admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:34:58.469554 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-8a1fdcce-491c-44a1-ab3f-841623bd9f9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:34:58.483435 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1fdcce-491c-44a1-ab3f-841623bd9f9b admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:34:58.527277 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:34:58.543017 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4309eb5-c8c4-44c6-b631-defcc86af48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:34:58.543673 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4309eb5-c8c4-44c6-b631-defcc86af48c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:34:58.543956 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4309eb5-c8c4-44c6-b631-defcc86af48c admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:34:58.544231 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4309eb5-c8c4-44c6-b631-defcc86af48c admin admin] PATH_INFO: `/v3/projects/8895387149ce4188a07a6586a3ef1720` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:34:58.545344 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4309eb5-c8c4-44c6-b631-defcc86af48c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8895387149ce4188a07a6586a3ef1720)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:34:58.547250 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4309eb5-c8c4-44c6-b631-defcc86af48c admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:34:58.593492 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-d4309eb5-c8c4-44c6-b631-defcc86af48c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8895387149ce4188a07a6586a3ef1720', 'request_id': 'req-d4309eb5-c8c4-44c6-b631-defcc86af48c'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:34:58.598935 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-d4309eb5-c8c4-44c6-b631-defcc86af48c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8895387149ce4188a07a6586a3ef1720', 'request_id': 'req-d4309eb5-c8c4-44c6-b631-defcc86af48c'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:34:58.605536 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-d4309eb5-c8c4-44c6-b631-defcc86af48c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8895387149ce4188a07a6586a3ef1720', 'request_id': 'req-d4309eb5-c8c4-44c6-b631-defcc86af48c'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:34:58.617870 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-d4309eb5-c8c4-44c6-b631-defcc86af48c admin admin] The token cache is being invalidate because project 8895387149ce4188a07a6586a3ef1720 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:34:58.618161 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-d4309eb5-c8c4-44c6-b631-defcc86af48c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:34:58.618786 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-d4309eb5-c8c4-44c6-b631-defcc86af48c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:34:58.620998 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1162/2313] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:34:58 2022] DELETE /identity/v3/projects/8895387149ce4188a07a6586a3ef1720 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 03:34:58.625842 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0a29c-cee8-42ae-848f-80b33d4d4800 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:34:58.626205 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0a29c-cee8-42ae-848f-80b33d4d4800 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:34:58.626511 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0a29c-cee8-42ae-848f-80b33d4d4800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:34:58.647037 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-9ad0a29c-cee8-42ae-848f-80b33d4d4800 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:34:58.648269 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-9ad0a29c-cee8-42ae-848f-80b33d4d4800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:34:58.707058 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1152/2314] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:34:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:34:58.714271 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15476c76-d279-4ce0-9b69-dc1aa048c2c8 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:34:58.714635 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15476c76-d279-4ce0-9b69-dc1aa048c2c8 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:34:58.714999 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15476c76-d279-4ce0-9b69-dc1aa048c2c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:34:58.735046 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-15476c76-d279-4ce0-9b69-dc1aa048c2c8 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:34:58.736391 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-15476c76-d279-4ce0-9b69-dc1aa048c2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:34:58.745687 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1163/2315] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:34:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:34:58.749677 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0a29c-cee8-42ae-848f-80b33d4d4800 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:34:58.766517 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0a29c-cee8-42ae-848f-80b33d4d4800 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:34:58.771102 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca42d80-27b3-4497-a548-73192bc2fef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:34:58.771711 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca42d80-27b3-4497-a548-73192bc2fef3 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:34:58.771989 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca42d80-27b3-4497-a548-73192bc2fef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:34:58.772262 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca42d80-27b3-4497-a548-73192bc2fef3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:34:58.772897 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca42d80-27b3-4497-a548-73192bc2fef3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:34:58.773195 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca42d80-27b3-4497-a548-73192bc2fef3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:34:58.774750 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca42d80-27b3-4497-a548-73192bc2fef3 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:34:58.794079 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1153/2316] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 03:34:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:34:58.798457 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15476c76-d279-4ce0-9b69-dc1aa048c2c8 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:34:58.808730 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15476c76-d279-4ce0-9b69-dc1aa048c2c8 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:34:58.813485 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3950080-3806-4961-af68-cf4549f8e0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:34:58.814071 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3950080-3806-4961-af68-cf4549f8e0ca admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:34:58.814350 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3950080-3806-4961-af68-cf4549f8e0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:34:58.814621 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3950080-3806-4961-af68-cf4549f8e0ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:34:58.815260 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3950080-3806-4961-af68-cf4549f8e0ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:34:58.817148 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3950080-3806-4961-af68-cf4549f8e0ca admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:34:58.845489 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1164/2317] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:34:58 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:34:58.849639 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca42d80-27b3-4497-a548-73192bc2fef3 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:34:58.859775 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca42d80-27b3-4497-a548-73192bc2fef3 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:34:58.917122 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf93a97a-960b-44fb-b8d6-327bbba0e354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:34:58.918173 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93a97a-960b-44fb-b8d6-327bbba0e354 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:34:58.918462 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93a97a-960b-44fb-b8d6-327bbba0e354 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:34:58.918742 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93a97a-960b-44fb-b8d6-327bbba0e354 admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:34:58.919379 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf93a97a-960b-44fb-b8d6-327bbba0e354 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:34:58.921324 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf93a97a-960b-44fb-b8d6-327bbba0e354 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:34:58.948227 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1154/2318] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:34:58 2022] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 03:34:58.949399 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3950080-3806-4961-af68-cf4549f8e0ca admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:34:58.959677 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3950080-3806-4961-af68-cf4549f8e0ca admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:34:58.964521 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6265093b-5af8-45e6-a79b-15cf145f9ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:34:58.965119 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6265093b-5af8-45e6-a79b-15cf145f9ae2 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:34:58.965405 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6265093b-5af8-45e6-a79b-15cf145f9ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:34:58.965683 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6265093b-5af8-45e6-a79b-15cf145f9ae2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:34:58.966353 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6265093b-5af8-45e6-a79b-15cf145f9ae2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:34:58.967988 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6265093b-5af8-45e6-a79b-15cf145f9ae2 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:34:58.981486 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1165/2319] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:34:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:34:58.982945 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf93a97a-960b-44fb-b8d6-327bbba0e354 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:34:58.993118 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf93a97a-960b-44fb-b8d6-327bbba0e354 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:34:58.999285 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955245aa-ff48-4837-a4fb-5a2dff1085d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:34:59.000157 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955245aa-ff48-4837-a4fb-5a2dff1085d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:34:59.000435 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955245aa-ff48-4837-a4fb-5a2dff1085d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:34:59.000789 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955245aa-ff48-4837-a4fb-5a2dff1085d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:34:59.001535 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955245aa-ff48-4837-a4fb-5a2dff1085d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:34:59.003203 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955245aa-ff48-4837-a4fb-5a2dff1085d1 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:34:59.016916 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1155/2320] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:34:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:34:59.021272 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6265093b-5af8-45e6-a79b-15cf145f9ae2 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:34:59.034624 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6265093b-5af8-45e6-a79b-15cf145f9ae2 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:34:59.040510 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0609c448-6e54-4b94-8758-eba6ee4b3a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:34:59.042011 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0609c448-6e54-4b94-8758-eba6ee4b3a6f admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:34:59.042364 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0609c448-6e54-4b94-8758-eba6ee4b3a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:34:59.042705 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0609c448-6e54-4b94-8758-eba6ee4b3a6f admin admin] PATH_INFO: `/v3/projects/983779b1af524a26b692d3ce7cb40524/users/1bf4aeff88ac4b29a877f071dd489b81/roles/04d0e4575a28440eb4349b4a6565e8b8` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:34:59.060409 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0609c448-6e54-4b94-8758-eba6ee4b3a6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=983779b1af524a26b692d3ce7cb40524, user_id=1bf4aeff88ac4b29a877f071dd489b81, role_id=04d0e4575a28440eb4349b4a6565e8b8)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:34:59.063801 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0609c448-6e54-4b94-8758-eba6ee4b3a6f admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:34:59.090520 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1166/2321] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:34:59 2022] PUT /identity/v3/projects/983779b1af524a26b692d3ce7cb40524/users/1bf4aeff88ac4b29a877f071dd489b81/roles/04d0e4575a28440eb4349b4a6565e8b8 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 03:34:59.094579 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a2ba95-8e68-4aa2-9d6f-684ed5f34110 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:34:59.094828 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a2ba95-8e68-4aa2-9d6f-684ed5f34110 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:34:59.095114 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a2ba95-8e68-4aa2-9d6f-684ed5f34110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:34:59.117376 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:34:59.137117 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-f0a2ba95-8e68-4aa2-9d6f-684ed5f34110 None None] MFA Rules not processed for user `1bf4aeff88ac4b29a877f071dd489b81`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:34:59.139144 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-f0a2ba95-8e68-4aa2-9d6f-684ed5f34110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:34:59.207815 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1156/2322] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:34:59 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:34:59.212467 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0609c448-6e54-4b94-8758-eba6ee4b3a6f admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:34:59.273471 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0609c448-6e54-4b94-8758-eba6ee4b3a6f admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:34:59.278716 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eaf414-374e-4ec5-839f-04b3d0778214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:34:59.279315 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eaf414-374e-4ec5-839f-04b3d0778214 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:34:59.279635 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eaf414-374e-4ec5-839f-04b3d0778214 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:34:59.279917 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eaf414-374e-4ec5-839f-04b3d0778214 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:34:59.280562 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eaf414-374e-4ec5-839f-04b3d0778214 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:34:59.282436 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eaf414-374e-4ec5-839f-04b3d0778214 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:34:59.298015 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:34:59.311573 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1167/2323] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:34:59 2022] POST /identity/v3/projects => generated 381 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:34:59.316030 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a2ba95-8e68-4aa2-9d6f-684ed5f34110 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:34:59.328338 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a2ba95-8e68-4aa2-9d6f-684ed5f34110 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:34:59.387011 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6608b44f-a2de-4d4c-b911-8ce9c5156314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:34:59.387544 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608b44f-a2de-4d4c-b911-8ce9c5156314 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:34:59.387832 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608b44f-a2de-4d4c-b911-8ce9c5156314 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:34:59.388108 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608b44f-a2de-4d4c-b911-8ce9c5156314 admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:34:59.388738 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6608b44f-a2de-4d4c-b911-8ce9c5156314 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:34:59.390634 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6608b44f-a2de-4d4c-b911-8ce9c5156314 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:34:59.411692 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1157/2324] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:34:59 2022] POST /identity/v3/users => generated 297 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 03:34:59.415809 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eaf414-374e-4ec5-839f-04b3d0778214 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:34:59.426665 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eaf414-374e-4ec5-839f-04b3d0778214 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:34:59.431301 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d34359f-07e8-411f-b4b5-44dcd2fb6922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:34:59.431994 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d34359f-07e8-411f-b4b5-44dcd2fb6922 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:34:59.432275 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d34359f-07e8-411f-b4b5-44dcd2fb6922 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:34:59.432552 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d34359f-07e8-411f-b4b5-44dcd2fb6922 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:34:59.433195 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d34359f-07e8-411f-b4b5-44dcd2fb6922 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:34:59.434774 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d34359f-07e8-411f-b4b5-44dcd2fb6922 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:34:59.445445 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1168/2325] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:34:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:34:59.449811 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6608b44f-a2de-4d4c-b911-8ce9c5156314 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:34:59.459662 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6608b44f-a2de-4d4c-b911-8ce9c5156314 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:34:59.464998 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16df37f5-3070-432a-aab7-a33328b502f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:34:59.465651 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df37f5-3070-432a-aab7-a33328b502f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:34:59.465934 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df37f5-3070-432a-aab7-a33328b502f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:34:59.466209 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df37f5-3070-432a-aab7-a33328b502f8 admin admin] PATH_INFO: `/v3/projects/7b4b2c4173404855ae02ad9c1bcc54d2/users/1671d896bc4f4283858cd131fd87fd39/roles/fe9379cda35c4ff78576fe48b60bea3c` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:34:59.481807 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16df37f5-3070-432a-aab7-a33328b502f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b4b2c4173404855ae02ad9c1bcc54d2, user_id=1671d896bc4f4283858cd131fd87fd39, role_id=fe9379cda35c4ff78576fe48b60bea3c)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:34:59.484529 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16df37f5-3070-432a-aab7-a33328b502f8 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:34:59.497210 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1158/2326] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:34:59 2022] PUT /identity/v3/projects/7b4b2c4173404855ae02ad9c1bcc54d2/users/1671d896bc4f4283858cd131fd87fd39/roles/fe9379cda35c4ff78576fe48b60bea3c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:34:59.501270 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d34359f-07e8-411f-b4b5-44dcd2fb6922 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:34:59.511291 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d34359f-07e8-411f-b4b5-44dcd2fb6922 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:34:59.568311 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe6c04e-12cb-40bf-8585-d5023c2ec6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:34:59.569227 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe6c04e-12cb-40bf-8585-d5023c2ec6c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:34:59.569509 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe6c04e-12cb-40bf-8585-d5023c2ec6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:34:59.569779 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe6c04e-12cb-40bf-8585-d5023c2ec6c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:34:59.570416 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe6c04e-12cb-40bf-8585-d5023c2ec6c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:34:59.572038 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe6c04e-12cb-40bf-8585-d5023c2ec6c3 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:34:59.581734 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1169/2327] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:34:59 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 03:34:59.585894 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16df37f5-3070-432a-aab7-a33328b502f8 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:34:59.596554 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16df37f5-3070-432a-aab7-a33328b502f8 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:34:59.601274 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a9ab91-0da9-4548-9672-685fc2c03812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:34:59.601904 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a9ab91-0da9-4548-9672-685fc2c03812 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:34:59.602203 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a9ab91-0da9-4548-9672-685fc2c03812 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:34:59.602453 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a9ab91-0da9-4548-9672-685fc2c03812 admin admin] PATH_INFO: `/v3/projects/7b4b2c4173404855ae02ad9c1bcc54d2/users/1671d896bc4f4283858cd131fd87fd39/roles/fe9379cda35c4ff78576fe48b60bea3c` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:34:59.605074 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a9ab91-0da9-4548-9672-685fc2c03812 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b4b2c4173404855ae02ad9c1bcc54d2, user_id=1671d896bc4f4283858cd131fd87fd39, role_id=fe9379cda35c4ff78576fe48b60bea3c)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:34:59.607679 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a9ab91-0da9-4548-9672-685fc2c03812 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:34:59.617832 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1159/2328] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:34:59 2022] PUT /identity/v3/projects/7b4b2c4173404855ae02ad9c1bcc54d2/users/1671d896bc4f4283858cd131fd87fd39/roles/fe9379cda35c4ff78576fe48b60bea3c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:34:59.629163 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5853b9-3b49-41e7-8710-52e8c6aa59ea None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:34:59.629560 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5853b9-3b49-41e7-8710-52e8c6aa59ea None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:34:59.629913 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5853b9-3b49-41e7-8710-52e8c6aa59ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:34:59.658491 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-bc5853b9-3b49-41e7-8710-52e8c6aa59ea None None] MFA Rules not processed for user `1671d896bc4f4283858cd131fd87fd39`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:34:59.659663 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-bc5853b9-3b49-41e7-8710-52e8c6aa59ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:34:59.733344 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1170/2329] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:34:59 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:34:59.745661 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a9ab91-0da9-4548-9672-685fc2c03812 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:34:59.747376 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-87a9ab91-0da9-4548-9672-685fc2c03812 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:34:59.805876 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:34:59.811686 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a9ab91-0da9-4548-9672-685fc2c03812 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:34:59.816055 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86360ba1-f95e-4dcd-bea6-0ffe0093a249 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f537aabf3d1040ff840b02616f839975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:34:59.816740 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86360ba1-f95e-4dcd-bea6-0ffe0093a249 service cinder] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:34:59.817069 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86360ba1-f95e-4dcd-bea6-0ffe0093a249 service cinder] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:34:59.817428 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86360ba1-f95e-4dcd-bea6-0ffe0093a249 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:34:59.829446 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86360ba1-f95e-4dcd-bea6-0ffe0093a249 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:34:59.831129 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86360ba1-f95e-4dcd-bea6-0ffe0093a249 service cinder] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:34:59.843025 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1160/2330] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:34:59 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:35:00.105004 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096f896-0484-4ad8-8c43-c0d991c2fce6 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:00.105255 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096f896-0484-4ad8-8c43-c0d991c2fce6 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:00.105543 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096f896-0484-4ad8-8c43-c0d991c2fce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:00.132495 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-e096f896-0484-4ad8-8c43-c0d991c2fce6 None None] MFA Rules not processed for user `bef61ef12079495ba72b7fcd2717aca2`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:35:00.136066 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-e096f896-0484-4ad8-8c43-c0d991c2fce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:00.209753 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86360ba1-f95e-4dcd-bea6-0ffe0093a249 service cinder] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:00.220142 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86360ba1-f95e-4dcd-bea6-0ffe0093a249 service cinder] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:00.227144 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1171/2331] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Oct 4 03:35:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:35:00.233280 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf91d4a-3768-46e8-8c94-ede5c0aa6c39 tempest-VolumeQuotaClassesTest-1639219491 tempest-VolumeQuotaClassesTest-1639219491-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1671d896bc4f4283858cd131fd87fd39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b4b2c4173404855ae02ad9c1bcc54d2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:00.234068 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf91d4a-3768-46e8-8c94-ede5c0aa6c39 tempest-VolumeQuotaClassesTest-1639219491 tempest-VolumeQuotaClassesTest-1639219491-project-admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:00.234504 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf91d4a-3768-46e8-8c94-ede5c0aa6c39 tempest-VolumeQuotaClassesTest-1639219491 tempest-VolumeQuotaClassesTest-1639219491-project-admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:00.234908 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf91d4a-3768-46e8-8c94-ede5c0aa6c39 tempest-VolumeQuotaClassesTest-1639219491 tempest-VolumeQuotaClassesTest-1639219491-project-admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:00.235707 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf91d4a-3768-46e8-8c94-ede5c0aa6c39 tempest-VolumeQuotaClassesTest-1639219491 tempest-VolumeQuotaClassesTest-1639219491-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:35:00.236209 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf91d4a-3768-46e8-8c94-ede5c0aa6c39 tempest-VolumeQuotaClassesTest-1639219491 tempest-VolumeQuotaClassesTest-1639219491-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:00.238729 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf91d4a-3768-46e8-8c94-ede5c0aa6c39 tempest-VolumeQuotaClassesTest-1639219491 tempest-VolumeQuotaClassesTest-1639219491-project-admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:00.254240 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1161/2332] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 03:35:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:35:00.258326 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e096f896-0484-4ad8-8c43-c0d991c2fce6 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:00.270210 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e096f896-0484-4ad8-8c43-c0d991c2fce6 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:00.276705 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61706ba1-ed28-4078-827e-b67174e9353a tempest-VolumeQuotaClassesTest-1639219491 tempest-VolumeQuotaClassesTest-1639219491-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1671d896bc4f4283858cd131fd87fd39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b4b2c4173404855ae02ad9c1bcc54d2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:00.277129 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61706ba1-ed28-4078-827e-b67174e9353a tempest-VolumeQuotaClassesTest-1639219491 tempest-VolumeQuotaClassesTest-1639219491-project-admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:00.277397 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61706ba1-ed28-4078-827e-b67174e9353a tempest-VolumeQuotaClassesTest-1639219491 tempest-VolumeQuotaClassesTest-1639219491-project-admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:00.277919 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61706ba1-ed28-4078-827e-b67174e9353a tempest-VolumeQuotaClassesTest-1639219491 tempest-VolumeQuotaClassesTest-1639219491-project-admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:00.278679 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61706ba1-ed28-4078-827e-b67174e9353a tempest-VolumeQuotaClassesTest-1639219491 tempest-VolumeQuotaClassesTest-1639219491-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:00.280700 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61706ba1-ed28-4078-827e-b67174e9353a tempest-VolumeQuotaClassesTest-1639219491 tempest-VolumeQuotaClassesTest-1639219491-project-admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:00.294968 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:35:00.315805 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf91d4a-3768-46e8-8c94-ede5c0aa6c39 tempest-VolumeQuotaClassesTest-1639219491 tempest-VolumeQuotaClassesTest-1639219491-project-admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:00.317791 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-2cf91d4a-3768-46e8-8c94-ede5c0aa6c39 tempest-VolumeQuotaClassesTest-1639219491 tempest-VolumeQuotaClassesTest-1639219491-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:00.338446 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1172/2333] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:35:00 2022] POST /identity/v3/projects => generated 354 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:35:00.347748 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61706ba1-ed28-4078-827e-b67174e9353a tempest-VolumeQuotaClassesTest-1639219491 tempest-VolumeQuotaClassesTest-1639219491-project-admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:00.430131 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf91d4a-3768-46e8-8c94-ede5c0aa6c39 tempest-VolumeQuotaClassesTest-1639219491 tempest-VolumeQuotaClassesTest-1639219491-project-admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:00.446640 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61706ba1-ed28-4078-827e-b67174e9353a tempest-VolumeQuotaClassesTest-1639219491 tempest-VolumeQuotaClassesTest-1639219491-project-admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:00.452348 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b9222b-9816-4f5c-b655-f437dd5e35c5 tempest-VolumeQuotaClassesTest-1639219491 tempest-VolumeQuotaClassesTest-1639219491-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1671d896bc4f4283858cd131fd87fd39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b4b2c4173404855ae02ad9c1bcc54d2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:00.453040 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b9222b-9816-4f5c-b655-f437dd5e35c5 tempest-VolumeQuotaClassesTest-1639219491 tempest-VolumeQuotaClassesTest-1639219491-project-admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:00.453392 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b9222b-9816-4f5c-b655-f437dd5e35c5 tempest-VolumeQuotaClassesTest-1639219491 tempest-VolumeQuotaClassesTest-1639219491-project-admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:00.453736 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b9222b-9816-4f5c-b655-f437dd5e35c5 tempest-VolumeQuotaClassesTest-1639219491 tempest-VolumeQuotaClassesTest-1639219491-project-admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:00.454603 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b9222b-9816-4f5c-b655-f437dd5e35c5 tempest-VolumeQuotaClassesTest-1639219491 tempest-VolumeQuotaClassesTest-1639219491-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:35:00.455105 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b9222b-9816-4f5c-b655-f437dd5e35c5 tempest-VolumeQuotaClassesTest-1639219491 tempest-VolumeQuotaClassesTest-1639219491-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:00.456824 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b9222b-9816-4f5c-b655-f437dd5e35c5 tempest-VolumeQuotaClassesTest-1639219491 tempest-VolumeQuotaClassesTest-1639219491-project-admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:00.472950 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1173/2334] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 03:35:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:35:00.512675 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b9222b-9816-4f5c-b655-f437dd5e35c5 tempest-VolumeQuotaClassesTest-1639219491 tempest-VolumeQuotaClassesTest-1639219491-project-admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:00.517434 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300a612a-827d-45f6-a4b7-fa417130efbd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8da6bacc8f432e8f48bb99c7aede11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:00.518200 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a612a-827d-45f6-a4b7-fa417130efbd service swift] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:00.518336 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a612a-827d-45f6-a4b7-fa417130efbd service swift] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:00.518608 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a612a-827d-45f6-a4b7-fa417130efbd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:00.523344 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b9222b-9816-4f5c-b655-f437dd5e35c5 tempest-VolumeQuotaClassesTest-1639219491 tempest-VolumeQuotaClassesTest-1639219491-project-admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:00.528772 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bcc56e-2aa5-4d53-bc2e-0345b6a25f43 tempest-VolumeQuotaClassesTest-1639219491 tempest-VolumeQuotaClassesTest-1639219491-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1671d896bc4f4283858cd131fd87fd39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b4b2c4173404855ae02ad9c1bcc54d2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:00.530412 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bcc56e-2aa5-4d53-bc2e-0345b6a25f43 tempest-VolumeQuotaClassesTest-1639219491 tempest-VolumeQuotaClassesTest-1639219491-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:00.530412 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bcc56e-2aa5-4d53-bc2e-0345b6a25f43 tempest-VolumeQuotaClassesTest-1639219491 tempest-VolumeQuotaClassesTest-1639219491-project-admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:00.530412 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bcc56e-2aa5-4d53-bc2e-0345b6a25f43 tempest-VolumeQuotaClassesTest-1639219491 tempest-VolumeQuotaClassesTest-1639219491-project-admin] PATH_INFO: `/v3/projects/dfa5dfc4bd714747a65387ec91658a7c` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:00.531406 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bcc56e-2aa5-4d53-bc2e-0345b6a25f43 tempest-VolumeQuotaClassesTest-1639219491 tempest-VolumeQuotaClassesTest-1639219491-project-admin] RBAC: Authorizing `identity:delete_project(project_id=dfa5dfc4bd714747a65387ec91658a7c)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:00.533844 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bcc56e-2aa5-4d53-bc2e-0345b6a25f43 tempest-VolumeQuotaClassesTest-1639219491 tempest-VolumeQuotaClassesTest-1639219491-project-admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:00.586217 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300a612a-827d-45f6-a4b7-fa417130efbd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:00.589617 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-60bcc56e-2aa5-4d53-bc2e-0345b6a25f43 tempest-VolumeQuotaClassesTest-1639219491 tempest-VolumeQuotaClassesTest-1639219491-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfa5dfc4bd714747a65387ec91658a7c', 'request_id': 'req-60bcc56e-2aa5-4d53-bc2e-0345b6a25f43'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:00.589911 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300a612a-827d-45f6-a4b7-fa417130efbd service swift] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:00.594495 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-60bcc56e-2aa5-4d53-bc2e-0345b6a25f43 tempest-VolumeQuotaClassesTest-1639219491 tempest-VolumeQuotaClassesTest-1639219491-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfa5dfc4bd714747a65387ec91658a7c', 'request_id': 'req-60bcc56e-2aa5-4d53-bc2e-0345b6a25f43'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:00.602899 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1162/2335] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Oct 4 03:35:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 03:35:00.603098 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-60bcc56e-2aa5-4d53-bc2e-0345b6a25f43 tempest-VolumeQuotaClassesTest-1639219491 tempest-VolumeQuotaClassesTest-1639219491-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfa5dfc4bd714747a65387ec91658a7c', 'request_id': 'req-60bcc56e-2aa5-4d53-bc2e-0345b6a25f43'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:00.618960 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-60bcc56e-2aa5-4d53-bc2e-0345b6a25f43 tempest-VolumeQuotaClassesTest-1639219491 tempest-VolumeQuotaClassesTest-1639219491-project-admin] The token cache is being invalidate because project dfa5dfc4bd714747a65387ec91658a7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:35:00.619421 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-60bcc56e-2aa5-4d53-bc2e-0345b6a25f43 tempest-VolumeQuotaClassesTest-1639219491 tempest-VolumeQuotaClassesTest-1639219491-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:00.620493 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-60bcc56e-2aa5-4d53-bc2e-0345b6a25f43 tempest-VolumeQuotaClassesTest-1639219491 tempest-VolumeQuotaClassesTest-1639219491-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:00.635822 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1174/2336] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:35:00 2022] DELETE /identity/v3/projects/dfa5dfc4bd714747a65387ec91658a7c => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 03:35:00.905949 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300a612a-827d-45f6-a4b7-fa417130efbd service swift] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:00.938964 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:35:01.004889 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300a612a-827d-45f6-a4b7-fa417130efbd service swift] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:01.075401 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc73a1f-f46a-42fa-8480-0e17caa1fc06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:01.076081 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc73a1f-f46a-42fa-8480-0e17caa1fc06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:01.076360 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc73a1f-f46a-42fa-8480-0e17caa1fc06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:01.076634 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc73a1f-f46a-42fa-8480-0e17caa1fc06 admin admin] PATH_INFO: `/v3/users/1bf4aeff88ac4b29a877f071dd489b81` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:01.078368 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc73a1f-f46a-42fa-8480-0e17caa1fc06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bf4aeff88ac4b29a877f071dd489b81)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:01.080287 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc73a1f-f46a-42fa-8480-0e17caa1fc06 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:01.162280 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-ccc73a1f-f46a-42fa-8480-0e17caa1fc06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bf4aeff88ac4b29a877f071dd489b81'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:01.171984 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-ccc73a1f-f46a-42fa-8480-0e17caa1fc06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bf4aeff88ac4b29a877f071dd489b81'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:01.182264 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-ccc73a1f-f46a-42fa-8480-0e17caa1fc06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bf4aeff88ac4b29a877f071dd489b81'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:01.182983 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-ccc73a1f-f46a-42fa-8480-0e17caa1fc06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bf4aeff88ac4b29a877f071dd489b81'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:01.200350 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-ccc73a1f-f46a-42fa-8480-0e17caa1fc06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bf4aeff88ac4b29a877f071dd489b81'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:01.214671 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1163/2337] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:35:00 2022] DELETE /identity/v3/users/1bf4aeff88ac4b29a877f071dd489b81 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:35:01.216917 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5105b324-d17f-4c90-b69f-d6ff1a05ac33 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:01.217763 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5105b324-d17f-4c90-b69f-d6ff1a05ac33 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:01.218247 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5105b324-d17f-4c90-b69f-d6ff1a05ac33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:01.243642 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-5105b324-d17f-4c90-b69f-d6ff1a05ac33 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:35:01.245299 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-5105b324-d17f-4c90-b69f-d6ff1a05ac33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:01.361746 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1175/2338] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:35:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:35:01.372973 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc73a1f-f46a-42fa-8480-0e17caa1fc06 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:01.374811 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-ccc73a1f-f46a-42fa-8480-0e17caa1fc06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:01.441040 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:35:01.446379 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc73a1f-f46a-42fa-8480-0e17caa1fc06 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:01.450727 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7997ef3-3b29-4b27-976c-3616b733ba67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:01.451308 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7997ef3-3b29-4b27-976c-3616b733ba67 service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:01.452063 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7997ef3-3b29-4b27-976c-3616b733ba67 service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:01.453017 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7997ef3-3b29-4b27-976c-3616b733ba67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:01.473244 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7997ef3-3b29-4b27-976c-3616b733ba67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:01.474832 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7997ef3-3b29-4b27-976c-3616b733ba67 service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:01.508888 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1164/2339] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:35:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:35:01.911874 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5105b324-d17f-4c90-b69f-d6ff1a05ac33 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:01.913281 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-5105b324-d17f-4c90-b69f-d6ff1a05ac33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:01.935117 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5105b324-d17f-4c90-b69f-d6ff1a05ac33 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:01.953975 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d16a49-8fb4-484e-87c9-b88c015934a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:01.954551 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d16a49-8fb4-484e-87c9-b88c015934a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:01.954834 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d16a49-8fb4-484e-87c9-b88c015934a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:01.955107 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d16a49-8fb4-484e-87c9-b88c015934a2 admin admin] PATH_INFO: `/v3/projects/983779b1af524a26b692d3ce7cb40524` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:01.956282 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d16a49-8fb4-484e-87c9-b88c015934a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=983779b1af524a26b692d3ce7cb40524)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:01.959193 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d16a49-8fb4-484e-87c9-b88c015934a2 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:01.961255 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:35:02.036065 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-e0d16a49-8fb4-484e-87c9-b88c015934a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '983779b1af524a26b692d3ce7cb40524', 'request_id': 'req-e0d16a49-8fb4-484e-87c9-b88c015934a2'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:02.042890 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-e0d16a49-8fb4-484e-87c9-b88c015934a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '983779b1af524a26b692d3ce7cb40524', 'request_id': 'req-e0d16a49-8fb4-484e-87c9-b88c015934a2'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:02.051901 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-e0d16a49-8fb4-484e-87c9-b88c015934a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '983779b1af524a26b692d3ce7cb40524', 'request_id': 'req-e0d16a49-8fb4-484e-87c9-b88c015934a2'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:02.067573 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-e0d16a49-8fb4-484e-87c9-b88c015934a2 admin admin] The token cache is being invalidate because project 983779b1af524a26b692d3ce7cb40524 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:35:02.067931 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-e0d16a49-8fb4-484e-87c9-b88c015934a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:02.068819 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-e0d16a49-8fb4-484e-87c9-b88c015934a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:02.070338 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1176/2340] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:35:01 2022] DELETE /identity/v3/projects/983779b1af524a26b692d3ce7cb40524 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:35:02.075153 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7997ef3-3b29-4b27-976c-3616b733ba67 service neutron] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:02.091794 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7997ef3-3b29-4b27-976c-3616b733ba67 service neutron] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:02.162221 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e4109a-9679-414e-bc78-986691af3263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:02.163009 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e4109a-9679-414e-bc78-986691af3263 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:02.163299 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e4109a-9679-414e-bc78-986691af3263 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:02.163609 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e4109a-9679-414e-bc78-986691af3263 admin admin] PATH_INFO: `/v3/users/1671d896bc4f4283858cd131fd87fd39` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:02.164769 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e4109a-9679-414e-bc78-986691af3263 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1671d896bc4f4283858cd131fd87fd39)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:02.166954 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e4109a-9679-414e-bc78-986691af3263 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:02.244755 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-86e4109a-9679-414e-bc78-986691af3263 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1671d896bc4f4283858cd131fd87fd39'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:02.252522 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-86e4109a-9679-414e-bc78-986691af3263 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1671d896bc4f4283858cd131fd87fd39'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:02.264153 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-86e4109a-9679-414e-bc78-986691af3263 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1671d896bc4f4283858cd131fd87fd39'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:02.264924 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-86e4109a-9679-414e-bc78-986691af3263 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1671d896bc4f4283858cd131fd87fd39'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:02.292435 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-86e4109a-9679-414e-bc78-986691af3263 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1671d896bc4f4283858cd131fd87fd39'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:02.299540 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1165/2341] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:35:02 2022] DELETE /identity/v3/users/1671d896bc4f4283858cd131fd87fd39 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:35:02.701801 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d16a49-8fb4-484e-87c9-b88c015934a2 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:02.703315 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-e0d16a49-8fb4-484e-87c9-b88c015934a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:02.724995 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d16a49-8fb4-484e-87c9-b88c015934a2 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:02.821746 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d84f8-0923-4b97-9e0c-888f581fe679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:02.822619 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d84f8-0923-4b97-9e0c-888f581fe679 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:02.823116 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d84f8-0923-4b97-9e0c-888f581fe679 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:02.823516 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d84f8-0923-4b97-9e0c-888f581fe679 admin admin] PATH_INFO: `/v3/projects/7b4b2c4173404855ae02ad9c1bcc54d2` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:02.828261 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57d84f8-0923-4b97-9e0c-888f581fe679 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b4b2c4173404855ae02ad9c1bcc54d2)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:02.830472 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57d84f8-0923-4b97-9e0c-888f581fe679 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:02.899140 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-a57d84f8-0923-4b97-9e0c-888f581fe679 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b4b2c4173404855ae02ad9c1bcc54d2', 'request_id': 'req-a57d84f8-0923-4b97-9e0c-888f581fe679'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:02.912869 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-a57d84f8-0923-4b97-9e0c-888f581fe679 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b4b2c4173404855ae02ad9c1bcc54d2', 'request_id': 'req-a57d84f8-0923-4b97-9e0c-888f581fe679'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:02.922317 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-a57d84f8-0923-4b97-9e0c-888f581fe679 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b4b2c4173404855ae02ad9c1bcc54d2', 'request_id': 'req-a57d84f8-0923-4b97-9e0c-888f581fe679'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:02.940349 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-a57d84f8-0923-4b97-9e0c-888f581fe679 admin admin] The token cache is being invalidate because project 7b4b2c4173404855ae02ad9c1bcc54d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:35:02.940645 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-a57d84f8-0923-4b97-9e0c-888f581fe679 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:02.941358 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-a57d84f8-0923-4b97-9e0c-888f581fe679 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:02.943030 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1177/2342] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:35:02 2022] DELETE /identity/v3/projects/7b4b2c4173404855ae02ad9c1bcc54d2 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:35:02.949451 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36855a6-3ddd-4b1f-8c9f-b7a58b617bc3 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:02.949736 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36855a6-3ddd-4b1f-8c9f-b7a58b617bc3 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:02.950012 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36855a6-3ddd-4b1f-8c9f-b7a58b617bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:02.976566 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-d36855a6-3ddd-4b1f-8c9f-b7a58b617bc3 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:35:02.977788 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-d36855a6-3ddd-4b1f-8c9f-b7a58b617bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:03.081361 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1166/2343] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:35:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:35:03.089924 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e847e611-e096-48e2-9ebf-83f51d072fc6 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:03.090348 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e847e611-e096-48e2-9ebf-83f51d072fc6 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:03.090731 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e847e611-e096-48e2-9ebf-83f51d072fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:03.120109 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-e847e611-e096-48e2-9ebf-83f51d072fc6 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:35:03.122372 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-e847e611-e096-48e2-9ebf-83f51d072fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:03.133890 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1178/2344] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:35:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 03:35:03.140846 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36855a6-3ddd-4b1f-8c9f-b7a58b617bc3 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:03.153983 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36855a6-3ddd-4b1f-8c9f-b7a58b617bc3 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:03.160054 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f5a0a-1291-4284-b2e6-a5d85a4e8708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:03.160776 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f5a0a-1291-4284-b2e6-a5d85a4e8708 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:03.161124 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f5a0a-1291-4284-b2e6-a5d85a4e8708 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:03.161466 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f5a0a-1291-4284-b2e6-a5d85a4e8708 admin admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:03.162187 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8f5a0a-1291-4284-b2e6-a5d85a4e8708 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:35:03.162563 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8f5a0a-1291-4284-b2e6-a5d85a4e8708 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:03.164315 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8f5a0a-1291-4284-b2e6-a5d85a4e8708 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:03.173887 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:35:03.184712 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1167/2345] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 03:35:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:35:03.185360 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e847e611-e096-48e2-9ebf-83f51d072fc6 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:03.198362 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e847e611-e096-48e2-9ebf-83f51d072fc6 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:03.203859 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681f3f7f-d7bc-42cb-9ee8-74defdc50f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:03.205102 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f3f7f-d7bc-42cb-9ee8-74defdc50f8c admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:03.205397 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f3f7f-d7bc-42cb-9ee8-74defdc50f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:03.205672 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f3f7f-d7bc-42cb-9ee8-74defdc50f8c admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:03.206382 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681f3f7f-d7bc-42cb-9ee8-74defdc50f8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:03.208487 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681f3f7f-d7bc-42cb-9ee8-74defdc50f8c admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:03.232403 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:35:03.267580 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1179/2346] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:35:03 2022] POST /identity/v3/projects => generated 375 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 03:35:03.268835 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f5a0a-1291-4284-b2e6-a5d85a4e8708 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:03.283081 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f5a0a-1291-4284-b2e6-a5d85a4e8708 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:03.375879 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4942a558-588b-4c7f-b3ff-4734ab46065c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:03.376502 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4942a558-588b-4c7f-b3ff-4734ab46065c admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:03.376789 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4942a558-588b-4c7f-b3ff-4734ab46065c admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:03.377088 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4942a558-588b-4c7f-b3ff-4734ab46065c admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:03.377736 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4942a558-588b-4c7f-b3ff-4734ab46065c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:03.380530 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4942a558-588b-4c7f-b3ff-4734ab46065c admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:03.438794 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1168/2347] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:35:03 2022] POST /identity/v3/users => generated 288 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:35:03.442889 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681f3f7f-d7bc-42cb-9ee8-74defdc50f8c admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:03.460284 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681f3f7f-d7bc-42cb-9ee8-74defdc50f8c admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:03.465906 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbfcf72-e397-4035-8cda-b809189569da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:03.466518 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbfcf72-e397-4035-8cda-b809189569da admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:03.466805 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbfcf72-e397-4035-8cda-b809189569da admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:03.467083 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbfcf72-e397-4035-8cda-b809189569da admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:03.470041 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbfcf72-e397-4035-8cda-b809189569da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:03.473317 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbfcf72-e397-4035-8cda-b809189569da admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:03.488788 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1180/2348] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:35:03 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:35:03.492795 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4942a558-588b-4c7f-b3ff-4734ab46065c admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:03.504194 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4942a558-588b-4c7f-b3ff-4734ab46065c admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:03.509944 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f3e359-415b-4065-a4da-4caf35be87c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:03.510824 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f3e359-415b-4065-a4da-4caf35be87c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:03.511133 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f3e359-415b-4065-a4da-4caf35be87c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:03.511393 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f3e359-415b-4065-a4da-4caf35be87c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:03.512179 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f3e359-415b-4065-a4da-4caf35be87c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:03.513995 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f3e359-415b-4065-a4da-4caf35be87c9 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:03.528173 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1169/2349] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:35:03 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:35:03.529022 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbfcf72-e397-4035-8cda-b809189569da admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:03.540382 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbfcf72-e397-4035-8cda-b809189569da admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:03.549601 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48477e1-093d-4344-bf7f-2999aa4edae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:03.549981 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48477e1-093d-4344-bf7f-2999aa4edae4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:03.550312 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48477e1-093d-4344-bf7f-2999aa4edae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:03.550584 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48477e1-093d-4344-bf7f-2999aa4edae4 admin admin] PATH_INFO: `/v3/projects/fa0762413c254651b9b1423c6f624749/users/c35a3298099c43d0819518a2d1dd318a/roles/04d0e4575a28440eb4349b4a6565e8b8` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:03.567914 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48477e1-093d-4344-bf7f-2999aa4edae4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa0762413c254651b9b1423c6f624749, user_id=c35a3298099c43d0819518a2d1dd318a, role_id=04d0e4575a28440eb4349b4a6565e8b8)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:03.571159 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48477e1-093d-4344-bf7f-2999aa4edae4 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:03.589382 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1181/2350] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:35:03 2022] PUT /identity/v3/projects/fa0762413c254651b9b1423c6f624749/users/c35a3298099c43d0819518a2d1dd318a/roles/04d0e4575a28440eb4349b4a6565e8b8 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 03:35:03.603043 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d6608-d08b-4fbe-989e-2e53c91aac2e None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:03.603984 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d6608-d08b-4fbe-989e-2e53c91aac2e None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:03.604388 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d6608-d08b-4fbe-989e-2e53c91aac2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:03.663224 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-2a0d6608-d08b-4fbe-989e-2e53c91aac2e None None] MFA Rules not processed for user `c35a3298099c43d0819518a2d1dd318a`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:35:03.664520 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-2a0d6608-d08b-4fbe-989e-2e53c91aac2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:03.771633 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1170/2351] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:35:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:35:03.782887 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48477e1-093d-4344-bf7f-2999aa4edae4 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:03.784973 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-e48477e1-093d-4344-bf7f-2999aa4edae4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:03.861729 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48477e1-093d-4344-bf7f-2999aa4edae4 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:03.865668 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8030e6bf-db5b-4bca-80d9-21d5fd2a4a4a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95be0e4e1c8641709e07b115047fb4e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:03.866310 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030e6bf-db5b-4bca-80d9-21d5fd2a4a4a service glance] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:03.866589 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030e6bf-db5b-4bca-80d9-21d5fd2a4a4a service glance] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:03.866859 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030e6bf-db5b-4bca-80d9-21d5fd2a4a4a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:03.879309 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8030e6bf-db5b-4bca-80d9-21d5fd2a4a4a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:03.880784 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8030e6bf-db5b-4bca-80d9-21d5fd2a4a4a service glance] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:03.891808 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1182/2352] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:35:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:35:11.576964 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d6608-d08b-4fbe-989e-2e53c91aac2e None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:11.580516 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-2a0d6608-d08b-4fbe-989e-2e53c91aac2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:11.645194 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d6608-d08b-4fbe-989e-2e53c91aac2e None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:11.648808 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e8d0c2-3be9-4fab-8939-936306279737 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:11.649421 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8d0c2-3be9-4fab-8939-936306279737 service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:11.649836 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8d0c2-3be9-4fab-8939-936306279737 service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:11.650268 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8d0c2-3be9-4fab-8939-936306279737 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:11.652528 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-f5e8d0c2-3be9-4fab-8939-936306279737 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:11.663267 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e8d0c2-3be9-4fab-8939-936306279737 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:11.664824 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e8d0c2-3be9-4fab-8939-936306279737 service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:11.674863 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1171/2353] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:35:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:35:13.473916 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8030e6bf-db5b-4bca-80d9-21d5fd2a4a4a service glance] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:13.484160 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8030e6bf-db5b-4bca-80d9-21d5fd2a4a4a service glance] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:13.487930 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae0a57e-7d61-49c5-acd7-65a1a512ec7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:13.488530 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0a57e-7d61-49c5-acd7-65a1a512ec7f service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:13.488815 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0a57e-7d61-49c5-acd7-65a1a512ec7f service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:13.489093 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0a57e-7d61-49c5-acd7-65a1a512ec7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:13.490904 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-3ae0a57e-7d61-49c5-acd7-65a1a512ec7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:13.555232 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae0a57e-7d61-49c5-acd7-65a1a512ec7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:13.557249 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae0a57e-7d61-49c5-acd7-65a1a512ec7f service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:13.567214 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1183/2354] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:35:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:35:15.507589 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0056e2c0-d355-40cd-a9f7-2ad77fd0dd01 None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:15.508039 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0056e2c0-d355-40cd-a9f7-2ad77fd0dd01 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:15.508155 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0056e2c0-d355-40cd-a9f7-2ad77fd0dd01 None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:15.509727 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1172/2355] 10.222.0.25 () {54 vars in 961 bytes} [Tue Oct 4 03:35:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:35:15.516271 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbafc2e-2c97-48be-84b7-1c29ef9ce51e None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:15.516776 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbafc2e-2c97-48be-84b7-1c29ef9ce51e None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:15.516861 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbafc2e-2c97-48be-84b7-1c29ef9ce51e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:15.538691 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-8fbafc2e-2c97-48be-84b7-1c29ef9ce51e None None] MFA Rules not processed for user `94513f6cd19f495e842deb3c13c3e4d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:35:15.539958 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-8fbafc2e-2c97-48be-84b7-1c29ef9ce51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:15.596395 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:35:15.617306 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1184/2356] 10.222.0.25 () {58 vars in 1058 bytes} [Tue Oct 4 03:35:15 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:35:15.625159 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0056e2c0-d355-40cd-a9f7-2ad77fd0dd01 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:15.646666 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0056e2c0-d355-40cd-a9f7-2ad77fd0dd01 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:15.651936 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f06fc0-727c-4325-95b2-e2484c3fd75d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94513f6cd19f495e842deb3c13c3e4d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:15.652705 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f06fc0-727c-4325-95b2-e2484c3fd75d service placement] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:15.653168 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f06fc0-727c-4325-95b2-e2484c3fd75d service placement] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:15.653446 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f06fc0-727c-4325-95b2-e2484c3fd75d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:15.655353 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-84f06fc0-727c-4325-95b2-e2484c3fd75d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:15.665648 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:35:15.668157 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f06fc0-727c-4325-95b2-e2484c3fd75d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:15.669743 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f06fc0-727c-4325-95b2-e2484c3fd75d service placement] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:15.680824 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1173/2357] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:35:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:35:17.085066 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbafc2e-2c97-48be-84b7-1c29ef9ce51e None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:17.086971 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-8fbafc2e-2c97-48be-84b7-1c29ef9ce51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:17.105179 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbafc2e-2c97-48be-84b7-1c29ef9ce51e None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:17.110762 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a32a9c-0645-4a21-9b6e-cb4990820d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:17.112191 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a32a9c-0645-4a21-9b6e-cb4990820d17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:17.112675 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a32a9c-0645-4a21-9b6e-cb4990820d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:17.113027 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a32a9c-0645-4a21-9b6e-cb4990820d17 admin admin] PATH_INFO: `/v3/users/02f76bc3ab354c4a8e9941e1403274ae` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:17.114390 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a32a9c-0645-4a21-9b6e-cb4990820d17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02f76bc3ab354c4a8e9941e1403274ae)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:17.116713 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a32a9c-0645-4a21-9b6e-cb4990820d17 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:17.171325 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-41a32a9c-0645-4a21-9b6e-cb4990820d17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02f76bc3ab354c4a8e9941e1403274ae'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:17.172288 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-41a32a9c-0645-4a21-9b6e-cb4990820d17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02f76bc3ab354c4a8e9941e1403274ae'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:17.182151 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-41a32a9c-0645-4a21-9b6e-cb4990820d17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02f76bc3ab354c4a8e9941e1403274ae'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:17.182900 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-41a32a9c-0645-4a21-9b6e-cb4990820d17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02f76bc3ab354c4a8e9941e1403274ae'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:17.195882 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-41a32a9c-0645-4a21-9b6e-cb4990820d17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02f76bc3ab354c4a8e9941e1403274ae'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:17.209352 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1185/2358] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:35:17 2022] DELETE /identity/v3/users/02f76bc3ab354c4a8e9941e1403274ae => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:35:17.418644 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f06fc0-727c-4325-95b2-e2484c3fd75d service placement] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:17.429363 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f06fc0-727c-4325-95b2-e2484c3fd75d service placement] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:17.478969 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe92cfa-49af-4aff-a0e7-825ad2299535 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:17.479346 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe92cfa-49af-4aff-a0e7-825ad2299535 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:17.479823 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe92cfa-49af-4aff-a0e7-825ad2299535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:17.506743 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a90e36-a8d9-4277-afa7-5d0ec6b78152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:17.507397 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-cbe92cfa-49af-4aff-a0e7-825ad2299535 None None] MFA Rules not processed for user `bef61ef12079495ba72b7fcd2717aca2`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:35:17.507860 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a90e36-a8d9-4277-afa7-5d0ec6b78152 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:17.508219 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a90e36-a8d9-4277-afa7-5d0ec6b78152 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:17.508555 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a90e36-a8d9-4277-afa7-5d0ec6b78152 admin admin] PATH_INFO: `/v3/projects/2011dec80f764558a3a0fe210cdd0755` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:17.508661 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-cbe92cfa-49af-4aff-a0e7-825ad2299535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:17.509935 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a90e36-a8d9-4277-afa7-5d0ec6b78152 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2011dec80f764558a3a0fe210cdd0755)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:17.511954 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a90e36-a8d9-4277-afa7-5d0ec6b78152 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:17.571118 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-c2a90e36-a8d9-4277-afa7-5d0ec6b78152 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2011dec80f764558a3a0fe210cdd0755', 'request_id': 'req-c2a90e36-a8d9-4277-afa7-5d0ec6b78152'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:17.574591 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1186/2359] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Oct 4 03:35:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:35:17.577538 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-c2a90e36-a8d9-4277-afa7-5d0ec6b78152 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2011dec80f764558a3a0fe210cdd0755', 'request_id': 'req-c2a90e36-a8d9-4277-afa7-5d0ec6b78152'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:17.584072 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-c2a90e36-a8d9-4277-afa7-5d0ec6b78152 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2011dec80f764558a3a0fe210cdd0755', 'request_id': 'req-c2a90e36-a8d9-4277-afa7-5d0ec6b78152'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:17.589616 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe92cfa-49af-4aff-a0e7-825ad2299535 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:17.591448 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-cbe92cfa-49af-4aff-a0e7-825ad2299535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:17.600111 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-c2a90e36-a8d9-4277-afa7-5d0ec6b78152 admin admin] The token cache is being invalidate because project 2011dec80f764558a3a0fe210cdd0755 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:35:17.600788 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-c2a90e36-a8d9-4277-afa7-5d0ec6b78152 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:17.604477 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-c2a90e36-a8d9-4277-afa7-5d0ec6b78152 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:17.606371 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1174/2360] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:35:17 2022] DELETE /identity/v3/projects/2011dec80f764558a3a0fe210cdd0755 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:35:17.614419 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1152e2aa-9bc4-45da-bf2e-ec350dc6c561 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:17.614870 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1152e2aa-9bc4-45da-bf2e-ec350dc6c561 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:17.615297 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1152e2aa-9bc4-45da-bf2e-ec350dc6c561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:17.643197 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-1152e2aa-9bc4-45da-bf2e-ec350dc6c561 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:35:17.644466 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-1152e2aa-9bc4-45da-bf2e-ec350dc6c561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:17.682275 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe92cfa-49af-4aff-a0e7-825ad2299535 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:17.687051 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:35:17.728942 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1175/2361] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:35:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 03:35:17.738491 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a738d4b-0165-4fc8-a60c-2f363ead4e28 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:17.738929 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a738d4b-0165-4fc8-a60c-2f363ead4e28 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:17.739214 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a738d4b-0165-4fc8-a60c-2f363ead4e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:17.774495 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-0a738d4b-0165-4fc8-a60c-2f363ead4e28 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:35:17.778251 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-0a738d4b-0165-4fc8-a60c-2f363ead4e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:17.783017 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c1b3bf-7161-4f75-b7bb-1cf88fb7eaf4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8da6bacc8f432e8f48bb99c7aede11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:17.783789 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1b3bf-7161-4f75-b7bb-1cf88fb7eaf4 service swift] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:17.784210 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1b3bf-7161-4f75-b7bb-1cf88fb7eaf4 service swift] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:17.784982 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1b3bf-7161-4f75-b7bb-1cf88fb7eaf4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:17.790587 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1176/2362] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:35:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:35:17.797068 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a738d4b-0165-4fc8-a60c-2f363ead4e28 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:17.800263 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-d8c1b3bf-7161-4f75-b7bb-1cf88fb7eaf4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:17.806966 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a738d4b-0165-4fc8-a60c-2f363ead4e28 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:17.816353 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e6c85-f2e5-42e6-815a-11a016f92660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:17.817092 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e6c85-f2e5-42e6-815a-11a016f92660 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:17.817372 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e6c85-f2e5-42e6-815a-11a016f92660 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:17.817648 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e6c85-f2e5-42e6-815a-11a016f92660 admin admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:17.818361 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7e6c85-f2e5-42e6-815a-11a016f92660 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:35:17.818932 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7e6c85-f2e5-42e6-815a-11a016f92660 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:17.821763 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7e6c85-f2e5-42e6-815a-11a016f92660 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:17.841441 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1177/2363] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 03:35:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:35:17.845641 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e6c85-f2e5-42e6-815a-11a016f92660 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:17.861901 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e6c85-f2e5-42e6-815a-11a016f92660 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:17.867338 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5673033-2a7a-44d5-97fc-28d26366d354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:17.868007 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5673033-2a7a-44d5-97fc-28d26366d354 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:17.868461 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5673033-2a7a-44d5-97fc-28d26366d354 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:17.868739 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5673033-2a7a-44d5-97fc-28d26366d354 admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:17.870897 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5673033-2a7a-44d5-97fc-28d26366d354 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:17.872904 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5673033-2a7a-44d5-97fc-28d26366d354 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:17.878436 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:35:17.903999 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c1b3bf-7161-4f75-b7bb-1cf88fb7eaf4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:17.905764 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c1b3bf-7161-4f75-b7bb-1cf88fb7eaf4 service swift] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:17.916259 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1187/2364] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Oct 4 03:35:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 04 03:35:17.920993 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1178/2365] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:35:17 2022] POST /identity/v3/projects => generated 391 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 03:35:17.925034 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c1b3bf-7161-4f75-b7bb-1cf88fb7eaf4 service swift] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:17.938337 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c1b3bf-7161-4f75-b7bb-1cf88fb7eaf4 service swift] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:18.012780 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c352e6-b915-47a3-9afc-bc8ce3db929e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:18.013891 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c352e6-b915-47a3-9afc-bc8ce3db929e admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:18.014547 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c352e6-b915-47a3-9afc-bc8ce3db929e admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:18.014989 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c352e6-b915-47a3-9afc-bc8ce3db929e admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:18.015844 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c352e6-b915-47a3-9afc-bc8ce3db929e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:18.018314 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c352e6-b915-47a3-9afc-bc8ce3db929e admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:18.057652 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1188/2366] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:35:17 2022] POST /identity/v3/users => generated 296 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 03:35:18.062694 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5673033-2a7a-44d5-97fc-28d26366d354 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:18.075562 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5673033-2a7a-44d5-97fc-28d26366d354 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:18.080803 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0fa7bc-5c2c-4483-a02c-79887fac95e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:18.082201 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0fa7bc-5c2c-4483-a02c-79887fac95e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:18.082691 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0fa7bc-5c2c-4483-a02c-79887fac95e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:18.083163 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0fa7bc-5c2c-4483-a02c-79887fac95e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:18.084159 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0fa7bc-5c2c-4483-a02c-79887fac95e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:18.086119 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0fa7bc-5c2c-4483-a02c-79887fac95e6 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:18.104855 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c352e6-b915-47a3-9afc-bc8ce3db929e admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:18.112141 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1179/2367] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:35:18 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:35:18.120282 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c352e6-b915-47a3-9afc-bc8ce3db929e admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:18.126838 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e37f4b2-464c-4e2a-9ef2-0b54b6abbaab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:18.127766 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37f4b2-464c-4e2a-9ef2-0b54b6abbaab admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:18.128210 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37f4b2-464c-4e2a-9ef2-0b54b6abbaab admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:18.128652 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37f4b2-464c-4e2a-9ef2-0b54b6abbaab admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:18.129704 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e37f4b2-464c-4e2a-9ef2-0b54b6abbaab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:18.131646 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e37f4b2-464c-4e2a-9ef2-0b54b6abbaab admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:18.152608 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1189/2368] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:35:18 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:35:18.152958 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0fa7bc-5c2c-4483-a02c-79887fac95e6 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:18.163751 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0fa7bc-5c2c-4483-a02c-79887fac95e6 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:18.169177 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de1ad7b-f759-47a8-8cb8-04b1e08d5b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:18.169847 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de1ad7b-f759-47a8-8cb8-04b1e08d5b3d admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:18.170144 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de1ad7b-f759-47a8-8cb8-04b1e08d5b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:18.170414 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de1ad7b-f759-47a8-8cb8-04b1e08d5b3d admin admin] PATH_INFO: `/v3/projects/8894b247d9a746848720219599a4d23c/users/c398e72dc1634b1da99095b1f24d3295/roles/04d0e4575a28440eb4349b4a6565e8b8` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:18.188596 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de1ad7b-f759-47a8-8cb8-04b1e08d5b3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8894b247d9a746848720219599a4d23c, user_id=c398e72dc1634b1da99095b1f24d3295, role_id=04d0e4575a28440eb4349b4a6565e8b8)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:18.191320 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de1ad7b-f759-47a8-8cb8-04b1e08d5b3d admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:18.217921 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1180/2369] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:35:18 2022] PUT /identity/v3/projects/8894b247d9a746848720219599a4d23c/users/c398e72dc1634b1da99095b1f24d3295/roles/04d0e4575a28440eb4349b4a6565e8b8 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 03:35:18.234183 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d85d47-55d6-48f9-94c6-e9e991d20572 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:18.234478 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d85d47-55d6-48f9-94c6-e9e991d20572 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:18.234758 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d85d47-55d6-48f9-94c6-e9e991d20572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:18.273912 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-d0d85d47-55d6-48f9-94c6-e9e991d20572 None None] MFA Rules not processed for user `c398e72dc1634b1da99095b1f24d3295`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:35:18.275968 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-d0d85d47-55d6-48f9-94c6-e9e991d20572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:18.297564 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:35:18.359913 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1190/2370] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:35:18 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:35:18.364826 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de1ad7b-f759-47a8-8cb8-04b1e08d5b3d admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:18.443914 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de1ad7b-f759-47a8-8cb8-04b1e08d5b3d admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:18.450155 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62129814-dc61-4839-9cc5-bf03f9326982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:18.450983 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62129814-dc61-4839-9cc5-bf03f9326982 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:18.451427 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62129814-dc61-4839-9cc5-bf03f9326982 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:18.451880 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62129814-dc61-4839-9cc5-bf03f9326982 admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:18.452780 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62129814-dc61-4839-9cc5-bf03f9326982 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:18.454867 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62129814-dc61-4839-9cc5-bf03f9326982 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:18.488841 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1181/2371] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:35:18 2022] POST /identity/v3/projects => generated 391 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 03:35:18.490315 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d85d47-55d6-48f9-94c6-e9e991d20572 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:18.503811 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d85d47-55d6-48f9-94c6-e9e991d20572 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:18.591119 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5abf7bf-cb08-4e09-9e7b-f1ba5cd3cdf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:18.591777 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5abf7bf-cb08-4e09-9e7b-f1ba5cd3cdf3 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:18.592244 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5abf7bf-cb08-4e09-9e7b-f1ba5cd3cdf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:18.592532 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5abf7bf-cb08-4e09-9e7b-f1ba5cd3cdf3 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:18.593859 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5abf7bf-cb08-4e09-9e7b-f1ba5cd3cdf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:18.596600 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5abf7bf-cb08-4e09-9e7b-f1ba5cd3cdf3 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:18.628234 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1191/2372] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:35:18 2022] POST /identity/v3/users => generated 302 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:35:18.635539 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62129814-dc61-4839-9cc5-bf03f9326982 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:18.644780 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62129814-dc61-4839-9cc5-bf03f9326982 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:18.655385 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8190feba-5dfb-4f27-8443-6093166a56cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:18.656526 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8190feba-5dfb-4f27-8443-6093166a56cf admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:18.657019 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8190feba-5dfb-4f27-8443-6093166a56cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:18.657478 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8190feba-5dfb-4f27-8443-6093166a56cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:18.658405 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8190feba-5dfb-4f27-8443-6093166a56cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:18.660312 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8190feba-5dfb-4f27-8443-6093166a56cf admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:18.675127 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1182/2373] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:35:18 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:35:18.679455 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5abf7bf-cb08-4e09-9e7b-f1ba5cd3cdf3 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:18.691165 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5abf7bf-cb08-4e09-9e7b-f1ba5cd3cdf3 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:18.696767 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8fb58b-50ba-4a91-9014-87de0d98c994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:18.698158 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8fb58b-50ba-4a91-9014-87de0d98c994 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:18.698624 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8fb58b-50ba-4a91-9014-87de0d98c994 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:18.698983 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8fb58b-50ba-4a91-9014-87de0d98c994 admin admin] PATH_INFO: `/v3/projects/ca4ace1887534c3fa56ad615112d1492/users/039848e9963e4df6b858d147866bf559/roles/fe9379cda35c4ff78576fe48b60bea3c` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:18.708095 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8190feba-5dfb-4f27-8443-6093166a56cf admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:18.710745 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-8190feba-5dfb-4f27-8443-6093166a56cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:18.726636 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8190feba-5dfb-4f27-8443-6093166a56cf admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:18.732314 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8fb58b-50ba-4a91-9014-87de0d98c994 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca4ace1887534c3fa56ad615112d1492, user_id=039848e9963e4df6b858d147866bf559, role_id=fe9379cda35c4ff78576fe48b60bea3c)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:18.735277 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f955f-7253-4254-925d-aab965135bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:18.735421 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8fb58b-50ba-4a91-9014-87de0d98c994 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:18.736066 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f955f-7253-4254-925d-aab965135bff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:18.736399 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f955f-7253-4254-925d-aab965135bff admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:18.736746 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f955f-7253-4254-925d-aab965135bff admin admin] PATH_INFO: `/v3/users/c35a3298099c43d0819518a2d1dd318a` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:18.737988 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94f955f-7253-4254-925d-aab965135bff admin admin] RBAC: Authorizing `identity:delete_user(user_id=c35a3298099c43d0819518a2d1dd318a)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:18.740069 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94f955f-7253-4254-925d-aab965135bff admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:18.755631 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1192/2374] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:35:18 2022] PUT /identity/v3/projects/ca4ace1887534c3fa56ad615112d1492/users/039848e9963e4df6b858d147866bf559/roles/fe9379cda35c4ff78576fe48b60bea3c => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:35:18.760246 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8fb58b-50ba-4a91-9014-87de0d98c994 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:18.819779 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-b94f955f-7253-4254-925d-aab965135bff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c35a3298099c43d0819518a2d1dd318a'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:18.828324 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-b94f955f-7253-4254-925d-aab965135bff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c35a3298099c43d0819518a2d1dd318a'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:18.841459 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-b94f955f-7253-4254-925d-aab965135bff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c35a3298099c43d0819518a2d1dd318a'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:18.842302 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-b94f955f-7253-4254-925d-aab965135bff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c35a3298099c43d0819518a2d1dd318a'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:18.845348 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8fb58b-50ba-4a91-9014-87de0d98c994 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:18.850142 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0f3af6-cb4e-4050-9073-695fd61c199d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:18.850747 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f3af6-cb4e-4050-9073-695fd61c199d admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:18.851143 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f3af6-cb4e-4050-9073-695fd61c199d admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:18.851400 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f3af6-cb4e-4050-9073-695fd61c199d admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:18.852318 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0f3af6-cb4e-4050-9073-695fd61c199d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:18.854429 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0f3af6-cb4e-4050-9073-695fd61c199d admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:18.864732 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:35:18.866302 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1193/2375] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:35:18 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:35:18.867863 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-b94f955f-7253-4254-925d-aab965135bff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c35a3298099c43d0819518a2d1dd318a'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:18.871332 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0f3af6-cb4e-4050-9073-695fd61c199d admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:18.873735 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-4b0f3af6-cb4e-4050-9073-695fd61c199d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:18.880501 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1183/2376] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:35:18 2022] DELETE /identity/v3/users/c35a3298099c43d0819518a2d1dd318a => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:35:18.881934 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca62d9a-eb1e-4f3f-97b6-ef914e9dd8b9 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:18.882316 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca62d9a-eb1e-4f3f-97b6-ef914e9dd8b9 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:18.882712 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca62d9a-eb1e-4f3f-97b6-ef914e9dd8b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:18.891318 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0f3af6-cb4e-4050-9073-695fd61c199d admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:18.906435 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-eca62d9a-eb1e-4f3f-97b6-ef914e9dd8b9 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:35:18.907821 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-eca62d9a-eb1e-4f3f-97b6-ef914e9dd8b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:18.910670 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:35:18.976470 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589fd97d-d091-42db-9ff3-bb9aa547526c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:18.977434 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589fd97d-d091-42db-9ff3-bb9aa547526c admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:18.979209 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589fd97d-d091-42db-9ff3-bb9aa547526c admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:18.979972 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589fd97d-d091-42db-9ff3-bb9aa547526c admin admin] PATH_INFO: `/v3/projects/ca4ace1887534c3fa56ad615112d1492/users/039848e9963e4df6b858d147866bf559/roles/fe9379cda35c4ff78576fe48b60bea3c` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:18.983166 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589fd97d-d091-42db-9ff3-bb9aa547526c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca4ace1887534c3fa56ad615112d1492, user_id=039848e9963e4df6b858d147866bf559, role_id=fe9379cda35c4ff78576fe48b60bea3c)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:18.987287 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589fd97d-d091-42db-9ff3-bb9aa547526c admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:18.995267 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1184/2377] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:35:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 03:35:19.014764 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca62d9a-eb1e-4f3f-97b6-ef914e9dd8b9 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:19.016839 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1194/2378] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:35:18 2022] PUT /identity/v3/projects/ca4ace1887534c3fa56ad615112d1492/users/039848e9963e4df6b858d147866bf559/roles/fe9379cda35c4ff78576fe48b60bea3c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 03:35:19.027294 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-eca62d9a-eb1e-4f3f-97b6-ef914e9dd8b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:19.027972 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa5164-bc56-42a4-a892-5ce70623312d None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:19.028330 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa5164-bc56-42a4-a892-5ce70623312d None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:19.028672 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa5164-bc56-42a4-a892-5ce70623312d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:19.079913 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-eafa5164-bc56-42a4-a892-5ce70623312d None None] MFA Rules not processed for user `039848e9963e4df6b858d147866bf559`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:35:19.081606 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-eafa5164-bc56-42a4-a892-5ce70623312d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:19.156073 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca62d9a-eb1e-4f3f-97b6-ef914e9dd8b9 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:19.199876 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1195/2379] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:35:19 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 03:35:19.201262 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafa5164-bc56-42a4-a892-5ce70623312d None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:19.204078 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-eafa5164-bc56-42a4-a892-5ce70623312d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:19.233264 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d7c2d6-da45-475e-86f6-1043715d12ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:19.234122 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d7c2d6-da45-475e-86f6-1043715d12ff service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:19.234508 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d7c2d6-da45-475e-86f6-1043715d12ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:19.234864 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d7c2d6-da45-475e-86f6-1043715d12ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:19.335668 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafa5164-bc56-42a4-a892-5ce70623312d None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:19.336946 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d7c2d6-da45-475e-86f6-1043715d12ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:19.339032 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d7c2d6-da45-475e-86f6-1043715d12ff service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:19.349207 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1ab08f-3d83-4f19-b8f2-0e9fa90e627a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f537aabf3d1040ff840b02616f839975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:19.350041 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ab08f-3d83-4f19-b8f2-0e9fa90e627a service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:19.350422 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ab08f-3d83-4f19-b8f2-0e9fa90e627a service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:19.350846 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1185/2380] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:35:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:35:19.351816 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ab08f-3d83-4f19-b8f2-0e9fa90e627a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:19.362454 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1ab08f-3d83-4f19-b8f2-0e9fa90e627a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:19.363936 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1ab08f-3d83-4f19-b8f2-0e9fa90e627a service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:19.394543 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1196/2381] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:35:19 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:35:19.454212 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d7c2d6-da45-475e-86f6-1043715d12ff service neutron] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:19.457160 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-a2d7c2d6-da45-475e-86f6-1043715d12ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:19.468665 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:35:19.475149 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d7c2d6-da45-475e-86f6-1043715d12ff service neutron] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:19.480511 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfa2026-d8af-49d7-a94b-c36ce0992b4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f537aabf3d1040ff840b02616f839975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:19.481270 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfa2026-d8af-49d7-a94b-c36ce0992b4a service cinder] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:19.481783 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfa2026-d8af-49d7-a94b-c36ce0992b4a service cinder] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:19.482591 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfa2026-d8af-49d7-a94b-c36ce0992b4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:19.484849 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-9cfa2026-d8af-49d7-a94b-c36ce0992b4a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:19.576491 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfa2026-d8af-49d7-a94b-c36ce0992b4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:19.577954 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfa2026-d8af-49d7-a94b-c36ce0992b4a service cinder] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:19.591973 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1186/2382] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:35:19 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:35:19.754389 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1ab08f-3d83-4f19-b8f2-0e9fa90e627a service cinder] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:19.755911 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-7d1ab08f-3d83-4f19-b8f2-0e9fa90e627a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:19.771386 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1ab08f-3d83-4f19-b8f2-0e9fa90e627a service cinder] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:19.780271 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fab628f-eee6-4fce-96dd-610e0ca6054d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:19.781289 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab628f-eee6-4fce-96dd-610e0ca6054d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:19.782250 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab628f-eee6-4fce-96dd-610e0ca6054d admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:19.782843 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab628f-eee6-4fce-96dd-610e0ca6054d admin admin] PATH_INFO: `/v3/projects/fa0762413c254651b9b1423c6f624749` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:19.784895 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fab628f-eee6-4fce-96dd-610e0ca6054d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa0762413c254651b9b1423c6f624749)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:19.796405 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fab628f-eee6-4fce-96dd-610e0ca6054d admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:19.858890 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:35:19.871034 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-8fab628f-eee6-4fce-96dd-610e0ca6054d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa0762413c254651b9b1423c6f624749', 'request_id': 'req-8fab628f-eee6-4fce-96dd-610e0ca6054d'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:19.878852 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-8fab628f-eee6-4fce-96dd-610e0ca6054d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa0762413c254651b9b1423c6f624749', 'request_id': 'req-8fab628f-eee6-4fce-96dd-610e0ca6054d'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:19.886676 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-8fab628f-eee6-4fce-96dd-610e0ca6054d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa0762413c254651b9b1423c6f624749', 'request_id': 'req-8fab628f-eee6-4fce-96dd-610e0ca6054d'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:19.906547 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-8fab628f-eee6-4fce-96dd-610e0ca6054d admin admin] The token cache is being invalidate because project fa0762413c254651b9b1423c6f624749 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:35:19.907086 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-8fab628f-eee6-4fce-96dd-610e0ca6054d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:19.908341 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-8fab628f-eee6-4fce-96dd-610e0ca6054d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:19.913527 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1197/2383] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:35:19 2022] DELETE /identity/v3/projects/fa0762413c254651b9b1423c6f624749 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:35:19.915686 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338f60f-5b75-4dce-9d69-e2422f41381b None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:19.916307 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338f60f-5b75-4dce-9d69-e2422f41381b None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:19.916786 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338f60f-5b75-4dce-9d69-e2422f41381b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:19.945415 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-0338f60f-5b75-4dce-9d69-e2422f41381b None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:35:19.946563 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-0338f60f-5b75-4dce-9d69-e2422f41381b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:20.070871 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1187/2384] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:35:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:35:20.074108 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e38522-7a1e-4d9a-8841-e90c91dce430 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:20.074402 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e38522-7a1e-4d9a-8841-e90c91dce430 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:20.074680 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e38522-7a1e-4d9a-8841-e90c91dce430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:20.097767 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-a3e38522-7a1e-4d9a-8841-e90c91dce430 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:35:20.099169 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-a3e38522-7a1e-4d9a-8841-e90c91dce430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:20.128557 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1198/2385] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:35:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:35:20.128849 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0338f60f-5b75-4dce-9d69-e2422f41381b None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:20.131888 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0338f60f-5b75-4dce-9d69-e2422f41381b None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:20.137629 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4721800a-3490-4f15-b39b-05331b05f6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:20.138259 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721800a-3490-4f15-b39b-05331b05f6ed admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:20.138587 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721800a-3490-4f15-b39b-05331b05f6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:20.138865 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721800a-3490-4f15-b39b-05331b05f6ed admin admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:20.139720 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4721800a-3490-4f15-b39b-05331b05f6ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:35:20.140024 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4721800a-3490-4f15-b39b-05331b05f6ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:20.141623 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4721800a-3490-4f15-b39b-05331b05f6ed admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:20.162884 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1188/2386] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 03:35:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:35:20.167982 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e38522-7a1e-4d9a-8841-e90c91dce430 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:20.177654 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e38522-7a1e-4d9a-8841-e90c91dce430 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:20.183460 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f560557b-7068-405c-9191-b7f51f9adee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:20.184216 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560557b-7068-405c-9191-b7f51f9adee8 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:20.184562 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560557b-7068-405c-9191-b7f51f9adee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:20.184924 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560557b-7068-405c-9191-b7f51f9adee8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:20.185636 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f560557b-7068-405c-9191-b7f51f9adee8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:20.187721 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f560557b-7068-405c-9191-b7f51f9adee8 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:20.234026 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1199/2387] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:35:20 2022] POST /identity/v3/projects => generated 399 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:35:20.238151 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4721800a-3490-4f15-b39b-05331b05f6ed admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:20.250338 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4721800a-3490-4f15-b39b-05331b05f6ed admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:20.343551 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e33337a-ab0e-45e1-925e-a9dec51d0b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:20.344175 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33337a-ab0e-45e1-925e-a9dec51d0b0e admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:20.344461 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33337a-ab0e-45e1-925e-a9dec51d0b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:20.344885 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33337a-ab0e-45e1-925e-a9dec51d0b0e admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:20.345577 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e33337a-ab0e-45e1-925e-a9dec51d0b0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:20.347714 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e33337a-ab0e-45e1-925e-a9dec51d0b0e admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:20.376020 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1189/2388] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:35:20 2022] POST /identity/v3/users => generated 300 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 03:35:20.380032 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f560557b-7068-405c-9191-b7f51f9adee8 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:20.405777 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f560557b-7068-405c-9191-b7f51f9adee8 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:20.410577 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51640a3-2a1f-497f-a39d-afc222cad45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:20.411644 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51640a3-2a1f-497f-a39d-afc222cad45e admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:20.411644 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51640a3-2a1f-497f-a39d-afc222cad45e admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:20.411818 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51640a3-2a1f-497f-a39d-afc222cad45e admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:20.412463 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51640a3-2a1f-497f-a39d-afc222cad45e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:20.414056 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51640a3-2a1f-497f-a39d-afc222cad45e admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:20.440984 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1200/2389] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:35:20 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:35:20.444999 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e33337a-ab0e-45e1-925e-a9dec51d0b0e admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:20.457493 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e33337a-ab0e-45e1-925e-a9dec51d0b0e admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:20.464677 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a22ec6a-d91c-44dc-a40b-d1aade4889ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:20.465686 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a22ec6a-d91c-44dc-a40b-d1aade4889ca admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:20.466089 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a22ec6a-d91c-44dc-a40b-d1aade4889ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:20.466467 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a22ec6a-d91c-44dc-a40b-d1aade4889ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:20.467352 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a22ec6a-d91c-44dc-a40b-d1aade4889ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:20.469310 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a22ec6a-d91c-44dc-a40b-d1aade4889ca admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:20.485383 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1190/2390] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:35:20 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 03:35:20.488054 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51640a3-2a1f-497f-a39d-afc222cad45e admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:20.516306 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51640a3-2a1f-497f-a39d-afc222cad45e admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:20.528599 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356f2ed9-8151-48a7-8d69-a515bd51d9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:20.529306 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f2ed9-8151-48a7-8d69-a515bd51d9d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:20.529594 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f2ed9-8151-48a7-8d69-a515bd51d9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:20.529877 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f2ed9-8151-48a7-8d69-a515bd51d9d0 admin admin] PATH_INFO: `/v3/projects/9318cbda446441158cdbf517d0e36ab5/users/17ddb5a4f44149238952784770b568b8/roles/04d0e4575a28440eb4349b4a6565e8b8` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:20.546557 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356f2ed9-8151-48a7-8d69-a515bd51d9d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9318cbda446441158cdbf517d0e36ab5, user_id=17ddb5a4f44149238952784770b568b8, role_id=04d0e4575a28440eb4349b4a6565e8b8)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:20.549217 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356f2ed9-8151-48a7-8d69-a515bd51d9d0 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:20.571362 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1201/2391] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:35:20 2022] PUT /identity/v3/projects/9318cbda446441158cdbf517d0e36ab5/users/17ddb5a4f44149238952784770b568b8/roles/04d0e4575a28440eb4349b4a6565e8b8 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 03:35:20.582012 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e90afdf-3b86-401c-bae9-a2402165aa21 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:20.582304 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e90afdf-3b86-401c-bae9-a2402165aa21 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:20.582586 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e90afdf-3b86-401c-bae9-a2402165aa21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:20.597564 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:35:20.614644 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-3e90afdf-3b86-401c-bae9-a2402165aa21 None None] MFA Rules not processed for user `17ddb5a4f44149238952784770b568b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:35:20.615927 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-3e90afdf-3b86-401c-bae9-a2402165aa21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:20.695215 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1191/2392] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:35:20 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:35:20.708239 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356f2ed9-8151-48a7-8d69-a515bd51d9d0 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:20.710055 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-356f2ed9-8151-48a7-8d69-a515bd51d9d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:20.775000 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356f2ed9-8151-48a7-8d69-a515bd51d9d0 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:20.779334 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67b57b3-909a-4d92-8e1e-aae274537060 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f537aabf3d1040ff840b02616f839975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:20.779981 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67b57b3-909a-4d92-8e1e-aae274537060 service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:20.780261 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67b57b3-909a-4d92-8e1e-aae274537060 service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:20.780532 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67b57b3-909a-4d92-8e1e-aae274537060 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:20.789491 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67b57b3-909a-4d92-8e1e-aae274537060 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:20.791457 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67b57b3-909a-4d92-8e1e-aae274537060 service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:20.801030 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1202/2393] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:35:20 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:35:23.401185 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e90afdf-3b86-401c-bae9-a2402165aa21 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:23.402809 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-3e90afdf-3b86-401c-bae9-a2402165aa21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:23.495455 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e90afdf-3b86-401c-bae9-a2402165aa21 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:23.503110 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c542a-a87a-49f0-bc89-fc38151ef239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:23.503828 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c542a-a87a-49f0-bc89-fc38151ef239 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:23.504294 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c542a-a87a-49f0-bc89-fc38151ef239 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:23.504578 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c542a-a87a-49f0-bc89-fc38151ef239 admin admin] PATH_INFO: `/v3/users/c398e72dc1634b1da99095b1f24d3295` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:23.505783 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551c542a-a87a-49f0-bc89-fc38151ef239 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c398e72dc1634b1da99095b1f24d3295)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:23.507883 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551c542a-a87a-49f0-bc89-fc38151ef239 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:23.587946 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-551c542a-a87a-49f0-bc89-fc38151ef239 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c398e72dc1634b1da99095b1f24d3295'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:23.600350 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-551c542a-a87a-49f0-bc89-fc38151ef239 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c398e72dc1634b1da99095b1f24d3295'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:23.622680 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-551c542a-a87a-49f0-bc89-fc38151ef239 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c398e72dc1634b1da99095b1f24d3295'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:23.623620 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-551c542a-a87a-49f0-bc89-fc38151ef239 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c398e72dc1634b1da99095b1f24d3295'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:23.645977 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-551c542a-a87a-49f0-bc89-fc38151ef239 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c398e72dc1634b1da99095b1f24d3295'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:23.665314 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1192/2394] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:35:23 2022] DELETE /identity/v3/users/c398e72dc1634b1da99095b1f24d3295 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:35:23.670719 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f5926-a663-4642-abdf-0012088a0346 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:23.672029 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f5926-a663-4642-abdf-0012088a0346 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:23.672695 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f5926-a663-4642-abdf-0012088a0346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:23.718128 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-6e8f5926-a663-4642-abdf-0012088a0346 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:35:23.719677 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-6e8f5926-a663-4642-abdf-0012088a0346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:23.883036 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1203/2395] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:35:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:35:23.890765 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c542a-a87a-49f0-bc89-fc38151ef239 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:23.892333 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-551c542a-a87a-49f0-bc89-fc38151ef239 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:23.914898 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:35:24.009544 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c542a-a87a-49f0-bc89-fc38151ef239 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:24.015091 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe27d11-0eed-4e83-905a-bcbbf3edd591 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:24.015933 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe27d11-0eed-4e83-905a-bcbbf3edd591 service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:24.016548 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe27d11-0eed-4e83-905a-bcbbf3edd591 service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:24.016859 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe27d11-0eed-4e83-905a-bcbbf3edd591 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:24.039247 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe27d11-0eed-4e83-905a-bcbbf3edd591 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:24.041376 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe27d11-0eed-4e83-905a-bcbbf3edd591 service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:24.054355 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1193/2396] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:35:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:35:24.540561 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f5926-a663-4642-abdf-0012088a0346 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:24.542128 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-6e8f5926-a663-4642-abdf-0012088a0346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:24.559437 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:35:24.573629 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f5926-a663-4642-abdf-0012088a0346 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:24.579818 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b7f866-7661-4713-b3bb-c8956585df8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:24.580877 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7f866-7661-4713-b3bb-c8956585df8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:24.581233 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7f866-7661-4713-b3bb-c8956585df8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:24.581718 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7f866-7661-4713-b3bb-c8956585df8a admin admin] PATH_INFO: `/v3/projects/8894b247d9a746848720219599a4d23c` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:24.583869 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b7f866-7661-4713-b3bb-c8956585df8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8894b247d9a746848720219599a4d23c)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:24.585814 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b7f866-7661-4713-b3bb-c8956585df8a admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:24.644403 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-32b7f866-7661-4713-b3bb-c8956585df8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8894b247d9a746848720219599a4d23c', 'request_id': 'req-32b7f866-7661-4713-b3bb-c8956585df8a'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:24.652003 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-32b7f866-7661-4713-b3bb-c8956585df8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8894b247d9a746848720219599a4d23c', 'request_id': 'req-32b7f866-7661-4713-b3bb-c8956585df8a'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:24.658352 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-32b7f866-7661-4713-b3bb-c8956585df8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8894b247d9a746848720219599a4d23c', 'request_id': 'req-32b7f866-7661-4713-b3bb-c8956585df8a'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:24.678604 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-32b7f866-7661-4713-b3bb-c8956585df8a admin admin] The token cache is being invalidate because project 8894b247d9a746848720219599a4d23c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:35:24.679318 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-32b7f866-7661-4713-b3bb-c8956585df8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:24.679698 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-32b7f866-7661-4713-b3bb-c8956585df8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:24.685260 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1204/2397] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:35:24 2022] DELETE /identity/v3/projects/8894b247d9a746848720219599a4d23c => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:35:24.686113 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe27d11-0eed-4e83-905a-bcbbf3edd591 service neutron] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:24.696623 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe27d11-0eed-4e83-905a-bcbbf3edd591 service neutron] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:24.772422 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e78561a-019c-4776-9756-ff61b7b63323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:24.773061 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78561a-019c-4776-9756-ff61b7b63323 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:24.773344 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78561a-019c-4776-9756-ff61b7b63323 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:24.773625 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78561a-019c-4776-9756-ff61b7b63323 admin admin] PATH_INFO: `/v3/users/039848e9963e4df6b858d147866bf559` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:24.774799 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e78561a-019c-4776-9756-ff61b7b63323 admin admin] RBAC: Authorizing `identity:delete_user(user_id=039848e9963e4df6b858d147866bf559)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:24.777408 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e78561a-019c-4776-9756-ff61b7b63323 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:24.835419 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-7e78561a-019c-4776-9756-ff61b7b63323 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '039848e9963e4df6b858d147866bf559'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:24.847717 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-7e78561a-019c-4776-9756-ff61b7b63323 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '039848e9963e4df6b858d147866bf559'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:24.857293 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-7e78561a-019c-4776-9756-ff61b7b63323 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '039848e9963e4df6b858d147866bf559'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:24.857919 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-7e78561a-019c-4776-9756-ff61b7b63323 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '039848e9963e4df6b858d147866bf559'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:24.871350 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-7e78561a-019c-4776-9756-ff61b7b63323 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '039848e9963e4df6b858d147866bf559'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:24.877667 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1194/2398] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:35:24 2022] DELETE /identity/v3/users/039848e9963e4df6b858d147866bf559 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 03:35:25.278259 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b7f866-7661-4713-b3bb-c8956585df8a admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:25.280294 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-32b7f866-7661-4713-b3bb-c8956585df8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:25.305917 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b7f866-7661-4713-b3bb-c8956585df8a admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:25.399571 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03634f8-2bfc-45e8-a9a3-ffef6771a5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:25.400396 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03634f8-2bfc-45e8-a9a3-ffef6771a5fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:25.400742 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03634f8-2bfc-45e8-a9a3-ffef6771a5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:25.401115 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03634f8-2bfc-45e8-a9a3-ffef6771a5fd admin admin] PATH_INFO: `/v3/projects/ca4ace1887534c3fa56ad615112d1492` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:25.402413 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03634f8-2bfc-45e8-a9a3-ffef6771a5fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca4ace1887534c3fa56ad615112d1492)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:25.404418 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03634f8-2bfc-45e8-a9a3-ffef6771a5fd admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:25.480351 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-e03634f8-2bfc-45e8-a9a3-ffef6771a5fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca4ace1887534c3fa56ad615112d1492', 'request_id': 'req-e03634f8-2bfc-45e8-a9a3-ffef6771a5fd'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:25.505652 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-e03634f8-2bfc-45e8-a9a3-ffef6771a5fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca4ace1887534c3fa56ad615112d1492', 'request_id': 'req-e03634f8-2bfc-45e8-a9a3-ffef6771a5fd'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:25.541650 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-e03634f8-2bfc-45e8-a9a3-ffef6771a5fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca4ace1887534c3fa56ad615112d1492', 'request_id': 'req-e03634f8-2bfc-45e8-a9a3-ffef6771a5fd'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:25.558779 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-e03634f8-2bfc-45e8-a9a3-ffef6771a5fd admin admin] The token cache is being invalidate because project ca4ace1887534c3fa56ad615112d1492 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:35:25.559100 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-e03634f8-2bfc-45e8-a9a3-ffef6771a5fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:25.559782 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-e03634f8-2bfc-45e8-a9a3-ffef6771a5fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:25.561307 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1205/2399] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:35:25 2022] DELETE /identity/v3/projects/ca4ace1887534c3fa56ad615112d1492 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:35:25.566261 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca3618-4079-4e74-9df4-592689d138f3 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:25.566825 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca3618-4079-4e74-9df4-592689d138f3 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:25.567293 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca3618-4079-4e74-9df4-592689d138f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:25.589316 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-6cca3618-4079-4e74-9df4-592689d138f3 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:35:25.590846 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-6cca3618-4079-4e74-9df4-592689d138f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:25.624865 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:35:25.657376 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1195/2400] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:35:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 03:35:25.666452 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7ecf42-f90a-4445-9bc0-440272b0078c None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:25.666856 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7ecf42-f90a-4445-9bc0-440272b0078c None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:25.667137 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7ecf42-f90a-4445-9bc0-440272b0078c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:25.688407 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-1e7ecf42-f90a-4445-9bc0-440272b0078c None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:35:25.690468 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-1e7ecf42-f90a-4445-9bc0-440272b0078c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:25.700332 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1206/2401] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:35:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:35:25.704990 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cca3618-4079-4e74-9df4-592689d138f3 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:25.715779 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cca3618-4079-4e74-9df4-592689d138f3 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:25.720547 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdfad65-8c9b-483e-8a01-aeacbfac8472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:25.721151 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdfad65-8c9b-483e-8a01-aeacbfac8472 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:25.721438 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdfad65-8c9b-483e-8a01-aeacbfac8472 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:25.721717 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdfad65-8c9b-483e-8a01-aeacbfac8472 admin admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:25.722402 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdfad65-8c9b-483e-8a01-aeacbfac8472 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:35:25.722710 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdfad65-8c9b-483e-8a01-aeacbfac8472 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:25.724359 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdfad65-8c9b-483e-8a01-aeacbfac8472 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:25.738263 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1196/2402] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 03:35:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:35:25.742641 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7ecf42-f90a-4445-9bc0-440272b0078c None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:25.753189 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7ecf42-f90a-4445-9bc0-440272b0078c None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:25.757949 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dda414-ea47-4f55-9f0a-af84fe6b92cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:25.758769 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dda414-ea47-4f55-9f0a-af84fe6b92cd admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:25.759285 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dda414-ea47-4f55-9f0a-af84fe6b92cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:25.760074 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dda414-ea47-4f55-9f0a-af84fe6b92cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:25.761152 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dda414-ea47-4f55-9f0a-af84fe6b92cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:25.763254 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dda414-ea47-4f55-9f0a-af84fe6b92cd admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:25.773855 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:35:25.797718 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1207/2403] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:35:25 2022] POST /identity/v3/projects => generated 409 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 03:35:25.801683 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdfad65-8c9b-483e-8a01-aeacbfac8472 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:25.821779 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdfad65-8c9b-483e-8a01-aeacbfac8472 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:25.893097 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e3fc34-f296-4b49-bb42-c31f88ea43f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:25.893708 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e3fc34-f296-4b49-bb42-c31f88ea43f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:25.893989 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e3fc34-f296-4b49-bb42-c31f88ea43f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:25.894300 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e3fc34-f296-4b49-bb42-c31f88ea43f0 admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:25.894971 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e3fc34-f296-4b49-bb42-c31f88ea43f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:25.896958 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e3fc34-f296-4b49-bb42-c31f88ea43f0 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:25.919214 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1197/2404] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:35:25 2022] POST /identity/v3/users => generated 305 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:35:25.923608 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dda414-ea47-4f55-9f0a-af84fe6b92cd admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:25.935219 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dda414-ea47-4f55-9f0a-af84fe6b92cd admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:25.940417 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced73ab5-8fc8-4171-873f-1b0c27b25f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:25.941027 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced73ab5-8fc8-4171-873f-1b0c27b25f87 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:25.943932 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced73ab5-8fc8-4171-873f-1b0c27b25f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:25.944486 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced73ab5-8fc8-4171-873f-1b0c27b25f87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:25.945413 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced73ab5-8fc8-4171-873f-1b0c27b25f87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:25.947708 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced73ab5-8fc8-4171-873f-1b0c27b25f87 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:25.958734 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1208/2405] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:35:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:35:25.963418 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e3fc34-f296-4b49-bb42-c31f88ea43f0 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:25.975614 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e3fc34-f296-4b49-bb42-c31f88ea43f0 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:25.980752 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6da424b-377e-49ea-b95f-8066153b477b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:25.981368 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da424b-377e-49ea-b95f-8066153b477b admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:25.981657 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da424b-377e-49ea-b95f-8066153b477b admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:25.981931 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da424b-377e-49ea-b95f-8066153b477b admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:25.982636 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6da424b-377e-49ea-b95f-8066153b477b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:25.984286 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6da424b-377e-49ea-b95f-8066153b477b admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:25.995884 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1198/2406] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:35:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:35:26.000399 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced73ab5-8fc8-4171-873f-1b0c27b25f87 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:26.012185 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced73ab5-8fc8-4171-873f-1b0c27b25f87 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:26.017013 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0125ed48-9c3e-4fd3-a7cb-c5c6c7591223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:26.017680 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0125ed48-9c3e-4fd3-a7cb-c5c6c7591223 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:26.017961 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0125ed48-9c3e-4fd3-a7cb-c5c6c7591223 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:26.018345 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0125ed48-9c3e-4fd3-a7cb-c5c6c7591223 admin admin] PATH_INFO: `/v3/projects/d85b5e10d1884b00969b801ffeda1965/users/32db5cdaa0904396a188d5c2bf161c2a/roles/04d0e4575a28440eb4349b4a6565e8b8` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:26.034625 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0125ed48-9c3e-4fd3-a7cb-c5c6c7591223 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d85b5e10d1884b00969b801ffeda1965, user_id=32db5cdaa0904396a188d5c2bf161c2a, role_id=04d0e4575a28440eb4349b4a6565e8b8)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:26.037469 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0125ed48-9c3e-4fd3-a7cb-c5c6c7591223 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:26.051543 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1209/2407] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:35:25 2022] PUT /identity/v3/projects/d85b5e10d1884b00969b801ffeda1965/users/32db5cdaa0904396a188d5c2bf161c2a/roles/04d0e4575a28440eb4349b4a6565e8b8 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:35:26.064179 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb937c90-e3b9-4640-a3df-a13b3126afce None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:26.064498 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb937c90-e3b9-4640-a3df-a13b3126afce None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:26.064779 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb937c90-e3b9-4640-a3df-a13b3126afce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:26.096364 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-cb937c90-e3b9-4640-a3df-a13b3126afce None None] MFA Rules not processed for user `32db5cdaa0904396a188d5c2bf161c2a`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:35:26.097412 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-cb937c90-e3b9-4640-a3df-a13b3126afce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:26.101599 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0125ed48-9c3e-4fd3-a7cb-c5c6c7591223 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:26.103374 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-0125ed48-9c3e-4fd3-a7cb-c5c6c7591223 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:26.165068 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1199/2408] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:35:26 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:35:26.170396 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb937c90-e3b9-4640-a3df-a13b3126afce None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:26.191867 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0125ed48-9c3e-4fd3-a7cb-c5c6c7591223 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:26.198547 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ecf3e-69b6-4634-8259-796234c2c6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:26.199216 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ecf3e-69b6-4634-8259-796234c2c6c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:26.199520 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ecf3e-69b6-4634-8259-796234c2c6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:26.199808 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ecf3e-69b6-4634-8259-796234c2c6c4 admin admin] PATH_INFO: `/v3/users/17ddb5a4f44149238952784770b568b8` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:26.200967 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8ecf3e-69b6-4634-8259-796234c2c6c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17ddb5a4f44149238952784770b568b8)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:26.202886 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8ecf3e-69b6-4634-8259-796234c2c6c4 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:26.217818 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:35:26.250896 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb937c90-e3b9-4640-a3df-a13b3126afce None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:26.256013 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a3235e-241c-4bc9-b318-83c4cbfe12a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:26.256622 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a3235e-241c-4bc9-b318-83c4cbfe12a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:26.256905 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a3235e-241c-4bc9-b318-83c4cbfe12a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:26.257183 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a3235e-241c-4bc9-b318-83c4cbfe12a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:26.257822 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a3235e-241c-4bc9-b318-83c4cbfe12a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:26.258993 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-9b8ecf3e-69b6-4634-8259-796234c2c6c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17ddb5a4f44149238952784770b568b8'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:26.261758 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-9b8ecf3e-69b6-4634-8259-796234c2c6c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17ddb5a4f44149238952784770b568b8'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:26.261902 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a3235e-241c-4bc9-b318-83c4cbfe12a0 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:26.269263 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-9b8ecf3e-69b6-4634-8259-796234c2c6c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17ddb5a4f44149238952784770b568b8'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:26.269902 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-9b8ecf3e-69b6-4634-8259-796234c2c6c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17ddb5a4f44149238952784770b568b8'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:26.285679 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-9b8ecf3e-69b6-4634-8259-796234c2c6c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17ddb5a4f44149238952784770b568b8'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:26.292005 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1200/2409] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:35:26 2022] POST /identity/v3/projects => generated 407 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 03:35:26.292005 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a3235e-241c-4bc9-b318-83c4cbfe12a0 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:26.294178 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-d9a3235e-241c-4bc9-b318-83c4cbfe12a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:26.299480 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1210/2410] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:35:26 2022] DELETE /identity/v3/users/17ddb5a4f44149238952784770b568b8 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 03:35:26.303275 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ecf3e-69b6-4634-8259-796234c2c6c4 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:26.304620 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-9b8ecf3e-69b6-4634-8259-796234c2c6c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:26.341792 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:35:26.372229 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a3235e-241c-4bc9-b318-83c4cbfe12a0 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:26.375400 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ecf3e-69b6-4634-8259-796234c2c6c4 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:26.380888 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b106425-fe49-4fbe-9de7-5da7aaed3496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:26.381629 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b106425-fe49-4fbe-9de7-5da7aaed3496 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:26.382014 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b106425-fe49-4fbe-9de7-5da7aaed3496 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:26.382427 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b106425-fe49-4fbe-9de7-5da7aaed3496 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:26.383130 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b106425-fe49-4fbe-9de7-5da7aaed3496 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:26.385370 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b106425-fe49-4fbe-9de7-5da7aaed3496 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:26.406696 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1211/2411] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:35:26 2022] POST /identity/v3/users => generated 310 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:35:26.407950 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfc9cf2-df8d-4235-9362-38064ad4576b None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:26.408241 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfc9cf2-df8d-4235-9362-38064ad4576b None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:26.408523 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfc9cf2-df8d-4235-9362-38064ad4576b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:26.428402 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-1cfc9cf2-df8d-4235-9362-38064ad4576b None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:35:26.429614 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-1cfc9cf2-df8d-4235-9362-38064ad4576b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:26.437929 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1212/2412] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:35:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:35:26.438517 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfc9cf2-df8d-4235-9362-38064ad4576b None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:26.445366 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5debad-5ab3-4009-a7e0-7c53ca100dc4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1f412befb9418fa66a2aabf475aa90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:26.446080 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5debad-5ab3-4009-a7e0-7c53ca100dc4 service nova] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:26.446429 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5debad-5ab3-4009-a7e0-7c53ca100dc4 service nova] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:26.446778 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5debad-5ab3-4009-a7e0-7c53ca100dc4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:26.449224 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfc9cf2-df8d-4235-9362-38064ad4576b None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:26.449427 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-8f5debad-5ab3-4009-a7e0-7c53ca100dc4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:26.453827 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f309e3ba-8a85-40c5-8b26-273e78a4cb72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:26.454416 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f309e3ba-8a85-40c5-8b26-273e78a4cb72 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:26.454695 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f309e3ba-8a85-40c5-8b26-273e78a4cb72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:26.454969 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f309e3ba-8a85-40c5-8b26-273e78a4cb72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:26.455647 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f309e3ba-8a85-40c5-8b26-273e78a4cb72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:26.457213 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f309e3ba-8a85-40c5-8b26-273e78a4cb72 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:26.470639 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1213/2413] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:35:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:35:26.470639 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f309e3ba-8a85-40c5-8b26-273e78a4cb72 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:26.470639 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-f309e3ba-8a85-40c5-8b26-273e78a4cb72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:26.507735 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:35:26.516075 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5debad-5ab3-4009-a7e0-7c53ca100dc4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:26.517728 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5debad-5ab3-4009-a7e0-7c53ca100dc4 service nova] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:26.527801 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1201/2414] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:35:26 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:35:26.528728 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5debad-5ab3-4009-a7e0-7c53ca100dc4 service nova] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:26.535001 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f309e3ba-8a85-40c5-8b26-273e78a4cb72 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:26.539131 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5debad-5ab3-4009-a7e0-7c53ca100dc4 service nova] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:26.539277 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c5e3c8-72b0-4931-bafb-628af704c286 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:26.539995 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c5e3c8-72b0-4931-bafb-628af704c286 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:26.540348 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c5e3c8-72b0-4931-bafb-628af704c286 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:26.540649 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c5e3c8-72b0-4931-bafb-628af704c286 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:26.546249 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab62d2e2-24da-45e9-96b2-2309aabd1990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:26.547088 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab62d2e2-24da-45e9-96b2-2309aabd1990 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:26.547509 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab62d2e2-24da-45e9-96b2-2309aabd1990 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:26.547810 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab62d2e2-24da-45e9-96b2-2309aabd1990 admin admin] PATH_INFO: `/v3/projects/eccba50c1c4841589480acfc217e92b7/users/fc2b21c50d1640eb884bf7fd893117b6/roles/fe9379cda35c4ff78576fe48b60bea3c` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:26.551312 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c5e3c8-72b0-4931-bafb-628af704c286 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:26.554057 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c5e3c8-72b0-4931-bafb-628af704c286 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:26.566271 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab62d2e2-24da-45e9-96b2-2309aabd1990 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eccba50c1c4841589480acfc217e92b7, user_id=fc2b21c50d1640eb884bf7fd893117b6, role_id=fe9379cda35c4ff78576fe48b60bea3c)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:26.570108 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab62d2e2-24da-45e9-96b2-2309aabd1990 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:26.575698 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1214/2415] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:35:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:35:26.587811 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1202/2416] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:35:26 2022] PUT /identity/v3/projects/eccba50c1c4841589480acfc217e92b7/users/fc2b21c50d1640eb884bf7fd893117b6/roles/fe9379cda35c4ff78576fe48b60bea3c => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:35:26.591925 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c5e3c8-72b0-4931-bafb-628af704c286 service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:26.602364 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c5e3c8-72b0-4931-bafb-628af704c286 service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:26.677998 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0217115-c577-43ab-a782-57a1db9e913f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:26.678616 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0217115-c577-43ab-a782-57a1db9e913f admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:26.678902 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0217115-c577-43ab-a782-57a1db9e913f admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:26.679175 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0217115-c577-43ab-a782-57a1db9e913f admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:26.679863 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0217115-c577-43ab-a782-57a1db9e913f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:26.681548 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0217115-c577-43ab-a782-57a1db9e913f admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:26.692179 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1215/2417] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:35:26 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 03:35:26.696570 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab62d2e2-24da-45e9-96b2-2309aabd1990 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:26.708287 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab62d2e2-24da-45e9-96b2-2309aabd1990 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:26.713915 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a817ca83-c5cd-4b1c-b92c-a39bdf800ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:26.714605 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a817ca83-c5cd-4b1c-b92c-a39bdf800ece admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:26.714889 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a817ca83-c5cd-4b1c-b92c-a39bdf800ece admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:26.715169 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a817ca83-c5cd-4b1c-b92c-a39bdf800ece admin admin] PATH_INFO: `/v3/projects/eccba50c1c4841589480acfc217e92b7/users/fc2b21c50d1640eb884bf7fd893117b6/roles/fe9379cda35c4ff78576fe48b60bea3c` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:26.717220 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a817ca83-c5cd-4b1c-b92c-a39bdf800ece admin admin] RBAC: Authorizing `identity:create_grant(project_id=eccba50c1c4841589480acfc217e92b7, user_id=fc2b21c50d1640eb884bf7fd893117b6, role_id=fe9379cda35c4ff78576fe48b60bea3c)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:26.719897 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a817ca83-c5cd-4b1c-b92c-a39bdf800ece admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:26.732488 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1203/2418] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:35:26 2022] PUT /identity/v3/projects/eccba50c1c4841589480acfc217e92b7/users/fc2b21c50d1640eb884bf7fd893117b6/roles/fe9379cda35c4ff78576fe48b60bea3c => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:35:26.742483 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e15e2-735b-483d-b529-7b0d77a62c49 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:26.742773 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e15e2-735b-483d-b529-7b0d77a62c49 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:26.743055 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e15e2-735b-483d-b529-7b0d77a62c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:26.780983 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-da3e15e2-735b-483d-b529-7b0d77a62c49 None None] MFA Rules not processed for user `fc2b21c50d1640eb884bf7fd893117b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:35:26.782193 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-da3e15e2-735b-483d-b529-7b0d77a62c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:26.827212 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:35:26.874300 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1216/2419] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:35:26 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:35:26.886669 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a817ca83-c5cd-4b1c-b92c-a39bdf800ece admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:26.888539 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-a817ca83-c5cd-4b1c-b92c-a39bdf800ece admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:26.958396 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a817ca83-c5cd-4b1c-b92c-a39bdf800ece admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:26.962368 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b506a14b-cec7-451b-bd7b-72f967458ea4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f537aabf3d1040ff840b02616f839975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:26.963204 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506a14b-cec7-451b-bd7b-72f967458ea4 service cinder] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:26.963584 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506a14b-cec7-451b-bd7b-72f967458ea4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:26.963928 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506a14b-cec7-451b-bd7b-72f967458ea4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:26.974289 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b506a14b-cec7-451b-bd7b-72f967458ea4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:26.976007 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b506a14b-cec7-451b-bd7b-72f967458ea4 service cinder] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:26.988356 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1204/2420] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:35:26 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:35:27.184851 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3e15e2-735b-483d-b529-7b0d77a62c49 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:27.195557 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3e15e2-735b-483d-b529-7b0d77a62c49 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:27.203833 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c2a6e8-fce5-48bd-9dcb-8ff28adeb3b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f537aabf3d1040ff840b02616f839975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:27.205538 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c2a6e8-fce5-48bd-9dcb-8ff28adeb3b3 service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:27.205817 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c2a6e8-fce5-48bd-9dcb-8ff28adeb3b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:27.206097 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c2a6e8-fce5-48bd-9dcb-8ff28adeb3b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:27.208001 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-e4c2a6e8-fce5-48bd-9dcb-8ff28adeb3b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:27.270890 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c2a6e8-fce5-48bd-9dcb-8ff28adeb3b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:27.272397 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c2a6e8-fce5-48bd-9dcb-8ff28adeb3b3 service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:27.276136 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b506a14b-cec7-451b-bd7b-72f967458ea4 service cinder] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:27.277739 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-b506a14b-cec7-451b-bd7b-72f967458ea4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:27.282715 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1217/2421] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:35:27 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:35:27.354239 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b506a14b-cec7-451b-bd7b-72f967458ea4 service cinder] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:27.360339 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4780a24-a48e-45e4-ab64-ee6b8e73b75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:27.360967 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4780a24-a48e-45e4-ab64-ee6b8e73b75c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:27.361248 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4780a24-a48e-45e4-ab64-ee6b8e73b75c admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:27.361549 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4780a24-a48e-45e4-ab64-ee6b8e73b75c admin admin] PATH_INFO: `/v3/projects/9318cbda446441158cdbf517d0e36ab5` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:27.362787 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4780a24-a48e-45e4-ab64-ee6b8e73b75c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9318cbda446441158cdbf517d0e36ab5)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:27.364913 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4780a24-a48e-45e4-ab64-ee6b8e73b75c admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:27.416828 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-e4780a24-a48e-45e4-ab64-ee6b8e73b75c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9318cbda446441158cdbf517d0e36ab5', 'request_id': 'req-e4780a24-a48e-45e4-ab64-ee6b8e73b75c'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:27.423369 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-e4780a24-a48e-45e4-ab64-ee6b8e73b75c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9318cbda446441158cdbf517d0e36ab5', 'request_id': 'req-e4780a24-a48e-45e4-ab64-ee6b8e73b75c'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:27.425281 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:35:27.430838 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-e4780a24-a48e-45e4-ab64-ee6b8e73b75c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9318cbda446441158cdbf517d0e36ab5', 'request_id': 'req-e4780a24-a48e-45e4-ab64-ee6b8e73b75c'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:27.446323 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-e4780a24-a48e-45e4-ab64-ee6b8e73b75c admin admin] The token cache is being invalidate because project 9318cbda446441158cdbf517d0e36ab5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:35:27.446640 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-e4780a24-a48e-45e4-ab64-ee6b8e73b75c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:27.447909 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-e4780a24-a48e-45e4-ab64-ee6b8e73b75c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:27.449428 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1205/2422] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:35:27 2022] DELETE /identity/v3/projects/9318cbda446441158cdbf517d0e36ab5 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 03:35:30.771168 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c2a6e8-fce5-48bd-9dcb-8ff28adeb3b3 service cinder] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:30.863136 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c2a6e8-fce5-48bd-9dcb-8ff28adeb3b3 service cinder] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:30.920486 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:35:30.928299 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c08126-7fd0-45cd-bdb2-c567b730b1b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1f412befb9418fa66a2aabf475aa90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:30.928899 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c08126-7fd0-45cd-bdb2-c567b730b1b8 service nova] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:30.929177 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c08126-7fd0-45cd-bdb2-c567b730b1b8 service nova] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:30.929451 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c08126-7fd0-45cd-bdb2-c567b730b1b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:30.931878 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-63c08126-7fd0-45cd-bdb2-c567b730b1b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:30.944333 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c08126-7fd0-45cd-bdb2-c567b730b1b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:30.945903 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c08126-7fd0-45cd-bdb2-c567b730b1b8 service nova] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:30.957481 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1218/2423] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:35:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:35:32.604624 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4780a24-a48e-45e4-ab64-ee6b8e73b75c admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:32.606047 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-e4780a24-a48e-45e4-ab64-ee6b8e73b75c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:32.670705 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4780a24-a48e-45e4-ab64-ee6b8e73b75c admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:32.675364 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a68d05-c81e-475f-9f0f-4c678577fa02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:32.676025 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a68d05-c81e-475f-9f0f-4c678577fa02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:32.676310 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a68d05-c81e-475f-9f0f-4c678577fa02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:32.676589 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a68d05-c81e-475f-9f0f-4c678577fa02 admin admin] PATH_INFO: `/v3/users/32db5cdaa0904396a188d5c2bf161c2a` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:32.677718 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a68d05-c81e-475f-9f0f-4c678577fa02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32db5cdaa0904396a188d5c2bf161c2a)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:32.679656 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a68d05-c81e-475f-9f0f-4c678577fa02 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:32.728780 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-12a68d05-c81e-475f-9f0f-4c678577fa02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32db5cdaa0904396a188d5c2bf161c2a'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:32.735655 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-12a68d05-c81e-475f-9f0f-4c678577fa02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32db5cdaa0904396a188d5c2bf161c2a'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:32.748916 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-12a68d05-c81e-475f-9f0f-4c678577fa02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32db5cdaa0904396a188d5c2bf161c2a'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:32.749559 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-12a68d05-c81e-475f-9f0f-4c678577fa02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32db5cdaa0904396a188d5c2bf161c2a'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:32.762965 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-12a68d05-c81e-475f-9f0f-4c678577fa02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32db5cdaa0904396a188d5c2bf161c2a'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:32.768849 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1206/2424] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:35:32 2022] DELETE /identity/v3/users/32db5cdaa0904396a188d5c2bf161c2a => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:35:32.773316 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a5c1b-bff0-404f-9db2-4ac05875399f None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:32.773816 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a5c1b-bff0-404f-9db2-4ac05875399f None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:32.773924 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a5c1b-bff0-404f-9db2-4ac05875399f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:32.793898 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-4a8a5c1b-bff0-404f-9db2-4ac05875399f None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:35:32.794911 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-4a8a5c1b-bff0-404f-9db2-4ac05875399f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:32.859826 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1219/2425] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:35:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 03:35:32.870665 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a68d05-c81e-475f-9f0f-4c678577fa02 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:32.872238 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-12a68d05-c81e-475f-9f0f-4c678577fa02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:32.934410 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a68d05-c81e-475f-9f0f-4c678577fa02 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:32.938135 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e359280-75a3-4dcb-b9b0-5f1cc78babd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:32.938735 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e359280-75a3-4dcb-b9b0-5f1cc78babd2 service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:32.939013 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e359280-75a3-4dcb-b9b0-5f1cc78babd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:32.939321 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e359280-75a3-4dcb-b9b0-5f1cc78babd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:32.949386 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e359280-75a3-4dcb-b9b0-5f1cc78babd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:32.950802 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e359280-75a3-4dcb-b9b0-5f1cc78babd2 service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:32.960509 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1207/2426] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:35:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:35:33.417560 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a5c1b-bff0-404f-9db2-4ac05875399f None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:33.419305 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-4a8a5c1b-bff0-404f-9db2-4ac05875399f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:33.433731 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a5c1b-bff0-404f-9db2-4ac05875399f None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:33.438851 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6705dc3-7e3c-4d67-9422-9aeec66678eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:33.439648 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6705dc3-7e3c-4d67-9422-9aeec66678eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:33.439937 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6705dc3-7e3c-4d67-9422-9aeec66678eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:33.440216 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6705dc3-7e3c-4d67-9422-9aeec66678eb admin admin] PATH_INFO: `/v3/projects/d85b5e10d1884b00969b801ffeda1965` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:33.441377 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6705dc3-7e3c-4d67-9422-9aeec66678eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d85b5e10d1884b00969b801ffeda1965)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:33.443278 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6705dc3-7e3c-4d67-9422-9aeec66678eb admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:33.500247 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-b6705dc3-7e3c-4d67-9422-9aeec66678eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd85b5e10d1884b00969b801ffeda1965', 'request_id': 'req-b6705dc3-7e3c-4d67-9422-9aeec66678eb'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:33.507635 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-b6705dc3-7e3c-4d67-9422-9aeec66678eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd85b5e10d1884b00969b801ffeda1965', 'request_id': 'req-b6705dc3-7e3c-4d67-9422-9aeec66678eb'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:33.514198 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-b6705dc3-7e3c-4d67-9422-9aeec66678eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd85b5e10d1884b00969b801ffeda1965', 'request_id': 'req-b6705dc3-7e3c-4d67-9422-9aeec66678eb'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:33.537270 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-b6705dc3-7e3c-4d67-9422-9aeec66678eb admin admin] The token cache is being invalidate because project d85b5e10d1884b00969b801ffeda1965 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:35:33.537578 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-b6705dc3-7e3c-4d67-9422-9aeec66678eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:33.538325 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-b6705dc3-7e3c-4d67-9422-9aeec66678eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:33.541591 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1220/2427] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:35:33 2022] DELETE /identity/v3/projects/d85b5e10d1884b00969b801ffeda1965 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:35:33.545426 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e359280-75a3-4dcb-b9b0-5f1cc78babd2 service neutron] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:33.555443 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e359280-75a3-4dcb-b9b0-5f1cc78babd2 service neutron] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:33.564602 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:35:33.624313 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c23c5c-b25d-439a-8fa2-924faaa797ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:33.625062 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c23c5c-b25d-439a-8fa2-924faaa797ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:33.625350 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c23c5c-b25d-439a-8fa2-924faaa797ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:33.625698 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c23c5c-b25d-439a-8fa2-924faaa797ae admin admin] PATH_INFO: `/v3/users/fc2b21c50d1640eb884bf7fd893117b6` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:33.626920 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c23c5c-b25d-439a-8fa2-924faaa797ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc2b21c50d1640eb884bf7fd893117b6)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:33.628933 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c23c5c-b25d-439a-8fa2-924faaa797ae admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:33.686092 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-30c23c5c-b25d-439a-8fa2-924faaa797ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc2b21c50d1640eb884bf7fd893117b6'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:33.693209 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-30c23c5c-b25d-439a-8fa2-924faaa797ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc2b21c50d1640eb884bf7fd893117b6'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:33.700458 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-30c23c5c-b25d-439a-8fa2-924faaa797ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc2b21c50d1640eb884bf7fd893117b6'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:33.701654 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-30c23c5c-b25d-439a-8fa2-924faaa797ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc2b21c50d1640eb884bf7fd893117b6'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:33.716524 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-30c23c5c-b25d-439a-8fa2-924faaa797ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc2b21c50d1640eb884bf7fd893117b6'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:33.723508 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1208/2428] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:35:33 2022] DELETE /identity/v3/users/fc2b21c50d1640eb884bf7fd893117b6 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:35:33.896227 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6705dc3-7e3c-4d67-9422-9aeec66678eb admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:33.897730 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-b6705dc3-7e3c-4d67-9422-9aeec66678eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:34.007191 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d528717-9479-40f1-89f4-face2ab0f383 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:34.007549 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d528717-9479-40f1-89f4-face2ab0f383 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:34.007994 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d528717-9479-40f1-89f4-face2ab0f383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:34.037197 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-9d528717-9479-40f1-89f4-face2ab0f383 None None] MFA Rules not processed for user `bef61ef12079495ba72b7fcd2717aca2`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:35:34.039825 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6705dc3-7e3c-4d67-9422-9aeec66678eb admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:34.043742 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-9d528717-9479-40f1-89f4-face2ab0f383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:34.057344 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:35:34.154337 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1209/2429] 10.222.0.25 () {58 vars in 967 bytes} [Tue Oct 4 03:35:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 03:35:34.155383 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d528717-9479-40f1-89f4-face2ab0f383 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:34.157858 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-9d528717-9479-40f1-89f4-face2ab0f383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:34.213516 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d717b4cb-8c7c-456f-9d87-07c052ddb941 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1f412befb9418fa66a2aabf475aa90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:34.213516 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d717b4cb-8c7c-456f-9d87-07c052ddb941 service nova] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:34.213787 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d717b4cb-8c7c-456f-9d87-07c052ddb941 service nova] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:34.213867 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d717b4cb-8c7c-456f-9d87-07c052ddb941 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:34.217045 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-d717b4cb-8c7c-456f-9d87-07c052ddb941 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:34.235088 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d717b4cb-8c7c-456f-9d87-07c052ddb941 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:34.237519 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d717b4cb-8c7c-456f-9d87-07c052ddb941 service nova] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:34.248757 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:35:34.261444 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1221/2430] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:35:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:35:34.262052 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d717b4cb-8c7c-456f-9d87-07c052ddb941 service nova] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:34.263421 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-d717b4cb-8c7c-456f-9d87-07c052ddb941 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:34.307891 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d528717-9479-40f1-89f4-face2ab0f383 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:34.314884 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c90ec0a-a615-44a8-b46f-3459e37d0b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:34.322484 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c90ec0a-a615-44a8-b46f-3459e37d0b21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:34.323008 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c90ec0a-a615-44a8-b46f-3459e37d0b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:34.325018 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c90ec0a-a615-44a8-b46f-3459e37d0b21 admin admin] PATH_INFO: `/v3/projects/eccba50c1c4841589480acfc217e92b7` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:34.326599 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c90ec0a-a615-44a8-b46f-3459e37d0b21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eccba50c1c4841589480acfc217e92b7)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:34.329911 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c90ec0a-a615-44a8-b46f-3459e37d0b21 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:34.372097 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d717b4cb-8c7c-456f-9d87-07c052ddb941 service nova] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:34.381112 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9586c6ff-137e-4b89-ae5d-e52bf7e2d644 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8da6bacc8f432e8f48bb99c7aede11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:34.383069 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9586c6ff-137e-4b89-ae5d-e52bf7e2d644 service swift] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:34.385419 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9586c6ff-137e-4b89-ae5d-e52bf7e2d644 service swift] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:34.385419 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9586c6ff-137e-4b89-ae5d-e52bf7e2d644 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:34.395479 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9586c6ff-137e-4b89-ae5d-e52bf7e2d644 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:34.397192 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9586c6ff-137e-4b89-ae5d-e52bf7e2d644 service swift] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:34.400996 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-2c90ec0a-a615-44a8-b46f-3459e37d0b21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eccba50c1c4841589480acfc217e92b7', 'request_id': 'req-2c90ec0a-a615-44a8-b46f-3459e37d0b21'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:34.406679 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1222/2431] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Oct 4 03:35:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 03:35:34.408216 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-2c90ec0a-a615-44a8-b46f-3459e37d0b21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eccba50c1c4841589480acfc217e92b7', 'request_id': 'req-2c90ec0a-a615-44a8-b46f-3459e37d0b21'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:34.414862 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-2c90ec0a-a615-44a8-b46f-3459e37d0b21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eccba50c1c4841589480acfc217e92b7', 'request_id': 'req-2c90ec0a-a615-44a8-b46f-3459e37d0b21'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:34.430421 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-2c90ec0a-a615-44a8-b46f-3459e37d0b21 admin admin] The token cache is being invalidate because project eccba50c1c4841589480acfc217e92b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:35:34.430785 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-2c90ec0a-a615-44a8-b46f-3459e37d0b21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:34.431625 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-2c90ec0a-a615-44a8-b46f-3459e37d0b21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:34.436330 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1210/2432] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:35:34 2022] DELETE /identity/v3/projects/eccba50c1c4841589480acfc217e92b7 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:35:34.441428 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b20834-49d1-44e4-94cb-e5d037512f21 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:34.441654 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b20834-49d1-44e4-94cb-e5d037512f21 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:34.441930 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b20834-49d1-44e4-94cb-e5d037512f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:34.465654 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-f4b20834-49d1-44e4-94cb-e5d037512f21 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:35:34.467246 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-f4b20834-49d1-44e4-94cb-e5d037512f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:34.541267 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1223/2433] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:35:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 03:35:34.550047 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b456a50-9f43-4dc3-9d5c-5abe84f21a51 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:34.550337 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b456a50-9f43-4dc3-9d5c-5abe84f21a51 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:34.550640 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b456a50-9f43-4dc3-9d5c-5abe84f21a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:34.572710 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-9b456a50-9f43-4dc3-9d5c-5abe84f21a51 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:35:34.574256 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-9b456a50-9f43-4dc3-9d5c-5abe84f21a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:34.587026 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1211/2434] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:35:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:35:34.588705 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b20834-49d1-44e4-94cb-e5d037512f21 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:34.604963 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b20834-49d1-44e4-94cb-e5d037512f21 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:34.613709 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f50914-dd55-4ff5-bac5-a5f3f3aa567e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:34.614647 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f50914-dd55-4ff5-bac5-a5f3f3aa567e admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:34.614918 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f50914-dd55-4ff5-bac5-a5f3f3aa567e admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:34.615184 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f50914-dd55-4ff5-bac5-a5f3f3aa567e admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:34.615884 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f50914-dd55-4ff5-bac5-a5f3f3aa567e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:35:34.616185 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f50914-dd55-4ff5-bac5-a5f3f3aa567e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:34.617798 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f50914-dd55-4ff5-bac5-a5f3f3aa567e admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:34.646954 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1224/2435] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 03:35:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:35:34.651953 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b456a50-9f43-4dc3-9d5c-5abe84f21a51 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:34.661899 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b456a50-9f43-4dc3-9d5c-5abe84f21a51 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:34.667736 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9046e9-7098-4627-b79b-a824640cb64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:34.668788 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9046e9-7098-4627-b79b-a824640cb64d admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:34.669218 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9046e9-7098-4627-b79b-a824640cb64d admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:34.669636 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9046e9-7098-4627-b79b-a824640cb64d admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:34.670866 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9046e9-7098-4627-b79b-a824640cb64d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:34.673725 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9046e9-7098-4627-b79b-a824640cb64d admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:34.723666 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1212/2436] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:35:34 2022] POST /identity/v3/projects => generated 387 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:35:34.728299 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f50914-dd55-4ff5-bac5-a5f3f3aa567e admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:34.746085 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f50914-dd55-4ff5-bac5-a5f3f3aa567e admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:34.760952 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:35:34.820328 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d3b945-ea6b-41c3-a33a-1c899abe9b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:34.821258 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3b945-ea6b-41c3-a33a-1c899abe9b28 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:34.821742 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3b945-ea6b-41c3-a33a-1c899abe9b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:34.822192 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3b945-ea6b-41c3-a33a-1c899abe9b28 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:34.823045 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d3b945-ea6b-41c3-a33a-1c899abe9b28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:34.825461 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d3b945-ea6b-41c3-a33a-1c899abe9b28 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:34.851697 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1225/2437] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:35:34 2022] POST /identity/v3/users => generated 294 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:35:34.856144 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9046e9-7098-4627-b79b-a824640cb64d admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:34.867348 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9046e9-7098-4627-b79b-a824640cb64d admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:34.874108 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fe2eca-04e4-4b90-8ccd-9d64ace6b27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:34.876310 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe2eca-04e4-4b90-8ccd-9d64ace6b27d admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:34.876607 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe2eca-04e4-4b90-8ccd-9d64ace6b27d admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:34.876939 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe2eca-04e4-4b90-8ccd-9d64ace6b27d admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:34.877558 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fe2eca-04e4-4b90-8ccd-9d64ace6b27d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:34.879186 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fe2eca-04e4-4b90-8ccd-9d64ace6b27d admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:34.899017 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1213/2438] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:35:34 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:35:34.900681 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d3b945-ea6b-41c3-a33a-1c899abe9b28 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:34.925785 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d3b945-ea6b-41c3-a33a-1c899abe9b28 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:34.937486 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df36eb6c-272a-404d-ab96-379025bcf6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:34.938315 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36eb6c-272a-404d-ab96-379025bcf6b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:34.938730 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36eb6c-272a-404d-ab96-379025bcf6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:34.939138 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36eb6c-272a-404d-ab96-379025bcf6b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:34.940364 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df36eb6c-272a-404d-ab96-379025bcf6b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:34.946043 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df36eb6c-272a-404d-ab96-379025bcf6b1 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:34.960335 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1226/2439] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:35:34 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 03:35:34.964555 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fe2eca-04e4-4b90-8ccd-9d64ace6b27d admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:34.991399 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fe2eca-04e4-4b90-8ccd-9d64ace6b27d admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:35.000631 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3107c060-fbe7-42a7-b82d-b2d4d54a42e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:35.001320 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107c060-fbe7-42a7-b82d-b2d4d54a42e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:35.001606 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107c060-fbe7-42a7-b82d-b2d4d54a42e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:35.001882 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107c060-fbe7-42a7-b82d-b2d4d54a42e2 admin admin] PATH_INFO: `/v3/projects/3e98c011bd6441dc9cb6aad09ef4eca6/users/bbeebc3685bc41d295fd048a7f265475/roles/04d0e4575a28440eb4349b4a6565e8b8` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:35.018024 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3107c060-fbe7-42a7-b82d-b2d4d54a42e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e98c011bd6441dc9cb6aad09ef4eca6, user_id=bbeebc3685bc41d295fd048a7f265475, role_id=04d0e4575a28440eb4349b4a6565e8b8)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:35.020979 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3107c060-fbe7-42a7-b82d-b2d4d54a42e2 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:35.036200 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1214/2440] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:35:34 2022] PUT /identity/v3/projects/3e98c011bd6441dc9cb6aad09ef4eca6/users/bbeebc3685bc41d295fd048a7f265475/roles/04d0e4575a28440eb4349b4a6565e8b8 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:35:35.047792 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2650f6-7305-47a5-af4b-90143964c821 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:35.048086 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2650f6-7305-47a5-af4b-90143964c821 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:35.048361 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2650f6-7305-47a5-af4b-90143964c821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:35.090701 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-0d2650f6-7305-47a5-af4b-90143964c821 None None] MFA Rules not processed for user `bbeebc3685bc41d295fd048a7f265475`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:35:35.092922 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-0d2650f6-7305-47a5-af4b-90143964c821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:35.188265 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1227/2441] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:35:35 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 03:35:35.189620 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3107c060-fbe7-42a7-b82d-b2d4d54a42e2 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:35.263982 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3107c060-fbe7-42a7-b82d-b2d4d54a42e2 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:35.269283 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b2a772-2563-4627-a818-3949638ab303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:35.269897 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b2a772-2563-4627-a818-3949638ab303 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:35.270173 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b2a772-2563-4627-a818-3949638ab303 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:35.270450 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b2a772-2563-4627-a818-3949638ab303 admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:35.271119 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b2a772-2563-4627-a818-3949638ab303 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:35.273049 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b2a772-2563-4627-a818-3949638ab303 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:35.281378 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:35:35.314930 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1215/2442] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:35:35 2022] POST /identity/v3/projects => generated 383 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:35:35.316477 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2650f6-7305-47a5-af4b-90143964c821 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:35.335161 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2650f6-7305-47a5-af4b-90143964c821 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:35.404208 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac7fe5b-c796-4de7-9edd-e84a155712b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:35.404825 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7fe5b-c796-4de7-9edd-e84a155712b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:35.405111 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7fe5b-c796-4de7-9edd-e84a155712b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:35.405522 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7fe5b-c796-4de7-9edd-e84a155712b6 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:35.406322 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac7fe5b-c796-4de7-9edd-e84a155712b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:35.408902 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac7fe5b-c796-4de7-9edd-e84a155712b6 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:35.435327 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1228/2443] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:35:35 2022] POST /identity/v3/users => generated 298 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 03:35:35.436614 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b2a772-2563-4627-a818-3949638ab303 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:35.448035 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b2a772-2563-4627-a818-3949638ab303 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:35.452473 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d57c30-31ac-41ca-822f-6ad5fa7ecc76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:35.453069 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d57c30-31ac-41ca-822f-6ad5fa7ecc76 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:35.453345 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d57c30-31ac-41ca-822f-6ad5fa7ecc76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:35.453616 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d57c30-31ac-41ca-822f-6ad5fa7ecc76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:35.454262 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d57c30-31ac-41ca-822f-6ad5fa7ecc76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:35.455878 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d57c30-31ac-41ca-822f-6ad5fa7ecc76 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:35.469097 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1216/2444] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:35:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:35:35.470274 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac7fe5b-c796-4de7-9edd-e84a155712b6 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:35.481125 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac7fe5b-c796-4de7-9edd-e84a155712b6 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:35.486327 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e064924-4868-47f3-8b03-585d734c03d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:35.487657 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e064924-4868-47f3-8b03-585d734c03d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:35.487942 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e064924-4868-47f3-8b03-585d734c03d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:35.488219 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e064924-4868-47f3-8b03-585d734c03d0 admin admin] PATH_INFO: `/v3/projects/6ca415d74d2241d9b12a0205dfa3ba0f/users/df22d3b5035146b78e95a0fa2d7b46cd/roles/fe9379cda35c4ff78576fe48b60bea3c` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:35.501828 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:35:35.507025 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e064924-4868-47f3-8b03-585d734c03d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ca415d74d2241d9b12a0205dfa3ba0f, user_id=df22d3b5035146b78e95a0fa2d7b46cd, role_id=fe9379cda35c4ff78576fe48b60bea3c)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:35.510787 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e064924-4868-47f3-8b03-585d734c03d0 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:35.532411 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1229/2445] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:35:35 2022] PUT /identity/v3/projects/6ca415d74d2241d9b12a0205dfa3ba0f/users/df22d3b5035146b78e95a0fa2d7b46cd/roles/fe9379cda35c4ff78576fe48b60bea3c => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:35:35.536376 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d57c30-31ac-41ca-822f-6ad5fa7ecc76 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:35.549755 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d57c30-31ac-41ca-822f-6ad5fa7ecc76 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:35.614004 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ff91d3-d3a6-43cd-a9fc-3c83135ebab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:35.614436 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ff91d3-d3a6-43cd-a9fc-3c83135ebab1 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:35.614768 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ff91d3-d3a6-43cd-a9fc-3c83135ebab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:35.614972 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ff91d3-d3a6-43cd-a9fc-3c83135ebab1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:35.618364 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ff91d3-d3a6-43cd-a9fc-3c83135ebab1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:35.618364 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ff91d3-d3a6-43cd-a9fc-3c83135ebab1 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:35.630961 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1217/2446] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:35:35 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:35:35.635548 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e064924-4868-47f3-8b03-585d734c03d0 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:35.649546 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e064924-4868-47f3-8b03-585d734c03d0 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:35.654472 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e268af-ca93-4855-b968-2198ee1f2fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:35.655195 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e268af-ca93-4855-b968-2198ee1f2fc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:35.655596 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e268af-ca93-4855-b968-2198ee1f2fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:35.655943 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e268af-ca93-4855-b968-2198ee1f2fc4 admin admin] PATH_INFO: `/v3/projects/6ca415d74d2241d9b12a0205dfa3ba0f/users/df22d3b5035146b78e95a0fa2d7b46cd/roles/fe9379cda35c4ff78576fe48b60bea3c` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:35.657923 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e268af-ca93-4855-b968-2198ee1f2fc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ca415d74d2241d9b12a0205dfa3ba0f, user_id=df22d3b5035146b78e95a0fa2d7b46cd, role_id=fe9379cda35c4ff78576fe48b60bea3c)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:35.660653 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e268af-ca93-4855-b968-2198ee1f2fc4 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:35.672688 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1230/2447] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:35:35 2022] PUT /identity/v3/projects/6ca415d74d2241d9b12a0205dfa3ba0f/users/df22d3b5035146b78e95a0fa2d7b46cd/roles/fe9379cda35c4ff78576fe48b60bea3c => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:35:35.683889 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c0c13-1651-4c20-ad35-adca4af1faba None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:35.684391 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c0c13-1651-4c20-ad35-adca4af1faba None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:35.684772 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c0c13-1651-4c20-ad35-adca4af1faba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:35.850414 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-819c0c13-1651-4c20-ad35-adca4af1faba None None] MFA Rules not processed for user `df22d3b5035146b78e95a0fa2d7b46cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:35:35.851654 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-819c0c13-1651-4c20-ad35-adca4af1faba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:35.919816 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1218/2448] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:35:35 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:35:35.930912 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e268af-ca93-4855-b968-2198ee1f2fc4 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:35.933370 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-a9e268af-ca93-4855-b968-2198ee1f2fc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:35.990249 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e268af-ca93-4855-b968-2198ee1f2fc4 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:35.994399 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176703ea-383b-4361-bac0-547e5618e047 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f537aabf3d1040ff840b02616f839975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:35.994983 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176703ea-383b-4361-bac0-547e5618e047 service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:35.995259 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176703ea-383b-4361-bac0-547e5618e047 service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:35.995583 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176703ea-383b-4361-bac0-547e5618e047 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:36.004405 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176703ea-383b-4361-bac0-547e5618e047 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:36.005893 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176703ea-383b-4361-bac0-547e5618e047 service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:36.015583 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1231/2449] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:35:35 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:35:36.567432 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819c0c13-1651-4c20-ad35-adca4af1faba None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:36.625263 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:35:36.629840 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819c0c13-1651-4c20-ad35-adca4af1faba None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:36.640744 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2905d12-f29c-4d76-81b6-8244c574a1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:36.641473 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2905d12-f29c-4d76-81b6-8244c574a1dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:36.641771 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2905d12-f29c-4d76-81b6-8244c574a1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:36.642062 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2905d12-f29c-4d76-81b6-8244c574a1dd admin admin] PATH_INFO: `/v3/users/bbeebc3685bc41d295fd048a7f265475` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:36.643385 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2905d12-f29c-4d76-81b6-8244c574a1dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbeebc3685bc41d295fd048a7f265475)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:36.645540 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2905d12-f29c-4d76-81b6-8244c574a1dd admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:36.694966 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-c2905d12-f29c-4d76-81b6-8244c574a1dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbeebc3685bc41d295fd048a7f265475'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:36.702323 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-c2905d12-f29c-4d76-81b6-8244c574a1dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbeebc3685bc41d295fd048a7f265475'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:36.709351 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-c2905d12-f29c-4d76-81b6-8244c574a1dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbeebc3685bc41d295fd048a7f265475'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:36.709903 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-c2905d12-f29c-4d76-81b6-8244c574a1dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbeebc3685bc41d295fd048a7f265475'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:36.722597 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-c2905d12-f29c-4d76-81b6-8244c574a1dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbeebc3685bc41d295fd048a7f265475'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:36.729159 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1219/2450] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:35:36 2022] DELETE /identity/v3/users/bbeebc3685bc41d295fd048a7f265475 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:35:36.733798 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d43696-a0e5-4877-b81d-c4bde5619a04 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:36.734091 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d43696-a0e5-4877-b81d-c4bde5619a04 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:36.734378 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d43696-a0e5-4877-b81d-c4bde5619a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:36.757288 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-92d43696-a0e5-4877-b81d-c4bde5619a04 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:35:36.758520 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-92d43696-a0e5-4877-b81d-c4bde5619a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:36.819505 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1232/2451] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:35:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 03:35:36.831673 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2905d12-f29c-4d76-81b6-8244c574a1dd admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:36.835867 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-c2905d12-f29c-4d76-81b6-8244c574a1dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:36.907783 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2905d12-f29c-4d76-81b6-8244c574a1dd admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:36.911665 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00145c7c-547c-4b69-b4fe-4c09ba239f2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:36.912290 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00145c7c-547c-4b69-b4fe-4c09ba239f2a service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:36.912568 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00145c7c-547c-4b69-b4fe-4c09ba239f2a service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:36.912841 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00145c7c-547c-4b69-b4fe-4c09ba239f2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:36.922601 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00145c7c-547c-4b69-b4fe-4c09ba239f2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:36.924078 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00145c7c-547c-4b69-b4fe-4c09ba239f2a service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:36.934127 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1220/2452] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:35:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:35:37.201436 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d43696-a0e5-4877-b81d-c4bde5619a04 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:37.202932 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-92d43696-a0e5-4877-b81d-c4bde5619a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:37.215996 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d43696-a0e5-4877-b81d-c4bde5619a04 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:37.220659 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64817c05-f61a-43ac-ab92-dbd17cca2d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:37.221351 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64817c05-f61a-43ac-ab92-dbd17cca2d64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:37.221716 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64817c05-f61a-43ac-ab92-dbd17cca2d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:37.222057 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64817c05-f61a-43ac-ab92-dbd17cca2d64 admin admin] PATH_INFO: `/v3/projects/3e98c011bd6441dc9cb6aad09ef4eca6` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:37.223240 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64817c05-f61a-43ac-ab92-dbd17cca2d64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e98c011bd6441dc9cb6aad09ef4eca6)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:37.225215 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64817c05-f61a-43ac-ab92-dbd17cca2d64 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:37.275835 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-64817c05-f61a-43ac-ab92-dbd17cca2d64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e98c011bd6441dc9cb6aad09ef4eca6', 'request_id': 'req-64817c05-f61a-43ac-ab92-dbd17cca2d64'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:37.282434 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-64817c05-f61a-43ac-ab92-dbd17cca2d64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e98c011bd6441dc9cb6aad09ef4eca6', 'request_id': 'req-64817c05-f61a-43ac-ab92-dbd17cca2d64'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:37.288918 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-64817c05-f61a-43ac-ab92-dbd17cca2d64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e98c011bd6441dc9cb6aad09ef4eca6', 'request_id': 'req-64817c05-f61a-43ac-ab92-dbd17cca2d64'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:37.301157 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-64817c05-f61a-43ac-ab92-dbd17cca2d64 admin admin] The token cache is being invalidate because project 3e98c011bd6441dc9cb6aad09ef4eca6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:35:37.301443 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-64817c05-f61a-43ac-ab92-dbd17cca2d64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:37.302061 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-64817c05-f61a-43ac-ab92-dbd17cca2d64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:37.303544 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1233/2453] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:35:37 2022] DELETE /identity/v3/projects/3e98c011bd6441dc9cb6aad09ef4eca6 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:35:37.307655 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00145c7c-547c-4b69-b4fe-4c09ba239f2a service neutron] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:37.317316 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00145c7c-547c-4b69-b4fe-4c09ba239f2a service neutron] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:37.374138 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d329727-5009-4c34-a86c-7ab89e0a1260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:37.374847 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d329727-5009-4c34-a86c-7ab89e0a1260 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:37.375170 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d329727-5009-4c34-a86c-7ab89e0a1260 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:37.375449 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d329727-5009-4c34-a86c-7ab89e0a1260 admin admin] PATH_INFO: `/v3/users/df22d3b5035146b78e95a0fa2d7b46cd` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:37.376601 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d329727-5009-4c34-a86c-7ab89e0a1260 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df22d3b5035146b78e95a0fa2d7b46cd)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:37.378495 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d329727-5009-4c34-a86c-7ab89e0a1260 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:37.399807 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:35:37.423876 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-0d329727-5009-4c34-a86c-7ab89e0a1260 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df22d3b5035146b78e95a0fa2d7b46cd'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:37.430644 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-0d329727-5009-4c34-a86c-7ab89e0a1260 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df22d3b5035146b78e95a0fa2d7b46cd'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:37.437111 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-0d329727-5009-4c34-a86c-7ab89e0a1260 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df22d3b5035146b78e95a0fa2d7b46cd'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:37.437854 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-0d329727-5009-4c34-a86c-7ab89e0a1260 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df22d3b5035146b78e95a0fa2d7b46cd'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:37.450126 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-0d329727-5009-4c34-a86c-7ab89e0a1260 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df22d3b5035146b78e95a0fa2d7b46cd'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:37.455951 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1221/2454] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:35:37 2022] DELETE /identity/v3/users/df22d3b5035146b78e95a0fa2d7b46cd => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 03:35:37.945090 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64817c05-f61a-43ac-ab92-dbd17cca2d64 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:37.950898 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-64817c05-f61a-43ac-ab92-dbd17cca2d64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:37.961594 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:35:37.973079 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64817c05-f61a-43ac-ab92-dbd17cca2d64 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:38.053399 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce50c02-949c-4b91-adf2-e2dfb5f66da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:38.054102 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce50c02-949c-4b91-adf2-e2dfb5f66da9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:38.054475 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce50c02-949c-4b91-adf2-e2dfb5f66da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:38.054763 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce50c02-949c-4b91-adf2-e2dfb5f66da9 admin admin] PATH_INFO: `/v3/projects/6ca415d74d2241d9b12a0205dfa3ba0f` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:38.056078 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce50c02-949c-4b91-adf2-e2dfb5f66da9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ca415d74d2241d9b12a0205dfa3ba0f)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:38.057892 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce50c02-949c-4b91-adf2-e2dfb5f66da9 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:38.115447 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-cce50c02-949c-4b91-adf2-e2dfb5f66da9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ca415d74d2241d9b12a0205dfa3ba0f', 'request_id': 'req-cce50c02-949c-4b91-adf2-e2dfb5f66da9'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:38.124263 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-cce50c02-949c-4b91-adf2-e2dfb5f66da9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ca415d74d2241d9b12a0205dfa3ba0f', 'request_id': 'req-cce50c02-949c-4b91-adf2-e2dfb5f66da9'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:38.131780 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-cce50c02-949c-4b91-adf2-e2dfb5f66da9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ca415d74d2241d9b12a0205dfa3ba0f', 'request_id': 'req-cce50c02-949c-4b91-adf2-e2dfb5f66da9'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:38.149908 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-cce50c02-949c-4b91-adf2-e2dfb5f66da9 admin admin] The token cache is being invalidate because project 6ca415d74d2241d9b12a0205dfa3ba0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:35:38.150320 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-cce50c02-949c-4b91-adf2-e2dfb5f66da9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:38.151339 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-cce50c02-949c-4b91-adf2-e2dfb5f66da9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:38.155679 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1234/2455] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:35:37 2022] DELETE /identity/v3/projects/6ca415d74d2241d9b12a0205dfa3ba0f => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:35:38.158489 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ea581-4035-4d93-ad9d-4c726bce8a96 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:38.158960 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ea581-4035-4d93-ad9d-4c726bce8a96 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:38.159073 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ea581-4035-4d93-ad9d-4c726bce8a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:38.180890 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-078ea581-4035-4d93-ad9d-4c726bce8a96 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:35:38.182089 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-078ea581-4035-4d93-ad9d-4c726bce8a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:38.250670 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1222/2456] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:35:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:35:38.260044 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd05cf-d7ec-4443-8e9f-e115dd795825 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:38.260597 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd05cf-d7ec-4443-8e9f-e115dd795825 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:38.260683 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd05cf-d7ec-4443-8e9f-e115dd795825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:38.282921 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-ccfd05cf-d7ec-4443-8e9f-e115dd795825 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:35:38.284146 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-ccfd05cf-d7ec-4443-8e9f-e115dd795825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:38.293398 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1235/2457] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:35:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:35:38.297646 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078ea581-4035-4d93-ad9d-4c726bce8a96 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:38.307339 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078ea581-4035-4d93-ad9d-4c726bce8a96 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:38.314884 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b740352-02cb-40ee-ab28-55a04fe530d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:38.315579 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b740352-02cb-40ee-ab28-55a04fe530d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:38.315868 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b740352-02cb-40ee-ab28-55a04fe530d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:38.316205 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b740352-02cb-40ee-ab28-55a04fe530d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:38.317229 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b740352-02cb-40ee-ab28-55a04fe530d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:35:38.317768 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b740352-02cb-40ee-ab28-55a04fe530d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:38.320330 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b740352-02cb-40ee-ab28-55a04fe530d1 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:38.332575 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1223/2458] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 03:35:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:35:38.336953 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfd05cf-d7ec-4443-8e9f-e115dd795825 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:38.346853 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfd05cf-d7ec-4443-8e9f-e115dd795825 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:38.351511 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299d17d1-a284-4cb2-9148-af077edb02ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:38.352120 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d17d1-a284-4cb2-9148-af077edb02ad admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:38.352400 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d17d1-a284-4cb2-9148-af077edb02ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:38.352676 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d17d1-a284-4cb2-9148-af077edb02ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:38.353313 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299d17d1-a284-4cb2-9148-af077edb02ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:38.355847 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299d17d1-a284-4cb2-9148-af077edb02ad admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:38.384008 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1236/2459] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:35:38 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 03:35:38.388187 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b740352-02cb-40ee-ab28-55a04fe530d1 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:38.397952 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b740352-02cb-40ee-ab28-55a04fe530d1 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:38.456913 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5ba05d-9040-4290-b5cc-e0b810a8c4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:38.457512 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ba05d-9040-4290-b5cc-e0b810a8c4d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:38.457797 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ba05d-9040-4290-b5cc-e0b810a8c4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:38.458071 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ba05d-9040-4290-b5cc-e0b810a8c4d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:38.458690 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5ba05d-9040-4290-b5cc-e0b810a8c4d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:38.461331 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5ba05d-9040-4290-b5cc-e0b810a8c4d3 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:38.482495 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1224/2460] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:35:38 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 03:35:38.486625 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299d17d1-a284-4cb2-9148-af077edb02ad admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:38.497688 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299d17d1-a284-4cb2-9148-af077edb02ad admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:38.502350 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a20b9-cdfa-4920-b049-6a55e011bd02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:38.502946 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a20b9-cdfa-4920-b049-6a55e011bd02 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:38.503229 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a20b9-cdfa-4920-b049-6a55e011bd02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:38.503524 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a20b9-cdfa-4920-b049-6a55e011bd02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:38.504167 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5a20b9-cdfa-4920-b049-6a55e011bd02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:38.505744 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5a20b9-cdfa-4920-b049-6a55e011bd02 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:38.516020 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1237/2461] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:35:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 03:35:38.519898 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5ba05d-9040-4290-b5cc-e0b810a8c4d3 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:38.530141 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5ba05d-9040-4290-b5cc-e0b810a8c4d3 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:38.534693 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00853afb-b6e8-4f19-83df-66e17b8bfb05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:38.535269 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00853afb-b6e8-4f19-83df-66e17b8bfb05 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:38.535582 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00853afb-b6e8-4f19-83df-66e17b8bfb05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:38.535853 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00853afb-b6e8-4f19-83df-66e17b8bfb05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:38.536485 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00853afb-b6e8-4f19-83df-66e17b8bfb05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:38.538037 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00853afb-b6e8-4f19-83df-66e17b8bfb05 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:38.548258 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1225/2462] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:35:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 03:35:38.552102 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a20b9-cdfa-4920-b049-6a55e011bd02 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:38.562204 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a20b9-cdfa-4920-b049-6a55e011bd02 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:38.566824 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d83d219-5125-4033-ba07-bbd05ef83040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:38.567463 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d83d219-5125-4033-ba07-bbd05ef83040 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:38.567779 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d83d219-5125-4033-ba07-bbd05ef83040 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:38.568058 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d83d219-5125-4033-ba07-bbd05ef83040 admin admin] PATH_INFO: `/v3/projects/78496d05883b498399358336608082c0/users/43a6ce7dbcb14d1db92adb110d683624/roles/04d0e4575a28440eb4349b4a6565e8b8` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:38.583016 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d83d219-5125-4033-ba07-bbd05ef83040 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78496d05883b498399358336608082c0, user_id=43a6ce7dbcb14d1db92adb110d683624, role_id=04d0e4575a28440eb4349b4a6565e8b8)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:38.585712 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d83d219-5125-4033-ba07-bbd05ef83040 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:38.599363 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1238/2463] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:35:38 2022] PUT /identity/v3/projects/78496d05883b498399358336608082c0/users/43a6ce7dbcb14d1db92adb110d683624/roles/04d0e4575a28440eb4349b4a6565e8b8 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 03:35:38.610340 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0568a-e6a6-4ae5-b682-08847f9d751e None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:38.610621 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0568a-e6a6-4ae5-b682-08847f9d751e None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:38.610895 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0568a-e6a6-4ae5-b682-08847f9d751e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:38.618849 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:35:38.639640 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-f8a0568a-e6a6-4ae5-b682-08847f9d751e None None] MFA Rules not processed for user `43a6ce7dbcb14d1db92adb110d683624`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:35:38.640827 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-f8a0568a-e6a6-4ae5-b682-08847f9d751e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:38.704324 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1226/2464] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:35:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:35:38.716332 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d83d219-5125-4033-ba07-bbd05ef83040 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:38.718024 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-0d83d219-5125-4033-ba07-bbd05ef83040 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:38.752931 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:35:38.781405 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d83d219-5125-4033-ba07-bbd05ef83040 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:38.785072 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956ad6ba-3dfd-4b7f-9e9a-394153da7a4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f537aabf3d1040ff840b02616f839975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:38.785674 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ad6ba-3dfd-4b7f-9e9a-394153da7a4b service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:38.785960 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ad6ba-3dfd-4b7f-9e9a-394153da7a4b service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:38.786238 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ad6ba-3dfd-4b7f-9e9a-394153da7a4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:38.794580 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956ad6ba-3dfd-4b7f-9e9a-394153da7a4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:38.796067 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956ad6ba-3dfd-4b7f-9e9a-394153da7a4b service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:38.804977 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1239/2465] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:35:38 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:35:38.824165 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a0568a-e6a6-4ae5-b682-08847f9d751e None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:38.886980 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a0568a-e6a6-4ae5-b682-08847f9d751e None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:38.891611 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65190442-5bb5-4f66-9b68-bdb89b7518f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:38.892231 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65190442-5bb5-4f66-9b68-bdb89b7518f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:38.892513 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65190442-5bb5-4f66-9b68-bdb89b7518f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:38.892785 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65190442-5bb5-4f66-9b68-bdb89b7518f9 admin admin] PATH_INFO: `/v3/users/43a6ce7dbcb14d1db92adb110d683624` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:38.893902 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65190442-5bb5-4f66-9b68-bdb89b7518f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43a6ce7dbcb14d1db92adb110d683624)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:38.895844 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65190442-5bb5-4f66-9b68-bdb89b7518f9 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:38.942030 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-65190442-5bb5-4f66-9b68-bdb89b7518f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43a6ce7dbcb14d1db92adb110d683624'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:38.949921 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-65190442-5bb5-4f66-9b68-bdb89b7518f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43a6ce7dbcb14d1db92adb110d683624'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:38.957371 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-65190442-5bb5-4f66-9b68-bdb89b7518f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43a6ce7dbcb14d1db92adb110d683624'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:38.958001 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-65190442-5bb5-4f66-9b68-bdb89b7518f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43a6ce7dbcb14d1db92adb110d683624'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:38.970387 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-65190442-5bb5-4f66-9b68-bdb89b7518f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43a6ce7dbcb14d1db92adb110d683624'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:38.976215 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1227/2466] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:35:38 2022] DELETE /identity/v3/users/43a6ce7dbcb14d1db92adb110d683624 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:35:38.981031 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d24048-becb-4550-a78b-0a534b79fc0c None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:38.981367 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d24048-becb-4550-a78b-0a534b79fc0c None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:38.981643 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d24048-becb-4550-a78b-0a534b79fc0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:39.001260 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-89d24048-becb-4550-a78b-0a534b79fc0c None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:35:39.002462 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-89d24048-becb-4550-a78b-0a534b79fc0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:39.059995 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1240/2467] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:35:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:35:39.069890 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65190442-5bb5-4f66-9b68-bdb89b7518f9 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:39.071283 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-65190442-5bb5-4f66-9b68-bdb89b7518f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:39.085518 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:35:39.130610 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65190442-5bb5-4f66-9b68-bdb89b7518f9 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:39.134600 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960a9cd2-b60b-4046-94df-11158c7929f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:39.135201 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a9cd2-b60b-4046-94df-11158c7929f4 service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:39.135501 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a9cd2-b60b-4046-94df-11158c7929f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:39.135809 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a9cd2-b60b-4046-94df-11158c7929f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:39.145191 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960a9cd2-b60b-4046-94df-11158c7929f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:39.146592 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960a9cd2-b60b-4046-94df-11158c7929f4 service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:39.156809 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1228/2468] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:35:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:35:39.326158 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d24048-becb-4550-a78b-0a534b79fc0c None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:39.336233 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d24048-becb-4550-a78b-0a534b79fc0c None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:39.340831 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63672622-3efe-4a94-9fa4-f6574710a552 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:39.341438 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63672622-3efe-4a94-9fa4-f6574710a552 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:39.341722 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63672622-3efe-4a94-9fa4-f6574710a552 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:39.341998 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63672622-3efe-4a94-9fa4-f6574710a552 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:39.343813 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-63672622-3efe-4a94-9fa4-f6574710a552 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:39.356761 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63672622-3efe-4a94-9fa4-f6574710a552 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:39.358181 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63672622-3efe-4a94-9fa4-f6574710a552 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:39.368247 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1241/2469] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:35:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:35:39.439972 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960a9cd2-b60b-4046-94df-11158c7929f4 service neutron] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:39.441444 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-960a9cd2-b60b-4046-94df-11158c7929f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:39.462763 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960a9cd2-b60b-4046-94df-11158c7929f4 service neutron] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:39.477857 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac0271b-77d5-4acd-89e0-17abcc28150c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:39.478493 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0271b-77d5-4acd-89e0-17abcc28150c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:39.478773 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0271b-77d5-4acd-89e0-17abcc28150c admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:39.479048 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0271b-77d5-4acd-89e0-17abcc28150c admin admin] PATH_INFO: `/v3/projects/78496d05883b498399358336608082c0` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:39.480231 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac0271b-77d5-4acd-89e0-17abcc28150c admin admin] RBAC: Authorizing `identity:delete_project(project_id=78496d05883b498399358336608082c0)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:39.482125 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac0271b-77d5-4acd-89e0-17abcc28150c admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:39.530272 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-5ac0271b-77d5-4acd-89e0-17abcc28150c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78496d05883b498399358336608082c0', 'request_id': 'req-5ac0271b-77d5-4acd-89e0-17abcc28150c'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:39.536128 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-5ac0271b-77d5-4acd-89e0-17abcc28150c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78496d05883b498399358336608082c0', 'request_id': 'req-5ac0271b-77d5-4acd-89e0-17abcc28150c'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:39.542461 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-5ac0271b-77d5-4acd-89e0-17abcc28150c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78496d05883b498399358336608082c0', 'request_id': 'req-5ac0271b-77d5-4acd-89e0-17abcc28150c'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:39.555012 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-5ac0271b-77d5-4acd-89e0-17abcc28150c admin admin] The token cache is being invalidate because project 78496d05883b498399358336608082c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:35:39.555327 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-5ac0271b-77d5-4acd-89e0-17abcc28150c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:39.555978 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-5ac0271b-77d5-4acd-89e0-17abcc28150c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:39.557494 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1229/2470] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:35:39 2022] DELETE /identity/v3/projects/78496d05883b498399358336608082c0 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:35:39.562949 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de0b20-14a5-4dc3-95e3-02c8f0c73dc0 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:39.563521 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de0b20-14a5-4dc3-95e3-02c8f0c73dc0 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:39.564010 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de0b20-14a5-4dc3-95e3-02c8f0c73dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:39.584849 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-77de0b20-14a5-4dc3-95e3-02c8f0c73dc0 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:35:39.586089 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-77de0b20-14a5-4dc3-95e3-02c8f0c73dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:39.656970 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1242/2471] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:35:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 03:35:39.664602 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cba48b-3a14-4c7f-93c9-c66a7f5ff141 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:39.664889 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cba48b-3a14-4c7f-93c9-c66a7f5ff141 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:39.665164 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cba48b-3a14-4c7f-93c9-c66a7f5ff141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:39.685683 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-d8cba48b-3a14-4c7f-93c9-c66a7f5ff141 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:35:39.686870 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-d8cba48b-3a14-4c7f-93c9-c66a7f5ff141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:39.694944 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1230/2472] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:35:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:35:39.699375 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77de0b20-14a5-4dc3-95e3-02c8f0c73dc0 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:39.708905 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77de0b20-14a5-4dc3-95e3-02c8f0c73dc0 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:39.713443 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ae0760-588d-4567-a7f0-d19c0a747a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:39.714061 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae0760-588d-4567-a7f0-d19c0a747a60 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:39.714419 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae0760-588d-4567-a7f0-d19c0a747a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:39.714699 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae0760-588d-4567-a7f0-d19c0a747a60 admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:39.715342 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ae0760-588d-4567-a7f0-d19c0a747a60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:35:39.715780 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ae0760-588d-4567-a7f0-d19c0a747a60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:39.717365 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ae0760-588d-4567-a7f0-d19c0a747a60 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:39.728978 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1243/2473] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 03:35:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:35:39.733753 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cba48b-3a14-4c7f-93c9-c66a7f5ff141 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:39.742837 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cba48b-3a14-4c7f-93c9-c66a7f5ff141 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:39.747752 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6677b5d-273f-4c5d-aa66-3bf21e35775d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:39.748350 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6677b5d-273f-4c5d-aa66-3bf21e35775d admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:39.748631 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6677b5d-273f-4c5d-aa66-3bf21e35775d admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:39.748904 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6677b5d-273f-4c5d-aa66-3bf21e35775d admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:39.749535 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6677b5d-273f-4c5d-aa66-3bf21e35775d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:39.751409 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6677b5d-273f-4c5d-aa66-3bf21e35775d admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:39.779050 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1231/2474] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:35:39 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:35:39.783170 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ae0760-588d-4567-a7f0-d19c0a747a60 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:39.795751 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ae0760-588d-4567-a7f0-d19c0a747a60 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:39.849855 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:35:39.864642 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4088ae8c-f1e2-41ba-b6b1-95ddfdb58216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:39.865340 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4088ae8c-f1e2-41ba-b6b1-95ddfdb58216 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:39.865798 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4088ae8c-f1e2-41ba-b6b1-95ddfdb58216 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:39.866138 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4088ae8c-f1e2-41ba-b6b1-95ddfdb58216 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:39.866842 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4088ae8c-f1e2-41ba-b6b1-95ddfdb58216 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:39.868866 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4088ae8c-f1e2-41ba-b6b1-95ddfdb58216 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:39.896377 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1244/2475] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:35:39 2022] POST /identity/v3/users => generated 288 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:35:39.897811 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6677b5d-273f-4c5d-aa66-3bf21e35775d admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:39.909427 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6677b5d-273f-4c5d-aa66-3bf21e35775d admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:39.914191 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8ddf1f-5ae3-4d1f-9d6d-59713cd9f49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:39.914802 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ddf1f-5ae3-4d1f-9d6d-59713cd9f49a admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:39.915085 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ddf1f-5ae3-4d1f-9d6d-59713cd9f49a admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:39.915359 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ddf1f-5ae3-4d1f-9d6d-59713cd9f49a admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:39.916126 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8ddf1f-5ae3-4d1f-9d6d-59713cd9f49a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:39.917844 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8ddf1f-5ae3-4d1f-9d6d-59713cd9f49a admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:39.928239 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1232/2476] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 03:35:39.932301 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4088ae8c-f1e2-41ba-b6b1-95ddfdb58216 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:39.943012 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4088ae8c-f1e2-41ba-b6b1-95ddfdb58216 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:39.948245 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f7cb84-1b49-4833-b5ea-2231865bbf42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:39.949478 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f7cb84-1b49-4833-b5ea-2231865bbf42 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:39.949880 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f7cb84-1b49-4833-b5ea-2231865bbf42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:39.950225 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f7cb84-1b49-4833-b5ea-2231865bbf42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:39.950956 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f7cb84-1b49-4833-b5ea-2231865bbf42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:39.952667 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f7cb84-1b49-4833-b5ea-2231865bbf42 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:39.963743 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1245/2477] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:35:39.968144 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8ddf1f-5ae3-4d1f-9d6d-59713cd9f49a admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:39.978039 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8ddf1f-5ae3-4d1f-9d6d-59713cd9f49a admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:39.982861 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e58e9c-9b19-405a-b73c-853a9cfe7a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:39.983598 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e58e9c-9b19-405a-b73c-853a9cfe7a1f admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:39.983883 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e58e9c-9b19-405a-b73c-853a9cfe7a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:39.984157 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e58e9c-9b19-405a-b73c-853a9cfe7a1f admin admin] PATH_INFO: `/v3/projects/41be55876eef4e89b28e19eb0dce554d/users/24ed2816e14c48beaf68874b3d96095b/roles/04d0e4575a28440eb4349b4a6565e8b8` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:39.999649 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e58e9c-9b19-405a-b73c-853a9cfe7a1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=41be55876eef4e89b28e19eb0dce554d, user_id=24ed2816e14c48beaf68874b3d96095b, role_id=04d0e4575a28440eb4349b4a6565e8b8)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:40.002488 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e58e9c-9b19-405a-b73c-853a9cfe7a1f admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:40.016569 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1233/2478] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:35:39 2022] PUT /identity/v3/projects/41be55876eef4e89b28e19eb0dce554d/users/24ed2816e14c48beaf68874b3d96095b/roles/04d0e4575a28440eb4349b4a6565e8b8 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:35:40.027583 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0538456-b069-49a2-a2cf-7cf8d6cafb19 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:40.027988 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0538456-b069-49a2-a2cf-7cf8d6cafb19 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:40.028167 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0538456-b069-49a2-a2cf-7cf8d6cafb19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:40.055849 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-d0538456-b069-49a2-a2cf-7cf8d6cafb19 None None] MFA Rules not processed for user `24ed2816e14c48beaf68874b3d96095b`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:35:40.057055 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-d0538456-b069-49a2-a2cf-7cf8d6cafb19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:40.122856 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1246/2479] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:35:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:35:40.133624 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e58e9c-9b19-405a-b73c-853a9cfe7a1f admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:40.135280 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-32e58e9c-9b19-405a-b73c-853a9cfe7a1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:40.176228 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:35:40.195632 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e58e9c-9b19-405a-b73c-853a9cfe7a1f admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:40.199246 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0056b86b-2dff-4117-a402-67ecbd3e5d30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f537aabf3d1040ff840b02616f839975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:40.199870 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0056b86b-2dff-4117-a402-67ecbd3e5d30 service cinder] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:40.200150 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0056b86b-2dff-4117-a402-67ecbd3e5d30 service cinder] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:40.200423 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0056b86b-2dff-4117-a402-67ecbd3e5d30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:40.208876 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0056b86b-2dff-4117-a402-67ecbd3e5d30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:40.210286 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0056b86b-2dff-4117-a402-67ecbd3e5d30 service cinder] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:40.220040 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1234/2480] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:35:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:35:42.431214 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0538456-b069-49a2-a2cf-7cf8d6cafb19 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:42.433144 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-d0538456-b069-49a2-a2cf-7cf8d6cafb19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:42.522888 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0056b86b-2dff-4117-a402-67ecbd3e5d30 service cinder] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:42.524541 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-0056b86b-2dff-4117-a402-67ecbd3e5d30 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:42.548128 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0538456-b069-49a2-a2cf-7cf8d6cafb19 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:42.554578 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e167e-a1be-4964-b83e-260c04041c08 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94513f6cd19f495e842deb3c13c3e4d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:42.555476 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e167e-a1be-4964-b83e-260c04041c08 service placement] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:42.555878 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e167e-a1be-4964-b83e-260c04041c08 service placement] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:42.556244 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e167e-a1be-4964-b83e-260c04041c08 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:42.558169 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-372e167e-a1be-4964-b83e-260c04041c08 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:42.575386 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372e167e-a1be-4964-b83e-260c04041c08 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:42.578029 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372e167e-a1be-4964-b83e-260c04041c08 service placement] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:42.591515 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1247/2481] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:35:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:35:42.613311 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0056b86b-2dff-4117-a402-67ecbd3e5d30 service cinder] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:42.618011 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42775b8-62bb-49de-9db0-528694ec5966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:42.618659 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42775b8-62bb-49de-9db0-528694ec5966 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:42.618942 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42775b8-62bb-49de-9db0-528694ec5966 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:42.619217 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42775b8-62bb-49de-9db0-528694ec5966 admin admin] PATH_INFO: `/v3/users/b8795829c34046628cae345dd4d45e75` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:42.620688 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42775b8-62bb-49de-9db0-528694ec5966 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8795829c34046628cae345dd4d45e75)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:42.622573 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42775b8-62bb-49de-9db0-528694ec5966 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:42.672033 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-f42775b8-62bb-49de-9db0-528694ec5966 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8795829c34046628cae345dd4d45e75'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:42.679179 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-f42775b8-62bb-49de-9db0-528694ec5966 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8795829c34046628cae345dd4d45e75'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:42.686061 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-f42775b8-62bb-49de-9db0-528694ec5966 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8795829c34046628cae345dd4d45e75'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:42.686768 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-f42775b8-62bb-49de-9db0-528694ec5966 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8795829c34046628cae345dd4d45e75'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:42.699859 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-f42775b8-62bb-49de-9db0-528694ec5966 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8795829c34046628cae345dd4d45e75'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:42.705487 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1235/2482] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:35:42 2022] DELETE /identity/v3/users/b8795829c34046628cae345dd4d45e75 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:35:42.872645 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e167e-a1be-4964-b83e-260c04041c08 service placement] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:42.883272 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e167e-a1be-4964-b83e-260c04041c08 service placement] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:42.926055 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:35:42.942952 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dd4ff4-08d1-4407-b0aa-8cbe99a37d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:42.943610 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd4ff4-08d1-4407-b0aa-8cbe99a37d96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:42.944149 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd4ff4-08d1-4407-b0aa-8cbe99a37d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:42.944425 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd4ff4-08d1-4407-b0aa-8cbe99a37d96 admin admin] PATH_INFO: `/v3/projects/a8d6ee89cb464afa95e222b2a1e7279b` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:42.945531 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dd4ff4-08d1-4407-b0aa-8cbe99a37d96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8d6ee89cb464afa95e222b2a1e7279b)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:42.947817 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dd4ff4-08d1-4407-b0aa-8cbe99a37d96 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:42.993814 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-d3dd4ff4-08d1-4407-b0aa-8cbe99a37d96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8d6ee89cb464afa95e222b2a1e7279b', 'request_id': 'req-d3dd4ff4-08d1-4407-b0aa-8cbe99a37d96'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:43.000196 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-d3dd4ff4-08d1-4407-b0aa-8cbe99a37d96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8d6ee89cb464afa95e222b2a1e7279b', 'request_id': 'req-d3dd4ff4-08d1-4407-b0aa-8cbe99a37d96'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:43.006548 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-d3dd4ff4-08d1-4407-b0aa-8cbe99a37d96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8d6ee89cb464afa95e222b2a1e7279b', 'request_id': 'req-d3dd4ff4-08d1-4407-b0aa-8cbe99a37d96'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:43.019610 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-d3dd4ff4-08d1-4407-b0aa-8cbe99a37d96 admin admin] The token cache is being invalidate because project a8d6ee89cb464afa95e222b2a1e7279b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:35:43.019903 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-d3dd4ff4-08d1-4407-b0aa-8cbe99a37d96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:43.020526 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-d3dd4ff4-08d1-4407-b0aa-8cbe99a37d96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:43.022012 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1248/2483] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:35:42 2022] DELETE /identity/v3/projects/a8d6ee89cb464afa95e222b2a1e7279b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:35:43.027247 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da98e9-a5fb-4f9d-ad48-d45fafec625c None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:43.027559 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da98e9-a5fb-4f9d-ad48-d45fafec625c None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:43.027836 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da98e9-a5fb-4f9d-ad48-d45fafec625c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:43.046856 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-62da98e9-a5fb-4f9d-ad48-d45fafec625c None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:35:43.048063 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-62da98e9-a5fb-4f9d-ad48-d45fafec625c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:43.098002 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:35:43.114726 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1236/2484] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:35:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:35:43.117374 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab2c263-6dbd-4dfc-92a6-8aeaa8705f52 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:43.117659 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab2c263-6dbd-4dfc-92a6-8aeaa8705f52 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:43.117934 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab2c263-6dbd-4dfc-92a6-8aeaa8705f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:43.137799 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-cab2c263-6dbd-4dfc-92a6-8aeaa8705f52 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:35:43.138986 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-cab2c263-6dbd-4dfc-92a6-8aeaa8705f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:43.146678 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1249/2485] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:35:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:35:43.150960 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62da98e9-a5fb-4f9d-ad48-d45fafec625c None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:43.161117 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62da98e9-a5fb-4f9d-ad48-d45fafec625c None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:43.165710 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff9a0b-b23e-43b1-ada1-d0ef02dc0418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:43.166300 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff9a0b-b23e-43b1-ada1-d0ef02dc0418 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:43.166584 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff9a0b-b23e-43b1-ada1-d0ef02dc0418 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:43.166860 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff9a0b-b23e-43b1-ada1-d0ef02dc0418 admin admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:43.167726 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ff9a0b-b23e-43b1-ada1-d0ef02dc0418 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:35:43.168039 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ff9a0b-b23e-43b1-ada1-d0ef02dc0418 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:43.169631 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ff9a0b-b23e-43b1-ada1-d0ef02dc0418 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:43.180902 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1237/2486] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 03:35:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:35:43.185383 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab2c263-6dbd-4dfc-92a6-8aeaa8705f52 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:43.194886 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab2c263-6dbd-4dfc-92a6-8aeaa8705f52 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:43.200242 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43305c78-f51b-4c00-9674-c3e3b06965e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:43.200835 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43305c78-f51b-4c00-9674-c3e3b06965e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:43.201116 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43305c78-f51b-4c00-9674-c3e3b06965e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:43.201388 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43305c78-f51b-4c00-9674-c3e3b06965e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:43.202026 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43305c78-f51b-4c00-9674-c3e3b06965e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:43.203965 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43305c78-f51b-4c00-9674-c3e3b06965e4 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:43.231458 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1250/2487] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:35:43 2022] POST /identity/v3/projects => generated 405 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 03:35:43.235500 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff9a0b-b23e-43b1-ada1-d0ef02dc0418 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:43.245566 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff9a0b-b23e-43b1-ada1-d0ef02dc0418 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:43.306967 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4907cdb8-72ad-4706-a1ec-c4dbe5361330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:43.307606 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907cdb8-72ad-4706-a1ec-c4dbe5361330 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:43.307895 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907cdb8-72ad-4706-a1ec-c4dbe5361330 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:43.308173 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907cdb8-72ad-4706-a1ec-c4dbe5361330 admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:43.308809 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4907cdb8-72ad-4706-a1ec-c4dbe5361330 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:43.310738 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4907cdb8-72ad-4706-a1ec-c4dbe5361330 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:43.331359 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1238/2488] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:35:43 2022] POST /identity/v3/users => generated 303 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 03:35:43.335528 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43305c78-f51b-4c00-9674-c3e3b06965e4 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:43.346407 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43305c78-f51b-4c00-9674-c3e3b06965e4 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:43.351023 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6e13ab-5507-403f-9675-f3206a465b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:43.351585 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e13ab-5507-403f-9675-f3206a465b0b admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:43.351864 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e13ab-5507-403f-9675-f3206a465b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:43.352133 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e13ab-5507-403f-9675-f3206a465b0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:43.352765 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6e13ab-5507-403f-9675-f3206a465b0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:43.354323 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6e13ab-5507-403f-9675-f3206a465b0b admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:43.364238 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1251/2489] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:35:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 03:35:43.367963 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4907cdb8-72ad-4706-a1ec-c4dbe5361330 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:43.378405 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4907cdb8-72ad-4706-a1ec-c4dbe5361330 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:43.383055 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aa2b37-d2d9-4aa1-8cd5-89ed0ba94d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:43.383685 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa2b37-d2d9-4aa1-8cd5-89ed0ba94d68 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:43.383968 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa2b37-d2d9-4aa1-8cd5-89ed0ba94d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:43.384242 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa2b37-d2d9-4aa1-8cd5-89ed0ba94d68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:43.384882 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aa2b37-d2d9-4aa1-8cd5-89ed0ba94d68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:43.386991 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aa2b37-d2d9-4aa1-8cd5-89ed0ba94d68 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:43.397406 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1239/2490] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:35:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:35:43.402413 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6e13ab-5507-403f-9675-f3206a465b0b admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:43.412935 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6e13ab-5507-403f-9675-f3206a465b0b admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:43.417777 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69f6446-ea8b-4a12-a031-729e26d2d9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:43.418429 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f6446-ea8b-4a12-a031-729e26d2d9c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:43.418716 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f6446-ea8b-4a12-a031-729e26d2d9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:43.418992 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f6446-ea8b-4a12-a031-729e26d2d9c9 admin admin] PATH_INFO: `/v3/projects/de6a051afc624ae6a68b27c03a6fc9c4/users/ad55e3ba2d4c4df094b4e8f77d28a115/roles/04d0e4575a28440eb4349b4a6565e8b8` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:43.433867 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69f6446-ea8b-4a12-a031-729e26d2d9c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de6a051afc624ae6a68b27c03a6fc9c4, user_id=ad55e3ba2d4c4df094b4e8f77d28a115, role_id=04d0e4575a28440eb4349b4a6565e8b8)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:43.436593 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69f6446-ea8b-4a12-a031-729e26d2d9c9 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:43.453536 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1252/2491] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:35:43 2022] PUT /identity/v3/projects/de6a051afc624ae6a68b27c03a6fc9c4/users/ad55e3ba2d4c4df094b4e8f77d28a115/roles/04d0e4575a28440eb4349b4a6565e8b8 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:35:43.458539 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aa2b37-d2d9-4aa1-8cd5-89ed0ba94d68 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:43.460274 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-62aa2b37-d2d9-4aa1-8cd5-89ed0ba94d68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:43.463754 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49231968-9ca1-435e-a9ff-2ddff241c610 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:43.464669 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49231968-9ca1-435e-a9ff-2ddff241c610 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:43.464946 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49231968-9ca1-435e-a9ff-2ddff241c610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:43.473867 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aa2b37-d2d9-4aa1-8cd5-89ed0ba94d68 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:43.493130 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-49231968-9ca1-435e-a9ff-2ddff241c610 None None] MFA Rules not processed for user `ad55e3ba2d4c4df094b4e8f77d28a115`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:35:43.494326 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-49231968-9ca1-435e-a9ff-2ddff241c610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:43.530565 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c59a46-3cce-4ee6-8162-34a3cada07bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:43.531181 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c59a46-3cce-4ee6-8162-34a3cada07bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:43.531458 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c59a46-3cce-4ee6-8162-34a3cada07bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:43.531764 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c59a46-3cce-4ee6-8162-34a3cada07bd admin admin] PATH_INFO: `/v3/users/24ed2816e14c48beaf68874b3d96095b` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:43.532914 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c59a46-3cce-4ee6-8162-34a3cada07bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=24ed2816e14c48beaf68874b3d96095b)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:43.534893 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c59a46-3cce-4ee6-8162-34a3cada07bd admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:43.558156 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:35:43.562444 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1253/2492] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:35:43 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 03:35:43.567052 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49231968-9ca1-435e-a9ff-2ddff241c610 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:43.578562 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49231968-9ca1-435e-a9ff-2ddff241c610 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:43.583743 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c2f8f-3e87-41f9-a49b-5c29d711db96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:43.584605 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c2f8f-3e87-41f9-a49b-5c29d711db96 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:43.584870 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c2f8f-3e87-41f9-a49b-5c29d711db96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:43.585140 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c2f8f-3e87-41f9-a49b-5c29d711db96 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:43.585767 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7c2f8f-3e87-41f9-a49b-5c29d711db96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:43.586140 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-31c59a46-3cce-4ee6-8162-34a3cada07bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24ed2816e14c48beaf68874b3d96095b'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:43.587733 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7c2f8f-3e87-41f9-a49b-5c29d711db96 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:43.594020 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-31c59a46-3cce-4ee6-8162-34a3cada07bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24ed2816e14c48beaf68874b3d96095b'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:43.601444 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-31c59a46-3cce-4ee6-8162-34a3cada07bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24ed2816e14c48beaf68874b3d96095b'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:43.602004 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-31c59a46-3cce-4ee6-8162-34a3cada07bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24ed2816e14c48beaf68874b3d96095b'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:43.604132 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:35:43.614843 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1254/2493] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:35:43 2022] POST /identity/v3/projects => generated 405 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 03:35:43.616488 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-31c59a46-3cce-4ee6-8162-34a3cada07bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24ed2816e14c48beaf68874b3d96095b'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:43.618765 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c2f8f-3e87-41f9-a49b-5c29d711db96 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:43.621058 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-7b7c2f8f-3e87-41f9-a49b-5c29d711db96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:43.623152 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1240/2494] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:35:43 2022] DELETE /identity/v3/users/24ed2816e14c48beaf68874b3d96095b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:35:43.627118 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bda41e-70bc-418a-849a-2de829f3d827 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:43.627434 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bda41e-70bc-418a-849a-2de829f3d827 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:43.627732 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bda41e-70bc-418a-849a-2de829f3d827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:43.653359 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-73bda41e-70bc-418a-849a-2de829f3d827 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:35:43.654562 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-73bda41e-70bc-418a-849a-2de829f3d827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:43.689963 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c2f8f-3e87-41f9-a49b-5c29d711db96 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:43.715099 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1241/2495] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:35:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:35:43.728788 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bda41e-70bc-418a-849a-2de829f3d827 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:43.730544 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-73bda41e-70bc-418a-849a-2de829f3d827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:43.758954 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c145c3f-adca-4879-ad63-01ed2812dd04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:43.759622 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c145c3f-adca-4879-ad63-01ed2812dd04 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:43.759966 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c145c3f-adca-4879-ad63-01ed2812dd04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:43.760186 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c145c3f-adca-4879-ad63-01ed2812dd04 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:43.762724 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c145c3f-adca-4879-ad63-01ed2812dd04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:43.764757 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c145c3f-adca-4879-ad63-01ed2812dd04 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:43.791575 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1255/2496] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:35:43 2022] POST /identity/v3/users => generated 309 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 03:35:43.792707 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c145c3f-adca-4879-ad63-01ed2812dd04 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:43.797154 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bda41e-70bc-418a-849a-2de829f3d827 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:43.801016 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd09c2b-d57d-4d8d-b40b-041115f0bda9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:43.801633 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd09c2b-d57d-4d8d-b40b-041115f0bda9 service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:43.801917 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd09c2b-d57d-4d8d-b40b-041115f0bda9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:43.802194 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd09c2b-d57d-4d8d-b40b-041115f0bda9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:43.803306 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c145c3f-adca-4879-ad63-01ed2812dd04 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:43.808552 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dbad5b-4df2-45a3-b7c0-998860332352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:43.809227 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dbad5b-4df2-45a3-b7c0-998860332352 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:43.809509 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dbad5b-4df2-45a3-b7c0-998860332352 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:43.809776 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dbad5b-4df2-45a3-b7c0-998860332352 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:43.810533 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dbad5b-4df2-45a3-b7c0-998860332352 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:43.812152 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dbad5b-4df2-45a3-b7c0-998860332352 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:43.812324 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd09c2b-d57d-4d8d-b40b-041115f0bda9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:43.813953 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd09c2b-d57d-4d8d-b40b-041115f0bda9 service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:43.826632 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1256/2497] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:35:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:35:43.826805 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1242/2498] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:35:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:35:43.828477 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dbad5b-4df2-45a3-b7c0-998860332352 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:43.838397 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dbad5b-4df2-45a3-b7c0-998860332352 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:43.843695 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eceb44-d05b-45a1-9466-281d0c89e843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:43.844446 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eceb44-d05b-45a1-9466-281d0c89e843 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:43.844806 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eceb44-d05b-45a1-9466-281d0c89e843 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:43.845692 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eceb44-d05b-45a1-9466-281d0c89e843 admin admin] PATH_INFO: `/v3/projects/bbab341aac9b4ea0b9b667c710bfc102/users/aabf4356251c4f52adc524f3e40a0a0b/roles/fe9379cda35c4ff78576fe48b60bea3c` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:43.862661 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eceb44-d05b-45a1-9466-281d0c89e843 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbab341aac9b4ea0b9b667c710bfc102, user_id=aabf4356251c4f52adc524f3e40a0a0b, role_id=fe9379cda35c4ff78576fe48b60bea3c)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:43.865416 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eceb44-d05b-45a1-9466-281d0c89e843 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:43.880111 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1257/2499] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:35:43 2022] PUT /identity/v3/projects/bbab341aac9b4ea0b9b667c710bfc102/users/aabf4356251c4f52adc524f3e40a0a0b/roles/fe9379cda35c4ff78576fe48b60bea3c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:35:43.884231 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd09c2b-d57d-4d8d-b40b-041115f0bda9 service neutron] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:43.895119 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd09c2b-d57d-4d8d-b40b-041115f0bda9 service neutron] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:43.956216 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7bcc98-e103-4879-b830-8931e38926f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:43.957174 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7bcc98-e103-4879-b830-8931e38926f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:43.957452 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7bcc98-e103-4879-b830-8931e38926f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:43.957723 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7bcc98-e103-4879-b830-8931e38926f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:43.958356 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7bcc98-e103-4879-b830-8931e38926f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:43.960014 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7bcc98-e103-4879-b830-8931e38926f4 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:43.971020 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1243/2500] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:35:43 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:35:43.975188 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eceb44-d05b-45a1-9466-281d0c89e843 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:43.986049 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eceb44-d05b-45a1-9466-281d0c89e843 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:43.992118 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9386b0a-9cc6-4be3-a0e7-c05a24d37ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:43.992593 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9386b0a-9cc6-4be3-a0e7-c05a24d37ab9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:43.992977 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9386b0a-9cc6-4be3-a0e7-c05a24d37ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:43.993376 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9386b0a-9cc6-4be3-a0e7-c05a24d37ab9 admin admin] PATH_INFO: `/v3/projects/bbab341aac9b4ea0b9b667c710bfc102/users/aabf4356251c4f52adc524f3e40a0a0b/roles/fe9379cda35c4ff78576fe48b60bea3c` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:43.995940 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9386b0a-9cc6-4be3-a0e7-c05a24d37ab9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbab341aac9b4ea0b9b667c710bfc102, user_id=aabf4356251c4f52adc524f3e40a0a0b, role_id=fe9379cda35c4ff78576fe48b60bea3c)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:43.998629 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9386b0a-9cc6-4be3-a0e7-c05a24d37ab9 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:44.009909 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1258/2501] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:35:43 2022] PUT /identity/v3/projects/bbab341aac9b4ea0b9b667c710bfc102/users/aabf4356251c4f52adc524f3e40a0a0b/roles/fe9379cda35c4ff78576fe48b60bea3c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:35:44.021077 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ca2d3-59d8-4266-977e-9e892433bc8e None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:44.021381 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ca2d3-59d8-4266-977e-9e892433bc8e None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:44.021776 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ca2d3-59d8-4266-977e-9e892433bc8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:44.050831 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-2e5ca2d3-59d8-4266-977e-9e892433bc8e None None] MFA Rules not processed for user `aabf4356251c4f52adc524f3e40a0a0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:35:44.052079 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-2e5ca2d3-59d8-4266-977e-9e892433bc8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:44.061712 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:35:44.121068 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9386b0a-9cc6-4be3-a0e7-c05a24d37ab9 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:44.123047 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-d9386b0a-9cc6-4be3-a0e7-c05a24d37ab9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:44.129830 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1244/2502] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:35:44 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:35:44.150384 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5ca2d3-59d8-4266-977e-9e892433bc8e None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:44.152257 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-2e5ca2d3-59d8-4266-977e-9e892433bc8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:44.158795 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:35:44.198767 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9386b0a-9cc6-4be3-a0e7-c05a24d37ab9 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:44.203397 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601109cd-fc5a-4da1-9d2c-6a14e49eb2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:44.204053 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601109cd-fc5a-4da1-9d2c-6a14e49eb2fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:44.204474 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601109cd-fc5a-4da1-9d2c-6a14e49eb2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:44.204747 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601109cd-fc5a-4da1-9d2c-6a14e49eb2fd admin admin] PATH_INFO: `/v3/projects/41be55876eef4e89b28e19eb0dce554d` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:44.206101 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601109cd-fc5a-4da1-9d2c-6a14e49eb2fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=41be55876eef4e89b28e19eb0dce554d)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:44.208146 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601109cd-fc5a-4da1-9d2c-6a14e49eb2fd admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:44.210059 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5ca2d3-59d8-4266-977e-9e892433bc8e None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:44.213654 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32406ffc-c857-407d-bee6-cd20173783eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f537aabf3d1040ff840b02616f839975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:44.214274 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32406ffc-c857-407d-bee6-cd20173783eb service cinder] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:44.214548 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32406ffc-c857-407d-bee6-cd20173783eb service cinder] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:44.214814 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32406ffc-c857-407d-bee6-cd20173783eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:44.223766 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32406ffc-c857-407d-bee6-cd20173783eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:44.225168 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32406ffc-c857-407d-bee6-cd20173783eb service cinder] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:44.236076 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1245/2503] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:35:44 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 03:35:44.255980 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-601109cd-fc5a-4da1-9d2c-6a14e49eb2fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41be55876eef4e89b28e19eb0dce554d', 'request_id': 'req-601109cd-fc5a-4da1-9d2c-6a14e49eb2fd'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:44.261782 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-601109cd-fc5a-4da1-9d2c-6a14e49eb2fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41be55876eef4e89b28e19eb0dce554d', 'request_id': 'req-601109cd-fc5a-4da1-9d2c-6a14e49eb2fd'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:44.271472 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-601109cd-fc5a-4da1-9d2c-6a14e49eb2fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41be55876eef4e89b28e19eb0dce554d', 'request_id': 'req-601109cd-fc5a-4da1-9d2c-6a14e49eb2fd'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:44.285184 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-601109cd-fc5a-4da1-9d2c-6a14e49eb2fd admin admin] The token cache is being invalidate because project 41be55876eef4e89b28e19eb0dce554d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:35:44.285482 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-601109cd-fc5a-4da1-9d2c-6a14e49eb2fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:44.286114 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-601109cd-fc5a-4da1-9d2c-6a14e49eb2fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:44.287687 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1259/2504] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:35:44 2022] DELETE /identity/v3/projects/41be55876eef4e89b28e19eb0dce554d => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:35:44.292871 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da7321-7a3f-4177-ab92-4824ed802307 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:44.293160 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da7321-7a3f-4177-ab92-4824ed802307 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:44.293434 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da7321-7a3f-4177-ab92-4824ed802307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:44.313837 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-a7da7321-7a3f-4177-ab92-4824ed802307 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:35:44.315073 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-a7da7321-7a3f-4177-ab92-4824ed802307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:44.378058 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601109cd-fc5a-4da1-9d2c-6a14e49eb2fd admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:44.379973 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-601109cd-fc5a-4da1-9d2c-6a14e49eb2fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:44.381166 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1246/2505] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:35:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:35:44.389589 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6538bdb-6dbc-4959-8af2-fa9b52e7e5a6 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:44.389882 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6538bdb-6dbc-4959-8af2-fa9b52e7e5a6 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:44.390158 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6538bdb-6dbc-4959-8af2-fa9b52e7e5a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:44.393587 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601109cd-fc5a-4da1-9d2c-6a14e49eb2fd admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:44.398219 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8817e366-8d97-4d83-af85-f9ef9fe9945c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:44.398845 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817e366-8d97-4d83-af85-f9ef9fe9945c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:44.399130 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817e366-8d97-4d83-af85-f9ef9fe9945c admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:44.399411 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817e366-8d97-4d83-af85-f9ef9fe9945c admin admin] PATH_INFO: `/v3/users/ad55e3ba2d4c4df094b4e8f77d28a115` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:44.400586 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8817e366-8d97-4d83-af85-f9ef9fe9945c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad55e3ba2d4c4df094b4e8f77d28a115)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:44.403145 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8817e366-8d97-4d83-af85-f9ef9fe9945c admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:44.410728 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-d6538bdb-6dbc-4959-8af2-fa9b52e7e5a6 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:35:44.411971 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-d6538bdb-6dbc-4959-8af2-fa9b52e7e5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:44.420273 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1247/2506] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:35:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 03:35:44.425022 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6538bdb-6dbc-4959-8af2-fa9b52e7e5a6 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:44.435455 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6538bdb-6dbc-4959-8af2-fa9b52e7e5a6 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:44.440321 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5c4662-71aa-46f6-8f66-e067b7fe1c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:44.440989 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c4662-71aa-46f6-8f66-e067b7fe1c2a admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:44.441267 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c4662-71aa-46f6-8f66-e067b7fe1c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:44.441542 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c4662-71aa-46f6-8f66-e067b7fe1c2a admin admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:44.442177 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5c4662-71aa-46f6-8f66-e067b7fe1c2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:35:44.442476 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5c4662-71aa-46f6-8f66-e067b7fe1c2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:44.444346 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5c4662-71aa-46f6-8f66-e067b7fe1c2a admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:44.453693 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-8817e366-8d97-4d83-af85-f9ef9fe9945c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad55e3ba2d4c4df094b4e8f77d28a115'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:44.454362 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-8817e366-8d97-4d83-af85-f9ef9fe9945c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad55e3ba2d4c4df094b4e8f77d28a115'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:44.460542 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1248/2507] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 03:35:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:35:44.461458 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5c4662-71aa-46f6-8f66-e067b7fe1c2a admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:44.463548 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-4a5c4662-71aa-46f6-8f66-e067b7fe1c2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:44.465028 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-8817e366-8d97-4d83-af85-f9ef9fe9945c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad55e3ba2d4c4df094b4e8f77d28a115'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:44.465793 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-8817e366-8d97-4d83-af85-f9ef9fe9945c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad55e3ba2d4c4df094b4e8f77d28a115'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:44.477758 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5c4662-71aa-46f6-8f66-e067b7fe1c2a admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:44.478087 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-8817e366-8d97-4d83-af85-f9ef9fe9945c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad55e3ba2d4c4df094b4e8f77d28a115'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:44.482872 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f4c1db-c41a-4a75-bae2-aca7fa1fcb09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:44.483465 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4c1db-c41a-4a75-bae2-aca7fa1fcb09 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:44.483772 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4c1db-c41a-4a75-bae2-aca7fa1fcb09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:44.484041 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4c1db-c41a-4a75-bae2-aca7fa1fcb09 admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:44.484690 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f4c1db-c41a-4a75-bae2-aca7fa1fcb09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:44.486600 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f4c1db-c41a-4a75-bae2-aca7fa1fcb09 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:44.490647 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1260/2508] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:35:44 2022] DELETE /identity/v3/users/ad55e3ba2d4c4df094b4e8f77d28a115 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 03:35:44.495786 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf0eb42-eb0f-4bcc-816b-daf1e8b6fbc0 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:44.496452 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf0eb42-eb0f-4bcc-816b-daf1e8b6fbc0 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:44.496872 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf0eb42-eb0f-4bcc-816b-daf1e8b6fbc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:44.515182 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1249/2509] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:35:44 2022] POST /identity/v3/projects => generated 367 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 03:35:44.516463 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-4cf0eb42-eb0f-4bcc-816b-daf1e8b6fbc0 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:35:44.517652 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-4cf0eb42-eb0f-4bcc-816b-daf1e8b6fbc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:44.519351 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f4c1db-c41a-4a75-bae2-aca7fa1fcb09 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:44.529438 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:35:44.544256 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:35:44.582246 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1261/2510] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:35:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 03:35:44.585535 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f4c1db-c41a-4a75-bae2-aca7fa1fcb09 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:44.589045 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1d20a3-b2ba-47dc-8e9a-b809541ed850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:44.589648 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d20a3-b2ba-47dc-8e9a-b809541ed850 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:44.589931 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d20a3-b2ba-47dc-8e9a-b809541ed850 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:44.590205 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d20a3-b2ba-47dc-8e9a-b809541ed850 admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:44.590970 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1d20a3-b2ba-47dc-8e9a-b809541ed850 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:44.591907 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf0eb42-eb0f-4bcc-816b-daf1e8b6fbc0 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:44.592903 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1d20a3-b2ba-47dc-8e9a-b809541ed850 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:44.593262 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-4cf0eb42-eb0f-4bcc-816b-daf1e8b6fbc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:44.614862 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1250/2511] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:35:44 2022] POST /identity/v3/users => generated 284 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 03:35:44.618969 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1d20a3-b2ba-47dc-8e9a-b809541ed850 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:44.628916 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1d20a3-b2ba-47dc-8e9a-b809541ed850 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:44.636330 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fab691-ad03-4c49-bb59-ed062c8b97d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:44.637960 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fab691-ad03-4c49-bb59-ed062c8b97d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:44.638272 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fab691-ad03-4c49-bb59-ed062c8b97d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:44.638546 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fab691-ad03-4c49-bb59-ed062c8b97d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:44.639533 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fab691-ad03-4c49-bb59-ed062c8b97d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:44.641159 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fab691-ad03-4c49-bb59-ed062c8b97d2 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:44.651779 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1251/2512] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:35:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:35:44.655409 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf0eb42-eb0f-4bcc-816b-daf1e8b6fbc0 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:44.656111 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fab691-ad03-4c49-bb59-ed062c8b97d2 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:44.658180 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23dbf35-0ebb-49fa-a5ba-5755c020f609 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:44.658781 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23dbf35-0ebb-49fa-a5ba-5755c020f609 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:44.659059 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23dbf35-0ebb-49fa-a5ba-5755c020f609 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:44.659338 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23dbf35-0ebb-49fa-a5ba-5755c020f609 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:44.665739 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fab691-ad03-4c49-bb59-ed062c8b97d2 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:44.668964 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23dbf35-0ebb-49fa-a5ba-5755c020f609 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:44.670387 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23dbf35-0ebb-49fa-a5ba-5755c020f609 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:44.670928 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e6e1cb-3441-4f67-910f-6f571f5c9d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:44.671534 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6e1cb-3441-4f67-910f-6f571f5c9d50 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:44.671815 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6e1cb-3441-4f67-910f-6f571f5c9d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:44.672091 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6e1cb-3441-4f67-910f-6f571f5c9d50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:44.672723 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e6e1cb-3441-4f67-910f-6f571f5c9d50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:44.674289 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e6e1cb-3441-4f67-910f-6f571f5c9d50 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:44.679788 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1262/2513] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:35:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 03:35:44.687521 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1252/2514] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:35:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 03:35:44.689081 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23dbf35-0ebb-49fa-a5ba-5755c020f609 service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:44.699535 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23dbf35-0ebb-49fa-a5ba-5755c020f609 service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:44.704687 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51004936-43c4-498e-b544-173c50ae16c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:44.705394 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51004936-43c4-498e-b544-173c50ae16c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:44.705674 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51004936-43c4-498e-b544-173c50ae16c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:44.705958 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51004936-43c4-498e-b544-173c50ae16c4 admin admin] PATH_INFO: `/v3/projects/46ff434aea6640bfa06788b67de2d5bb/users/9ca91e6f09be439f8fe5a16f957e3024/roles/04d0e4575a28440eb4349b4a6565e8b8` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:44.721589 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51004936-43c4-498e-b544-173c50ae16c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46ff434aea6640bfa06788b67de2d5bb, user_id=9ca91e6f09be439f8fe5a16f957e3024, role_id=04d0e4575a28440eb4349b4a6565e8b8)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:44.724695 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51004936-43c4-498e-b544-173c50ae16c4 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:44.738795 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1263/2515] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:35:44 2022] PUT /identity/v3/projects/46ff434aea6640bfa06788b67de2d5bb/users/9ca91e6f09be439f8fe5a16f957e3024/roles/04d0e4575a28440eb4349b4a6565e8b8 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 03:35:44.750439 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30024c-8cd0-4e44-b18d-081c9ff7a071 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:44.750908 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30024c-8cd0-4e44-b18d-081c9ff7a071 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:44.751171 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30024c-8cd0-4e44-b18d-081c9ff7a071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:44.779767 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-3d30024c-8cd0-4e44-b18d-081c9ff7a071 None None] MFA Rules not processed for user `9ca91e6f09be439f8fe5a16f957e3024`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:35:44.781004 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-3d30024c-8cd0-4e44-b18d-081c9ff7a071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:44.849304 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1253/2516] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:35:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:35:44.861946 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51004936-43c4-498e-b544-173c50ae16c4 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:44.863711 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-51004936-43c4-498e-b544-173c50ae16c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:44.925110 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51004936-43c4-498e-b544-173c50ae16c4 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:44.929580 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01537d0d-1a6a-44c5-ab8a-2bb104135bd7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95be0e4e1c8641709e07b115047fb4e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:44.930844 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01537d0d-1a6a-44c5-ab8a-2bb104135bd7 service glance] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:44.931208 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01537d0d-1a6a-44c5-ab8a-2bb104135bd7 service glance] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:44.931649 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01537d0d-1a6a-44c5-ab8a-2bb104135bd7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:44.942177 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01537d0d-1a6a-44c5-ab8a-2bb104135bd7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:44.943475 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01537d0d-1a6a-44c5-ab8a-2bb104135bd7 service glance] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:44.954587 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1264/2517] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:35:44 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:35:44.961287 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d30024c-8cd0-4e44-b18d-081c9ff7a071 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:44.962823 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-3d30024c-8cd0-4e44-b18d-081c9ff7a071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:45.036110 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d30024c-8cd0-4e44-b18d-081c9ff7a071 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:45.041047 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80790bc6-39cb-4304-91ee-a67040704cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:45.041699 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80790bc6-39cb-4304-91ee-a67040704cfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:45.043050 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80790bc6-39cb-4304-91ee-a67040704cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:45.043050 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80790bc6-39cb-4304-91ee-a67040704cfa admin admin] PATH_INFO: `/v3/projects/de6a051afc624ae6a68b27c03a6fc9c4` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:45.044250 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80790bc6-39cb-4304-91ee-a67040704cfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=de6a051afc624ae6a68b27c03a6fc9c4)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:45.046165 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80790bc6-39cb-4304-91ee-a67040704cfa admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:45.054491 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:35:45.095512 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-80790bc6-39cb-4304-91ee-a67040704cfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de6a051afc624ae6a68b27c03a6fc9c4', 'request_id': 'req-80790bc6-39cb-4304-91ee-a67040704cfa'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:45.100993 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-80790bc6-39cb-4304-91ee-a67040704cfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de6a051afc624ae6a68b27c03a6fc9c4', 'request_id': 'req-80790bc6-39cb-4304-91ee-a67040704cfa'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:45.108107 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-80790bc6-39cb-4304-91ee-a67040704cfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de6a051afc624ae6a68b27c03a6fc9c4', 'request_id': 'req-80790bc6-39cb-4304-91ee-a67040704cfa'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:45.121496 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-80790bc6-39cb-4304-91ee-a67040704cfa admin admin] The token cache is being invalidate because project de6a051afc624ae6a68b27c03a6fc9c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:35:45.121792 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-80790bc6-39cb-4304-91ee-a67040704cfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:45.122446 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-80790bc6-39cb-4304-91ee-a67040704cfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:45.123985 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1254/2518] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:35:44 2022] DELETE /identity/v3/projects/de6a051afc624ae6a68b27c03a6fc9c4 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 03:35:45.128030 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01537d0d-1a6a-44c5-ab8a-2bb104135bd7 service glance] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:45.138951 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01537d0d-1a6a-44c5-ab8a-2bb104135bd7 service glance] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:45.187716 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:35:45.199511 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8488b6e4-3b5d-482b-822d-514b69f6dfb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:45.200137 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8488b6e4-3b5d-482b-822d-514b69f6dfb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:45.200417 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8488b6e4-3b5d-482b-822d-514b69f6dfb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:45.200694 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8488b6e4-3b5d-482b-822d-514b69f6dfb5 admin admin] PATH_INFO: `/v3/users/aabf4356251c4f52adc524f3e40a0a0b` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:45.201844 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8488b6e4-3b5d-482b-822d-514b69f6dfb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aabf4356251c4f52adc524f3e40a0a0b)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:45.203850 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8488b6e4-3b5d-482b-822d-514b69f6dfb5 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:45.253248 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-8488b6e4-3b5d-482b-822d-514b69f6dfb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aabf4356251c4f52adc524f3e40a0a0b'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:45.253993 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-8488b6e4-3b5d-482b-822d-514b69f6dfb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aabf4356251c4f52adc524f3e40a0a0b'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:45.262811 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-8488b6e4-3b5d-482b-822d-514b69f6dfb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aabf4356251c4f52adc524f3e40a0a0b'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:45.263475 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-8488b6e4-3b5d-482b-822d-514b69f6dfb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aabf4356251c4f52adc524f3e40a0a0b'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:45.278632 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-8488b6e4-3b5d-482b-822d-514b69f6dfb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aabf4356251c4f52adc524f3e40a0a0b'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:45.295620 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1265/2519] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:35:45 2022] DELETE /identity/v3/users/aabf4356251c4f52adc524f3e40a0a0b => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:35:45.588589 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80790bc6-39cb-4304-91ee-a67040704cfa admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:45.590642 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-80790bc6-39cb-4304-91ee-a67040704cfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:45.609551 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80790bc6-39cb-4304-91ee-a67040704cfa admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:45.671371 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc56e62-cfe7-4960-a5b7-f889160ac72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:45.672026 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc56e62-cfe7-4960-a5b7-f889160ac72a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:45.672306 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc56e62-cfe7-4960-a5b7-f889160ac72a admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:45.672579 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc56e62-cfe7-4960-a5b7-f889160ac72a admin admin] PATH_INFO: `/v3/projects/bbab341aac9b4ea0b9b667c710bfc102` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:45.673690 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc56e62-cfe7-4960-a5b7-f889160ac72a admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbab341aac9b4ea0b9b667c710bfc102)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:45.675660 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc56e62-cfe7-4960-a5b7-f889160ac72a admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:45.725342 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-cfc56e62-cfe7-4960-a5b7-f889160ac72a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbab341aac9b4ea0b9b667c710bfc102', 'request_id': 'req-cfc56e62-cfe7-4960-a5b7-f889160ac72a'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:45.733806 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-cfc56e62-cfe7-4960-a5b7-f889160ac72a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbab341aac9b4ea0b9b667c710bfc102', 'request_id': 'req-cfc56e62-cfe7-4960-a5b7-f889160ac72a'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:45.740624 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-cfc56e62-cfe7-4960-a5b7-f889160ac72a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbab341aac9b4ea0b9b667c710bfc102', 'request_id': 'req-cfc56e62-cfe7-4960-a5b7-f889160ac72a'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:45.755022 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-cfc56e62-cfe7-4960-a5b7-f889160ac72a admin admin] The token cache is being invalidate because project bbab341aac9b4ea0b9b667c710bfc102 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:35:45.755307 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-cfc56e62-cfe7-4960-a5b7-f889160ac72a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:45.756023 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-cfc56e62-cfe7-4960-a5b7-f889160ac72a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:45.757888 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1255/2520] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:35:45 2022] DELETE /identity/v3/projects/bbab341aac9b4ea0b9b667c710bfc102 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:35:45.764166 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9183fea-9f3b-4505-b4a9-42110c854e7f None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:45.764706 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9183fea-9f3b-4505-b4a9-42110c854e7f None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:45.765204 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9183fea-9f3b-4505-b4a9-42110c854e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:45.789303 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-d9183fea-9f3b-4505-b4a9-42110c854e7f None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:35:45.790848 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-d9183fea-9f3b-4505-b4a9-42110c854e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:45.852730 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1266/2521] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:35:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:35:45.863030 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd053e4f-8c99-4f23-90d3-d1096895ee15 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:45.863339 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd053e4f-8c99-4f23-90d3-d1096895ee15 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:45.863649 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd053e4f-8c99-4f23-90d3-d1096895ee15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:45.883232 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-bd053e4f-8c99-4f23-90d3-d1096895ee15 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:35:45.884505 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-bd053e4f-8c99-4f23-90d3-d1096895ee15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:45.893543 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1256/2522] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:35:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:35:45.897984 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9183fea-9f3b-4505-b4a9-42110c854e7f None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:45.908154 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9183fea-9f3b-4505-b4a9-42110c854e7f None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:45.912625 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aa71ad-0c0b-4fb8-be32-03283431f3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:45.913213 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa71ad-0c0b-4fb8-be32-03283431f3a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:45.913493 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa71ad-0c0b-4fb8-be32-03283431f3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:45.913764 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa71ad-0c0b-4fb8-be32-03283431f3a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:45.914399 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aa71ad-0c0b-4fb8-be32-03283431f3a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:35:45.914726 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aa71ad-0c0b-4fb8-be32-03283431f3a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:45.916331 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aa71ad-0c0b-4fb8-be32-03283431f3a2 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:45.929518 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1267/2523] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 03:35:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:35:45.934144 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd053e4f-8c99-4f23-90d3-d1096895ee15 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:45.943348 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd053e4f-8c99-4f23-90d3-d1096895ee15 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:45.948194 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa64b99f-3adb-4ec1-a885-5cd51a8c1fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:45.948959 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa64b99f-3adb-4ec1-a885-5cd51a8c1fc2 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:45.949226 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa64b99f-3adb-4ec1-a885-5cd51a8c1fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:45.949493 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa64b99f-3adb-4ec1-a885-5cd51a8c1fc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:45.950149 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa64b99f-3adb-4ec1-a885-5cd51a8c1fc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:45.952061 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa64b99f-3adb-4ec1-a885-5cd51a8c1fc2 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:45.973232 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:35:45.985534 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1257/2524] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:35:45 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:35:45.986668 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aa71ad-0c0b-4fb8-be32-03283431f3a2 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:45.996824 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aa71ad-0c0b-4fb8-be32-03283431f3a2 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:46.049054 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:35:46.056715 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d0562-048a-471e-bab2-2aee0ffbe433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:46.058134 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d0562-048a-471e-bab2-2aee0ffbe433 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:46.058794 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d0562-048a-471e-bab2-2aee0ffbe433 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:46.059301 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d0562-048a-471e-bab2-2aee0ffbe433 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:46.060062 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680d0562-048a-471e-bab2-2aee0ffbe433 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:46.062166 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680d0562-048a-471e-bab2-2aee0ffbe433 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:46.083508 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1268/2525] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:35:45 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:35:46.087644 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa64b99f-3adb-4ec1-a885-5cd51a8c1fc2 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:46.099799 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa64b99f-3adb-4ec1-a885-5cd51a8c1fc2 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:46.105107 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f227f73a-66e1-4a1f-b008-adfb5a88ed30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:46.105738 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f227f73a-66e1-4a1f-b008-adfb5a88ed30 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:46.106021 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f227f73a-66e1-4a1f-b008-adfb5a88ed30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:46.106328 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f227f73a-66e1-4a1f-b008-adfb5a88ed30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:46.106979 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f227f73a-66e1-4a1f-b008-adfb5a88ed30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:46.108614 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f227f73a-66e1-4a1f-b008-adfb5a88ed30 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:46.119798 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1258/2526] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:35:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:35:46.124623 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d0562-048a-471e-bab2-2aee0ffbe433 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:46.138433 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d0562-048a-471e-bab2-2aee0ffbe433 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:46.144512 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82541ccd-55b4-4430-a174-a7266b574470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:46.145131 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82541ccd-55b4-4430-a174-a7266b574470 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:46.145416 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82541ccd-55b4-4430-a174-a7266b574470 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:46.145686 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82541ccd-55b4-4430-a174-a7266b574470 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:46.146337 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82541ccd-55b4-4430-a174-a7266b574470 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:46.147966 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82541ccd-55b4-4430-a174-a7266b574470 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:46.159816 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1269/2527] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:35:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 03:35:46.163980 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f227f73a-66e1-4a1f-b008-adfb5a88ed30 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:46.174413 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f227f73a-66e1-4a1f-b008-adfb5a88ed30 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:46.179459 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52daa028-d359-46ca-a8ca-8d6623b69707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:46.180119 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52daa028-d359-46ca-a8ca-8d6623b69707 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:46.180393 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52daa028-d359-46ca-a8ca-8d6623b69707 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:46.180661 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52daa028-d359-46ca-a8ca-8d6623b69707 admin admin] PATH_INFO: `/v3/projects/9d5318170d514d939b72e3c885eb5c71/users/4abbef1b811943279142271da11d42cb/roles/04d0e4575a28440eb4349b4a6565e8b8` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:46.195874 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52daa028-d359-46ca-a8ca-8d6623b69707 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d5318170d514d939b72e3c885eb5c71, user_id=4abbef1b811943279142271da11d42cb, role_id=04d0e4575a28440eb4349b4a6565e8b8)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:46.199130 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52daa028-d359-46ca-a8ca-8d6623b69707 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:46.211721 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1259/2528] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:35:46 2022] PUT /identity/v3/projects/9d5318170d514d939b72e3c885eb5c71/users/4abbef1b811943279142271da11d42cb/roles/04d0e4575a28440eb4349b4a6565e8b8 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:35:46.225157 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e55b6a-9756-4d25-96ca-ca531eb07e28 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:46.226298 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e55b6a-9756-4d25-96ca-ca531eb07e28 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:46.231293 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e55b6a-9756-4d25-96ca-ca531eb07e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:46.262516 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-57e55b6a-9756-4d25-96ca-ca531eb07e28 None None] MFA Rules not processed for user `4abbef1b811943279142271da11d42cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:35:46.263794 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-57e55b6a-9756-4d25-96ca-ca531eb07e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:46.331049 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1270/2529] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:35:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:35:46.335667 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52daa028-d359-46ca-a8ca-8d6623b69707 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:46.400324 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52daa028-d359-46ca-a8ca-8d6623b69707 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:46.405828 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a34e8a-97d5-480e-945c-d4a382a022d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:46.406423 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a34e8a-97d5-480e-945c-d4a382a022d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:46.406701 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a34e8a-97d5-480e-945c-d4a382a022d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:46.406977 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a34e8a-97d5-480e-945c-d4a382a022d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:46.407642 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a34e8a-97d5-480e-945c-d4a382a022d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:46.410522 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a34e8a-97d5-480e-945c-d4a382a022d7 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:46.439908 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1260/2530] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:35:46 2022] POST /identity/v3/projects => generated 381 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:35:46.444219 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e55b6a-9756-4d25-96ca-ca531eb07e28 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:46.456403 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e55b6a-9756-4d25-96ca-ca531eb07e28 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:46.518445 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908244a0-5127-40ed-b591-fea423405910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:46.519053 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908244a0-5127-40ed-b591-fea423405910 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:46.519390 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908244a0-5127-40ed-b591-fea423405910 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:46.519717 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908244a0-5127-40ed-b591-fea423405910 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:46.520361 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908244a0-5127-40ed-b591-fea423405910 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:46.522364 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908244a0-5127-40ed-b591-fea423405910 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:46.544435 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1271/2531] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:35:46 2022] POST /identity/v3/users => generated 297 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:35:46.548448 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a34e8a-97d5-480e-945c-d4a382a022d7 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:46.561718 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a34e8a-97d5-480e-945c-d4a382a022d7 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:46.566340 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde527d0-40ca-4f8e-9612-b1c543b3bf65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:46.566935 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde527d0-40ca-4f8e-9612-b1c543b3bf65 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:46.567811 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde527d0-40ca-4f8e-9612-b1c543b3bf65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:46.568108 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde527d0-40ca-4f8e-9612-b1c543b3bf65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:46.569043 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde527d0-40ca-4f8e-9612-b1c543b3bf65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:46.570649 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde527d0-40ca-4f8e-9612-b1c543b3bf65 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:46.582026 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1261/2532] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:35:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:35:46.586317 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908244a0-5127-40ed-b591-fea423405910 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:46.598355 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908244a0-5127-40ed-b591-fea423405910 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:46.603392 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747661e5-89c7-4c32-b8aa-21065812485b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:46.604087 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747661e5-89c7-4c32-b8aa-21065812485b admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:46.604369 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747661e5-89c7-4c32-b8aa-21065812485b admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:46.604833 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747661e5-89c7-4c32-b8aa-21065812485b admin admin] PATH_INFO: `/v3/projects/cf089b8a7a8a4dc58d37c5cbb4ae3dab/users/d4098506b6f749d28e92b125a80812b9/roles/fe9379cda35c4ff78576fe48b60bea3c` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:46.620760 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747661e5-89c7-4c32-b8aa-21065812485b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf089b8a7a8a4dc58d37c5cbb4ae3dab, user_id=d4098506b6f749d28e92b125a80812b9, role_id=fe9379cda35c4ff78576fe48b60bea3c)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:46.623544 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747661e5-89c7-4c32-b8aa-21065812485b admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:46.642849 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1272/2533] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:35:46 2022] PUT /identity/v3/projects/cf089b8a7a8a4dc58d37c5cbb4ae3dab/users/d4098506b6f749d28e92b125a80812b9/roles/fe9379cda35c4ff78576fe48b60bea3c => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:35:46.646841 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde527d0-40ca-4f8e-9612-b1c543b3bf65 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:46.657950 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde527d0-40ca-4f8e-9612-b1c543b3bf65 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:46.720530 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee4085-714c-4f15-8190-7d219670ab8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:46.721132 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee4085-714c-4f15-8190-7d219670ab8e admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:46.721409 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee4085-714c-4f15-8190-7d219670ab8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:46.721678 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee4085-714c-4f15-8190-7d219670ab8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:46.722313 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bee4085-714c-4f15-8190-7d219670ab8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:46.723934 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bee4085-714c-4f15-8190-7d219670ab8e admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:46.733904 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1262/2534] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:35:46 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 03:35:46.738043 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747661e5-89c7-4c32-b8aa-21065812485b admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:46.750962 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747661e5-89c7-4c32-b8aa-21065812485b admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:46.756391 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc4050-4152-4907-ab94-71d17b261139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:46.757046 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc4050-4152-4907-ab94-71d17b261139 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:46.757322 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc4050-4152-4907-ab94-71d17b261139 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:46.757592 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc4050-4152-4907-ab94-71d17b261139 admin admin] PATH_INFO: `/v3/projects/cf089b8a7a8a4dc58d37c5cbb4ae3dab/users/d4098506b6f749d28e92b125a80812b9/roles/fe9379cda35c4ff78576fe48b60bea3c` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:46.759539 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcc4050-4152-4907-ab94-71d17b261139 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf089b8a7a8a4dc58d37c5cbb4ae3dab, user_id=d4098506b6f749d28e92b125a80812b9, role_id=fe9379cda35c4ff78576fe48b60bea3c)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:46.763084 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcc4050-4152-4907-ab94-71d17b261139 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:46.773527 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1273/2535] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:35:46 2022] PUT /identity/v3/projects/cf089b8a7a8a4dc58d37c5cbb4ae3dab/users/d4098506b6f749d28e92b125a80812b9/roles/fe9379cda35c4ff78576fe48b60bea3c => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 03:35:46.784850 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f3c37f-c5fc-4d14-91ed-1685f585356d None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:46.785146 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f3c37f-c5fc-4d14-91ed-1685f585356d None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:46.785643 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f3c37f-c5fc-4d14-91ed-1685f585356d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:46.815383 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-23f3c37f-c5fc-4d14-91ed-1685f585356d None None] MFA Rules not processed for user `d4098506b6f749d28e92b125a80812b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:35:46.816626 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-23f3c37f-c5fc-4d14-91ed-1685f585356d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:46.838504 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:35:46.889387 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1263/2536] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:35:46 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:35:46.900610 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc4050-4152-4907-ab94-71d17b261139 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:46.902366 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-2dcc4050-4152-4907-ab94-71d17b261139 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:46.924373 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:35:46.964284 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc4050-4152-4907-ab94-71d17b261139 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:46.967917 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fffb86-a7a2-4972-b814-4ee52cb2e814 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f537aabf3d1040ff840b02616f839975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:46.968519 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fffb86-a7a2-4972-b814-4ee52cb2e814 service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:46.968797 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fffb86-a7a2-4972-b814-4ee52cb2e814 service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:46.969066 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fffb86-a7a2-4972-b814-4ee52cb2e814 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:46.979025 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fffb86-a7a2-4972-b814-4ee52cb2e814 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:46.981025 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fffb86-a7a2-4972-b814-4ee52cb2e814 service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:46.990717 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1274/2537] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:35:46 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:35:47.068120 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f3c37f-c5fc-4d14-91ed-1685f585356d None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:47.078121 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f3c37f-c5fc-4d14-91ed-1685f585356d None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:47.081722 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a925a-6c95-4e3f-9f53-d71cb14a3d20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f537aabf3d1040ff840b02616f839975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:47.082308 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a925a-6c95-4e3f-9f53-d71cb14a3d20 service cinder] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:47.082590 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a925a-6c95-4e3f-9f53-d71cb14a3d20 service cinder] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:47.082864 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a925a-6c95-4e3f-9f53-d71cb14a3d20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:47.141737 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18a925a-6c95-4e3f-9f53-d71cb14a3d20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:47.143510 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18a925a-6c95-4e3f-9f53-d71cb14a3d20 service cinder] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:47.153866 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1264/2538] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:35:47 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:35:54.005916 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fffb86-a7a2-4972-b814-4ee52cb2e814 service cinder] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:54.193305 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fffb86-a7a2-4972-b814-4ee52cb2e814 service cinder] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:54.198007 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95b46b7-f90b-4e1d-b512-e581393f6eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:54.199250 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b46b7-f90b-4e1d-b512-e581393f6eb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:54.199555 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b46b7-f90b-4e1d-b512-e581393f6eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:54.199829 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b46b7-f90b-4e1d-b512-e581393f6eb8 admin admin] PATH_INFO: `/v3/users/4abbef1b811943279142271da11d42cb` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:54.200949 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95b46b7-f90b-4e1d-b512-e581393f6eb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4abbef1b811943279142271da11d42cb)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:54.202843 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95b46b7-f90b-4e1d-b512-e581393f6eb8 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:54.250160 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-f95b46b7-f90b-4e1d-b512-e581393f6eb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4abbef1b811943279142271da11d42cb'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:54.251189 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-f95b46b7-f90b-4e1d-b512-e581393f6eb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4abbef1b811943279142271da11d42cb'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:54.260453 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-f95b46b7-f90b-4e1d-b512-e581393f6eb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4abbef1b811943279142271da11d42cb'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:54.262022 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-f95b46b7-f90b-4e1d-b512-e581393f6eb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4abbef1b811943279142271da11d42cb'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:54.273996 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-f95b46b7-f90b-4e1d-b512-e581393f6eb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4abbef1b811943279142271da11d42cb'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:54.286366 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1275/2539] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:35:54 2022] DELETE /identity/v3/users/4abbef1b811943279142271da11d42cb => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:35:54.290895 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50fe242-3604-405c-b9f5-73dc0c5e8c96 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:54.291375 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50fe242-3604-405c-b9f5-73dc0c5e8c96 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:54.291510 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50fe242-3604-405c-b9f5-73dc0c5e8c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:54.313657 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-c50fe242-3604-405c-b9f5-73dc0c5e8c96 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:35:54.314868 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-c50fe242-3604-405c-b9f5-73dc0c5e8c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:54.377577 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1265/2540] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:35:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:35:54.387240 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95b46b7-f90b-4e1d-b512-e581393f6eb8 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:54.388689 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-f95b46b7-f90b-4e1d-b512-e581393f6eb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:54.435593 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:35:54.452557 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95b46b7-f90b-4e1d-b512-e581393f6eb8 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:54.456423 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d039617-03e7-4e63-9d57-4f7e23ea3738 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:54.457014 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d039617-03e7-4e63-9d57-4f7e23ea3738 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:54.457288 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d039617-03e7-4e63-9d57-4f7e23ea3738 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:54.457555 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d039617-03e7-4e63-9d57-4f7e23ea3738 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:54.466420 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d039617-03e7-4e63-9d57-4f7e23ea3738 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:54.467852 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d039617-03e7-4e63-9d57-4f7e23ea3738 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:54.479998 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1276/2541] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:35:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:35:54.762437 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50fe242-3604-405c-b9f5-73dc0c5e8c96 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:54.764011 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-c50fe242-3604-405c-b9f5-73dc0c5e8c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:54.781340 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50fe242-3604-405c-b9f5-73dc0c5e8c96 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:54.786654 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9f677b-1672-4722-9de7-2250b89f644a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:54.787300 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f677b-1672-4722-9de7-2250b89f644a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:54.787619 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f677b-1672-4722-9de7-2250b89f644a admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:54.787908 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f677b-1672-4722-9de7-2250b89f644a admin admin] PATH_INFO: `/v3/projects/9d5318170d514d939b72e3c885eb5c71` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:54.790226 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9f677b-1672-4722-9de7-2250b89f644a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d5318170d514d939b72e3c885eb5c71)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:54.793001 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9f677b-1672-4722-9de7-2250b89f644a admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:54.842423 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-ac9f677b-1672-4722-9de7-2250b89f644a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d5318170d514d939b72e3c885eb5c71', 'request_id': 'req-ac9f677b-1672-4722-9de7-2250b89f644a'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:54.844301 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:35:54.848372 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-ac9f677b-1672-4722-9de7-2250b89f644a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d5318170d514d939b72e3c885eb5c71', 'request_id': 'req-ac9f677b-1672-4722-9de7-2250b89f644a'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:54.855326 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-ac9f677b-1672-4722-9de7-2250b89f644a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d5318170d514d939b72e3c885eb5c71', 'request_id': 'req-ac9f677b-1672-4722-9de7-2250b89f644a'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:54.868072 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-ac9f677b-1672-4722-9de7-2250b89f644a admin admin] The token cache is being invalidate because project 9d5318170d514d939b72e3c885eb5c71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:35:54.868505 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-ac9f677b-1672-4722-9de7-2250b89f644a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:54.869123 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-ac9f677b-1672-4722-9de7-2250b89f644a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:54.870708 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1266/2542] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:35:54 2022] DELETE /identity/v3/projects/9d5318170d514d939b72e3c885eb5c71 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:35:54.874865 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d039617-03e7-4e63-9d57-4f7e23ea3738 service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:54.884890 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d039617-03e7-4e63-9d57-4f7e23ea3738 service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:54.958591 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a6ba9e-6a6f-42de-906f-46db8bd967a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:54.959226 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a6ba9e-6a6f-42de-906f-46db8bd967a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:54.959538 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a6ba9e-6a6f-42de-906f-46db8bd967a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:54.959821 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a6ba9e-6a6f-42de-906f-46db8bd967a4 admin admin] PATH_INFO: `/v3/users/d4098506b6f749d28e92b125a80812b9` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:54.960953 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a6ba9e-6a6f-42de-906f-46db8bd967a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4098506b6f749d28e92b125a80812b9)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:54.962862 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a6ba9e-6a6f-42de-906f-46db8bd967a4 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:55.011390 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-56a6ba9e-6a6f-42de-906f-46db8bd967a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4098506b6f749d28e92b125a80812b9'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:55.012109 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-56a6ba9e-6a6f-42de-906f-46db8bd967a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4098506b6f749d28e92b125a80812b9'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:55.019354 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-56a6ba9e-6a6f-42de-906f-46db8bd967a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4098506b6f749d28e92b125a80812b9'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:55.020003 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-56a6ba9e-6a6f-42de-906f-46db8bd967a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4098506b6f749d28e92b125a80812b9'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:55.032276 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-56a6ba9e-6a6f-42de-906f-46db8bd967a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4098506b6f749d28e92b125a80812b9'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:55.046077 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1277/2543] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:35:54 2022] DELETE /identity/v3/users/d4098506b6f749d28e92b125a80812b9 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:35:55.579295 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9f677b-1672-4722-9de7-2250b89f644a admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:55.580746 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-ac9f677b-1672-4722-9de7-2250b89f644a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:55.595249 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9f677b-1672-4722-9de7-2250b89f644a admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:55.654609 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b1d10-6cba-492f-9a6d-159d5e83353d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:55.655234 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b1d10-6cba-492f-9a6d-159d5e83353d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:55.655535 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b1d10-6cba-492f-9a6d-159d5e83353d admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:55.655808 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b1d10-6cba-492f-9a6d-159d5e83353d admin admin] PATH_INFO: `/v3/projects/cf089b8a7a8a4dc58d37c5cbb4ae3dab` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:55.656907 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205b1d10-6cba-492f-9a6d-159d5e83353d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf089b8a7a8a4dc58d37c5cbb4ae3dab)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:55.658815 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205b1d10-6cba-492f-9a6d-159d5e83353d admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:55.706157 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-205b1d10-6cba-492f-9a6d-159d5e83353d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf089b8a7a8a4dc58d37c5cbb4ae3dab', 'request_id': 'req-205b1d10-6cba-492f-9a6d-159d5e83353d'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:55.711881 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-205b1d10-6cba-492f-9a6d-159d5e83353d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf089b8a7a8a4dc58d37c5cbb4ae3dab', 'request_id': 'req-205b1d10-6cba-492f-9a6d-159d5e83353d'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:55.718138 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-205b1d10-6cba-492f-9a6d-159d5e83353d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf089b8a7a8a4dc58d37c5cbb4ae3dab', 'request_id': 'req-205b1d10-6cba-492f-9a6d-159d5e83353d'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:55.732499 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-205b1d10-6cba-492f-9a6d-159d5e83353d admin admin] The token cache is being invalidate because project cf089b8a7a8a4dc58d37c5cbb4ae3dab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:35:55.732793 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-205b1d10-6cba-492f-9a6d-159d5e83353d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:55.733432 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-205b1d10-6cba-492f-9a6d-159d5e83353d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:55.734974 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1267/2544] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:35:55 2022] DELETE /identity/v3/projects/cf089b8a7a8a4dc58d37c5cbb4ae3dab => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:35:55.739949 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a178a3-101d-484b-9258-a5d8e5cbfd8a None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:55.740240 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a178a3-101d-484b-9258-a5d8e5cbfd8a None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:55.740515 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a178a3-101d-484b-9258-a5d8e5cbfd8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:55.760101 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-83a178a3-101d-484b-9258-a5d8e5cbfd8a None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:35:55.761546 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-83a178a3-101d-484b-9258-a5d8e5cbfd8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:55.825406 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1278/2545] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:35:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:35:55.833378 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61065615-4fd8-4cbb-a921-924d1f428e2d None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:55.833663 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61065615-4fd8-4cbb-a921-924d1f428e2d None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:55.833941 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61065615-4fd8-4cbb-a921-924d1f428e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:55.855510 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-61065615-4fd8-4cbb-a921-924d1f428e2d None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:35:55.856722 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-61065615-4fd8-4cbb-a921-924d1f428e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:55.868182 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1268/2546] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:35:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:35:55.873282 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a178a3-101d-484b-9258-a5d8e5cbfd8a None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:55.878533 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:35:55.886384 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a178a3-101d-484b-9258-a5d8e5cbfd8a None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:55.892677 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77174a3-e4b0-4424-ac23-8c21e9db2cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:55.893212 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77174a3-e4b0-4424-ac23-8c21e9db2cb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:55.893494 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77174a3-e4b0-4424-ac23-8c21e9db2cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:55.893764 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77174a3-e4b0-4424-ac23-8c21e9db2cb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:55.894404 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77174a3-e4b0-4424-ac23-8c21e9db2cb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:35:55.894708 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77174a3-e4b0-4424-ac23-8c21e9db2cb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:55.896320 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77174a3-e4b0-4424-ac23-8c21e9db2cb4 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:55.908806 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1279/2547] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 03:35:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:35:55.913172 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61065615-4fd8-4cbb-a921-924d1f428e2d None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:55.922538 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61065615-4fd8-4cbb-a921-924d1f428e2d None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:55.927124 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29acbed0-9f3e-440c-bc1a-a3e9a8948997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:55.927784 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29acbed0-9f3e-440c-bc1a-a3e9a8948997 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:55.928071 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29acbed0-9f3e-440c-bc1a-a3e9a8948997 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:55.928348 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29acbed0-9f3e-440c-bc1a-a3e9a8948997 admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:55.928981 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29acbed0-9f3e-440c-bc1a-a3e9a8948997 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:55.930856 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29acbed0-9f3e-440c-bc1a-a3e9a8948997 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:55.958007 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1269/2548] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:35:55 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:35:55.962032 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77174a3-e4b0-4424-ac23-8c21e9db2cb4 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:55.972499 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77174a3-e4b0-4424-ac23-8c21e9db2cb4 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:56.031812 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20891c1-9f33-407b-9643-ff33fda6d8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:56.032455 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20891c1-9f33-407b-9643-ff33fda6d8bf admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:56.032673 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20891c1-9f33-407b-9643-ff33fda6d8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:56.032945 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20891c1-9f33-407b-9643-ff33fda6d8bf admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:56.033574 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20891c1-9f33-407b-9643-ff33fda6d8bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:56.035444 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20891c1-9f33-407b-9643-ff33fda6d8bf admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:56.055815 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1280/2549] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:35:55 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 03:35:56.059953 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29acbed0-9f3e-440c-bc1a-a3e9a8948997 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:56.070363 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29acbed0-9f3e-440c-bc1a-a3e9a8948997 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:56.075479 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad2dca9-eb29-473d-8f3b-a39de8b061be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:56.076095 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad2dca9-eb29-473d-8f3b-a39de8b061be admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:56.076382 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad2dca9-eb29-473d-8f3b-a39de8b061be admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:56.076656 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad2dca9-eb29-473d-8f3b-a39de8b061be admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:56.077295 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad2dca9-eb29-473d-8f3b-a39de8b061be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:56.078868 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad2dca9-eb29-473d-8f3b-a39de8b061be admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:56.089291 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1270/2550] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:35:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:35:56.093543 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20891c1-9f33-407b-9643-ff33fda6d8bf admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:56.103225 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20891c1-9f33-407b-9643-ff33fda6d8bf admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:56.107818 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe7a070-b8b6-4991-9997-60ad1c2fac9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:56.108403 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7a070-b8b6-4991-9997-60ad1c2fac9c admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:56.108678 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7a070-b8b6-4991-9997-60ad1c2fac9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:56.108944 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7a070-b8b6-4991-9997-60ad1c2fac9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:56.109599 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe7a070-b8b6-4991-9997-60ad1c2fac9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:56.111159 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe7a070-b8b6-4991-9997-60ad1c2fac9c admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:56.121036 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1281/2551] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:35:56 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 03:35:56.125063 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad2dca9-eb29-473d-8f3b-a39de8b061be admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:56.134842 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad2dca9-eb29-473d-8f3b-a39de8b061be admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:56.139952 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304753e6-d4b0-44a4-afc5-3a962c1582f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:56.140585 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304753e6-d4b0-44a4-afc5-3a962c1582f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:56.140867 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304753e6-d4b0-44a4-afc5-3a962c1582f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:56.141143 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304753e6-d4b0-44a4-afc5-3a962c1582f4 admin admin] PATH_INFO: `/v3/projects/7721dc014eec45dda08b5d89b1bd20c4/users/e617dc8187ce4c39ae38d34a92d00d9f/roles/04d0e4575a28440eb4349b4a6565e8b8` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:56.155947 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304753e6-d4b0-44a4-afc5-3a962c1582f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7721dc014eec45dda08b5d89b1bd20c4, user_id=e617dc8187ce4c39ae38d34a92d00d9f, role_id=04d0e4575a28440eb4349b4a6565e8b8)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:56.158502 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304753e6-d4b0-44a4-afc5-3a962c1582f4 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:56.171539 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1271/2552] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:35:56 2022] PUT /identity/v3/projects/7721dc014eec45dda08b5d89b1bd20c4/users/e617dc8187ce4c39ae38d34a92d00d9f/roles/04d0e4575a28440eb4349b4a6565e8b8 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:35:56.181604 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0cef1e-de60-4bf0-9cb5-b3cc38162ebd None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:56.181888 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0cef1e-de60-4bf0-9cb5-b3cc38162ebd None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:56.182163 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0cef1e-de60-4bf0-9cb5-b3cc38162ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:56.211178 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-eb0cef1e-de60-4bf0-9cb5-b3cc38162ebd None None] MFA Rules not processed for user `e617dc8187ce4c39ae38d34a92d00d9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:35:56.212414 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-eb0cef1e-de60-4bf0-9cb5-b3cc38162ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:56.275977 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1282/2553] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:35:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:35:56.280462 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304753e6-d4b0-44a4-afc5-3a962c1582f4 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:56.289219 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:35:56.343492 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304753e6-d4b0-44a4-afc5-3a962c1582f4 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:56.348178 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfe4fd7-978a-450f-bfc3-e4ac82ab8d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:56.348772 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe4fd7-978a-450f-bfc3-e4ac82ab8d5f admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:56.349057 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe4fd7-978a-450f-bfc3-e4ac82ab8d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:56.349363 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe4fd7-978a-450f-bfc3-e4ac82ab8d5f admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:56.350009 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfe4fd7-978a-450f-bfc3-e4ac82ab8d5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:56.351955 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfe4fd7-978a-450f-bfc3-e4ac82ab8d5f admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:56.379343 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1272/2554] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:35:56 2022] POST /identity/v3/projects => generated 383 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:35:56.383506 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0cef1e-de60-4bf0-9cb5-b3cc38162ebd None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:56.394154 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0cef1e-de60-4bf0-9cb5-b3cc38162ebd None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:56.443630 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:35:56.454010 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a8dbe5-fb3f-4ce4-83b2-11454a4918a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:56.454612 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a8dbe5-fb3f-4ce4-83b2-11454a4918a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:56.454887 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a8dbe5-fb3f-4ce4-83b2-11454a4918a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:56.455160 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a8dbe5-fb3f-4ce4-83b2-11454a4918a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:56.455840 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a8dbe5-fb3f-4ce4-83b2-11454a4918a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:56.457818 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a8dbe5-fb3f-4ce4-83b2-11454a4918a4 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:56.479250 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1283/2555] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:35:56 2022] POST /identity/v3/users => generated 298 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:35:56.484254 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfe4fd7-978a-450f-bfc3-e4ac82ab8d5f admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:56.494457 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfe4fd7-978a-450f-bfc3-e4ac82ab8d5f admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:56.499288 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d38788-cfc5-41a0-a15f-7bd1727edd96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:56.499929 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d38788-cfc5-41a0-a15f-7bd1727edd96 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:56.500228 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d38788-cfc5-41a0-a15f-7bd1727edd96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:56.500484 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d38788-cfc5-41a0-a15f-7bd1727edd96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:56.502324 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d38788-cfc5-41a0-a15f-7bd1727edd96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:56.502709 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d38788-cfc5-41a0-a15f-7bd1727edd96 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:56.513208 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1273/2556] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:35:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:35:56.517317 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a8dbe5-fb3f-4ce4-83b2-11454a4918a4 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:56.527843 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a8dbe5-fb3f-4ce4-83b2-11454a4918a4 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:56.532453 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc8dbb6-6b2c-4d6f-abf0-32669bb7336e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:56.533092 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8dbb6-6b2c-4d6f-abf0-32669bb7336e admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:56.533368 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8dbb6-6b2c-4d6f-abf0-32669bb7336e admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:56.533637 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8dbb6-6b2c-4d6f-abf0-32669bb7336e admin admin] PATH_INFO: `/v3/projects/0a280eecaacc45a49da8c6bbce8aff5b/users/7689c05df0994607bd28971e9b2295eb/roles/fe9379cda35c4ff78576fe48b60bea3c` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:56.548496 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc8dbb6-6b2c-4d6f-abf0-32669bb7336e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a280eecaacc45a49da8c6bbce8aff5b, user_id=7689c05df0994607bd28971e9b2295eb, role_id=fe9379cda35c4ff78576fe48b60bea3c)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:56.551072 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc8dbb6-6b2c-4d6f-abf0-32669bb7336e admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:56.563346 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1284/2557] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:35:56 2022] PUT /identity/v3/projects/0a280eecaacc45a49da8c6bbce8aff5b/users/7689c05df0994607bd28971e9b2295eb/roles/fe9379cda35c4ff78576fe48b60bea3c => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:35:56.567621 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d38788-cfc5-41a0-a15f-7bd1727edd96 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:56.578437 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d38788-cfc5-41a0-a15f-7bd1727edd96 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:56.633807 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f64b864-d139-46f8-94e7-632c3378c5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:56.634471 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f64b864-d139-46f8-94e7-632c3378c5d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:56.634671 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f64b864-d139-46f8-94e7-632c3378c5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:56.634945 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f64b864-d139-46f8-94e7-632c3378c5d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:56.636264 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f64b864-d139-46f8-94e7-632c3378c5d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:56.638422 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f64b864-d139-46f8-94e7-632c3378c5d1 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:56.648110 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1274/2558] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:35:56 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:35:56.652988 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc8dbb6-6b2c-4d6f-abf0-32669bb7336e admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:56.663227 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc8dbb6-6b2c-4d6f-abf0-32669bb7336e admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:56.668325 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57818a8c-5cb4-47a0-8a70-8dde84770d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:56.668974 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57818a8c-5cb4-47a0-8a70-8dde84770d49 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:56.669285 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57818a8c-5cb4-47a0-8a70-8dde84770d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:56.669559 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57818a8c-5cb4-47a0-8a70-8dde84770d49 admin admin] PATH_INFO: `/v3/projects/0a280eecaacc45a49da8c6bbce8aff5b/users/7689c05df0994607bd28971e9b2295eb/roles/fe9379cda35c4ff78576fe48b60bea3c` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:56.671472 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57818a8c-5cb4-47a0-8a70-8dde84770d49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a280eecaacc45a49da8c6bbce8aff5b, user_id=7689c05df0994607bd28971e9b2295eb, role_id=fe9379cda35c4ff78576fe48b60bea3c)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:56.674097 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57818a8c-5cb4-47a0-8a70-8dde84770d49 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:56.684348 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1285/2559] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:35:56 2022] PUT /identity/v3/projects/0a280eecaacc45a49da8c6bbce8aff5b/users/7689c05df0994607bd28971e9b2295eb/roles/fe9379cda35c4ff78576fe48b60bea3c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 03:35:56.695874 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87593169-937a-4e2c-92c0-405ab9063ccd None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:56.696096 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87593169-937a-4e2c-92c0-405ab9063ccd None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:56.696368 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87593169-937a-4e2c-92c0-405ab9063ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:56.724554 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-87593169-937a-4e2c-92c0-405ab9063ccd None None] MFA Rules not processed for user `7689c05df0994607bd28971e9b2295eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:35:56.725740 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-87593169-937a-4e2c-92c0-405ab9063ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:56.794435 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1275/2560] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:35:56 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:35:56.805191 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57818a8c-5cb4-47a0-8a70-8dde84770d49 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:56.806880 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-57818a8c-5cb4-47a0-8a70-8dde84770d49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:56.865211 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57818a8c-5cb4-47a0-8a70-8dde84770d49 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:56.868805 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26118b80-5d73-4ff8-93ab-b65122585b80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f537aabf3d1040ff840b02616f839975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:56.869388 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26118b80-5d73-4ff8-93ab-b65122585b80 service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:56.869669 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26118b80-5d73-4ff8-93ab-b65122585b80 service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:56.870519 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26118b80-5d73-4ff8-93ab-b65122585b80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:56.879296 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26118b80-5d73-4ff8-93ab-b65122585b80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:56.880893 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26118b80-5d73-4ff8-93ab-b65122585b80 service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:56.891234 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1286/2561] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:35:56 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:35:56.993718 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87593169-937a-4e2c-92c0-405ab9063ccd None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:56.998716 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:35:57.005476 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87593169-937a-4e2c-92c0-405ab9063ccd None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:57.009309 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500ed04d-beb0-48d0-8faf-41ba67401d1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f537aabf3d1040ff840b02616f839975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:57.009899 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ed04d-beb0-48d0-8faf-41ba67401d1a service cinder] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:57.010179 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ed04d-beb0-48d0-8faf-41ba67401d1a service cinder] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:57.010489 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ed04d-beb0-48d0-8faf-41ba67401d1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:57.069577 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500ed04d-beb0-48d0-8faf-41ba67401d1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:57.071026 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500ed04d-beb0-48d0-8faf-41ba67401d1a service cinder] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:57.080745 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1276/2562] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:35:56 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:35:59.691040 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26118b80-5d73-4ff8-93ab-b65122585b80 service cinder] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:59.755192 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26118b80-5d73-4ff8-93ab-b65122585b80 service cinder] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:35:59.759865 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c04a50a-b26e-4353-8466-a7f6400f7c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:35:59.760492 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c04a50a-b26e-4353-8466-a7f6400f7c7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:59.761334 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c04a50a-b26e-4353-8466-a7f6400f7c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:59.761764 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c04a50a-b26e-4353-8466-a7f6400f7c7c admin admin] PATH_INFO: `/v3/users/e617dc8187ce4c39ae38d34a92d00d9f` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:59.763213 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c04a50a-b26e-4353-8466-a7f6400f7c7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e617dc8187ce4c39ae38d34a92d00d9f)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:35:59.765304 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c04a50a-b26e-4353-8466-a7f6400f7c7c admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:35:59.818680 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-2c04a50a-b26e-4353-8466-a7f6400f7c7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e617dc8187ce4c39ae38d34a92d00d9f'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:59.819927 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-2c04a50a-b26e-4353-8466-a7f6400f7c7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e617dc8187ce4c39ae38d34a92d00d9f'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:59.836092 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-2c04a50a-b26e-4353-8466-a7f6400f7c7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e617dc8187ce4c39ae38d34a92d00d9f'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:59.836092 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-2c04a50a-b26e-4353-8466-a7f6400f7c7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e617dc8187ce4c39ae38d34a92d00d9f'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:59.836092 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=86,keystone:INSERT=6,keystone:DELETE=8 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:35:59.846923 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-2c04a50a-b26e-4353-8466-a7f6400f7c7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e617dc8187ce4c39ae38d34a92d00d9f'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:35:59.860053 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1287/2563] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:35:59 2022] DELETE /identity/v3/users/e617dc8187ce4c39ae38d34a92d00d9f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:35:59.864831 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcbb2ad-434a-4516-aa4f-7dbd8755f08c None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:35:59.865280 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcbb2ad-434a-4516-aa4f-7dbd8755f08c None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:35:59.865393 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcbb2ad-434a-4516-aa4f-7dbd8755f08c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:35:59.883987 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-0dcbb2ad-434a-4516-aa4f-7dbd8755f08c None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:35:59.885185 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-0dcbb2ad-434a-4516-aa4f-7dbd8755f08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:35:59.944444 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1277/2564] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:35:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:35:59.954640 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c04a50a-b26e-4353-8466-a7f6400f7c7c admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:35:59.956075 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-2c04a50a-b26e-4353-8466-a7f6400f7c7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:00.013963 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c04a50a-b26e-4353-8466-a7f6400f7c7c admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:00.017595 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f294271-5199-4149-9d24-57c98289ce4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:00.018183 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f294271-5199-4149-9d24-57c98289ce4b service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:00.018458 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f294271-5199-4149-9d24-57c98289ce4b service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:00.018727 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f294271-5199-4149-9d24-57c98289ce4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:00.028104 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f294271-5199-4149-9d24-57c98289ce4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:00.029590 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f294271-5199-4149-9d24-57c98289ce4b service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:00.039049 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1288/2565] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:35:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:36:00.301428 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcbb2ad-434a-4516-aa4f-7dbd8755f08c None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:00.303530 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-0dcbb2ad-434a-4516-aa4f-7dbd8755f08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:00.318397 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcbb2ad-434a-4516-aa4f-7dbd8755f08c None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:00.323812 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7698abf3-0d4e-449d-9c8c-37958dd63ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:00.324436 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698abf3-0d4e-449d-9c8c-37958dd63ae6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:00.324836 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698abf3-0d4e-449d-9c8c-37958dd63ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:00.325109 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698abf3-0d4e-449d-9c8c-37958dd63ae6 admin admin] PATH_INFO: `/v3/projects/7721dc014eec45dda08b5d89b1bd20c4` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:00.326404 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7698abf3-0d4e-449d-9c8c-37958dd63ae6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7721dc014eec45dda08b5d89b1bd20c4)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:00.328412 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7698abf3-0d4e-449d-9c8c-37958dd63ae6 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:00.378205 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-7698abf3-0d4e-449d-9c8c-37958dd63ae6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7721dc014eec45dda08b5d89b1bd20c4', 'request_id': 'req-7698abf3-0d4e-449d-9c8c-37958dd63ae6'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:00.384004 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-7698abf3-0d4e-449d-9c8c-37958dd63ae6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7721dc014eec45dda08b5d89b1bd20c4', 'request_id': 'req-7698abf3-0d4e-449d-9c8c-37958dd63ae6'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:00.390183 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-7698abf3-0d4e-449d-9c8c-37958dd63ae6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7721dc014eec45dda08b5d89b1bd20c4', 'request_id': 'req-7698abf3-0d4e-449d-9c8c-37958dd63ae6'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:00.402399 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-7698abf3-0d4e-449d-9c8c-37958dd63ae6 admin admin] The token cache is being invalidate because project 7721dc014eec45dda08b5d89b1bd20c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:36:00.402682 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-7698abf3-0d4e-449d-9c8c-37958dd63ae6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:00.403295 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-7698abf3-0d4e-449d-9c8c-37958dd63ae6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:00.404784 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1278/2566] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:36:00 2022] DELETE /identity/v3/projects/7721dc014eec45dda08b5d89b1bd20c4 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:36:00.408863 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f294271-5199-4149-9d24-57c98289ce4b service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:00.419875 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f294271-5199-4149-9d24-57c98289ce4b service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:00.476070 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae40acb-9d46-4e88-be2c-43faea1c4bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:00.476683 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae40acb-9d46-4e88-be2c-43faea1c4bf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:00.476963 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae40acb-9d46-4e88-be2c-43faea1c4bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:00.477235 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae40acb-9d46-4e88-be2c-43faea1c4bf3 admin admin] PATH_INFO: `/v3/users/7689c05df0994607bd28971e9b2295eb` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:00.478336 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae40acb-9d46-4e88-be2c-43faea1c4bf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7689c05df0994607bd28971e9b2295eb)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:00.480755 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae40acb-9d46-4e88-be2c-43faea1c4bf3 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:00.525658 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-fae40acb-9d46-4e88-be2c-43faea1c4bf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7689c05df0994607bd28971e9b2295eb'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:00.526370 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-fae40acb-9d46-4e88-be2c-43faea1c4bf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7689c05df0994607bd28971e9b2295eb'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:00.534642 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-fae40acb-9d46-4e88-be2c-43faea1c4bf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7689c05df0994607bd28971e9b2295eb'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:00.535271 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-fae40acb-9d46-4e88-be2c-43faea1c4bf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7689c05df0994607bd28971e9b2295eb'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:00.547738 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-fae40acb-9d46-4e88-be2c-43faea1c4bf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7689c05df0994607bd28971e9b2295eb'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:00.552053 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:36:00.562956 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1289/2567] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:36:00 2022] DELETE /identity/v3/users/7689c05df0994607bd28971e9b2295eb => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:36:00.829340 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7698abf3-0d4e-449d-9c8c-37958dd63ae6 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:00.830801 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-7698abf3-0d4e-449d-9c8c-37958dd63ae6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:00.844176 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7698abf3-0d4e-449d-9c8c-37958dd63ae6 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:00.868468 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:36:00.909281 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d8da2-eda5-433e-8f54-5c2e354fd14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:00.909944 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d8da2-eda5-433e-8f54-5c2e354fd14f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:00.910228 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d8da2-eda5-433e-8f54-5c2e354fd14f admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:00.910502 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d8da2-eda5-433e-8f54-5c2e354fd14f admin admin] PATH_INFO: `/v3/projects/0a280eecaacc45a49da8c6bbce8aff5b` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:00.911669 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569d8da2-eda5-433e-8f54-5c2e354fd14f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a280eecaacc45a49da8c6bbce8aff5b)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:00.913823 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569d8da2-eda5-433e-8f54-5c2e354fd14f admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:00.961391 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-569d8da2-eda5-433e-8f54-5c2e354fd14f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a280eecaacc45a49da8c6bbce8aff5b', 'request_id': 'req-569d8da2-eda5-433e-8f54-5c2e354fd14f'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:00.967080 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-569d8da2-eda5-433e-8f54-5c2e354fd14f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a280eecaacc45a49da8c6bbce8aff5b', 'request_id': 'req-569d8da2-eda5-433e-8f54-5c2e354fd14f'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:00.973138 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-569d8da2-eda5-433e-8f54-5c2e354fd14f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a280eecaacc45a49da8c6bbce8aff5b', 'request_id': 'req-569d8da2-eda5-433e-8f54-5c2e354fd14f'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:00.989089 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-569d8da2-eda5-433e-8f54-5c2e354fd14f admin admin] The token cache is being invalidate because project 0a280eecaacc45a49da8c6bbce8aff5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:36:00.989382 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-569d8da2-eda5-433e-8f54-5c2e354fd14f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:00.990008 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-569d8da2-eda5-433e-8f54-5c2e354fd14f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:00.991507 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1279/2568] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:36:00 2022] DELETE /identity/v3/projects/0a280eecaacc45a49da8c6bbce8aff5b => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:36:00.998458 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69a07c-9d3a-4e0e-b40f-8712e278397f None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:00.998965 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69a07c-9d3a-4e0e-b40f-8712e278397f None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:00.999290 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69a07c-9d3a-4e0e-b40f-8712e278397f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:01.019869 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-4f69a07c-9d3a-4e0e-b40f-8712e278397f None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:36:01.021081 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-4f69a07c-9d3a-4e0e-b40f-8712e278397f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:01.083057 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1290/2569] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:36:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:36:01.091627 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4f9a6a-9e02-4dc1-b954-88aab130a369 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:01.091991 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4f9a6a-9e02-4dc1-b954-88aab130a369 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:01.092331 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4f9a6a-9e02-4dc1-b954-88aab130a369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:01.113481 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-6b4f9a6a-9e02-4dc1-b954-88aab130a369 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:36:01.114887 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-6b4f9a6a-9e02-4dc1-b954-88aab130a369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:01.123976 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1280/2570] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:36:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:36:01.128157 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f69a07c-9d3a-4e0e-b40f-8712e278397f None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:01.138895 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f69a07c-9d3a-4e0e-b40f-8712e278397f None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:01.144280 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c60408d-4676-47f7-9d2d-a988197db570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:01.144866 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c60408d-4676-47f7-9d2d-a988197db570 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:01.145149 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c60408d-4676-47f7-9d2d-a988197db570 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:01.145423 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c60408d-4676-47f7-9d2d-a988197db570 admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:01.146062 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c60408d-4676-47f7-9d2d-a988197db570 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:36:01.146384 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c60408d-4676-47f7-9d2d-a988197db570 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:01.147976 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c60408d-4676-47f7-9d2d-a988197db570 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:01.160784 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1291/2571] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 03:36:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:36:01.165374 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4f9a6a-9e02-4dc1-b954-88aab130a369 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:01.176819 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4f9a6a-9e02-4dc1-b954-88aab130a369 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:01.183770 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b8d59e-5fb5-4feb-aa7c-aa8266a03fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:01.184652 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b8d59e-5fb5-4feb-aa7c-aa8266a03fe2 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:01.185019 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b8d59e-5fb5-4feb-aa7c-aa8266a03fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:01.185390 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b8d59e-5fb5-4feb-aa7c-aa8266a03fe2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:01.186232 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b8d59e-5fb5-4feb-aa7c-aa8266a03fe2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:01.188287 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b8d59e-5fb5-4feb-aa7c-aa8266a03fe2 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:01.219789 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1281/2572] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:36:01 2022] POST /identity/v3/projects => generated 387 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:36:01.223544 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c60408d-4676-47f7-9d2d-a988197db570 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:01.234238 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c60408d-4676-47f7-9d2d-a988197db570 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:01.293788 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c95069f-eadd-4544-994e-b8eee2aa565b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:01.294391 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c95069f-eadd-4544-994e-b8eee2aa565b admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:01.294675 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c95069f-eadd-4544-994e-b8eee2aa565b admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:01.294949 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c95069f-eadd-4544-994e-b8eee2aa565b admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:01.295672 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c95069f-eadd-4544-994e-b8eee2aa565b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:01.297843 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c95069f-eadd-4544-994e-b8eee2aa565b admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:01.319711 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1292/2573] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:36:01 2022] POST /identity/v3/users => generated 294 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:36:01.324713 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b8d59e-5fb5-4feb-aa7c-aa8266a03fe2 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:01.335744 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b8d59e-5fb5-4feb-aa7c-aa8266a03fe2 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:01.341393 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592af960-c66f-415f-9ef7-4ed6e949518f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:01.342029 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592af960-c66f-415f-9ef7-4ed6e949518f admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:01.342353 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592af960-c66f-415f-9ef7-4ed6e949518f admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:01.342623 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592af960-c66f-415f-9ef7-4ed6e949518f admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:01.343264 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592af960-c66f-415f-9ef7-4ed6e949518f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:01.344882 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592af960-c66f-415f-9ef7-4ed6e949518f admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:01.357784 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1282/2574] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:36:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:36:01.361953 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c95069f-eadd-4544-994e-b8eee2aa565b admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:01.372527 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c95069f-eadd-4544-994e-b8eee2aa565b admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:01.377761 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ef8619-af29-452a-a486-de3dfb4c43ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:01.378352 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ef8619-af29-452a-a486-de3dfb4c43ff admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:01.378629 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ef8619-af29-452a-a486-de3dfb4c43ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:01.378900 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ef8619-af29-452a-a486-de3dfb4c43ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:01.379573 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ef8619-af29-452a-a486-de3dfb4c43ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:01.381150 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ef8619-af29-452a-a486-de3dfb4c43ff admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:01.393463 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1293/2575] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:36:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:36:01.397626 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592af960-c66f-415f-9ef7-4ed6e949518f admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:01.408853 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592af960-c66f-415f-9ef7-4ed6e949518f admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:01.413878 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebcbf09-9c15-44ac-b04a-679e8de60fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:01.414630 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebcbf09-9c15-44ac-b04a-679e8de60fd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:01.415023 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebcbf09-9c15-44ac-b04a-679e8de60fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:01.415314 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebcbf09-9c15-44ac-b04a-679e8de60fd3 admin admin] PATH_INFO: `/v3/projects/bd63ff28400b426c9f17727fedfd6f68/users/0aafaf1f1b2543218609a3c9cd328279/roles/04d0e4575a28440eb4349b4a6565e8b8` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:01.429948 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebcbf09-9c15-44ac-b04a-679e8de60fd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd63ff28400b426c9f17727fedfd6f68, user_id=0aafaf1f1b2543218609a3c9cd328279, role_id=04d0e4575a28440eb4349b4a6565e8b8)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:01.432697 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebcbf09-9c15-44ac-b04a-679e8de60fd3 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:01.445923 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1283/2576] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:36:01 2022] PUT /identity/v3/projects/bd63ff28400b426c9f17727fedfd6f68/users/0aafaf1f1b2543218609a3c9cd328279/roles/04d0e4575a28440eb4349b4a6565e8b8 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:36:01.456757 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20775343-6cc4-45c5-b8f4-0f1ef36db47a None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:01.457050 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20775343-6cc4-45c5-b8f4-0f1ef36db47a None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:01.457330 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20775343-6cc4-45c5-b8f4-0f1ef36db47a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:01.487082 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-20775343-6cc4-45c5-b8f4-0f1ef36db47a None None] MFA Rules not processed for user `0aafaf1f1b2543218609a3c9cd328279`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:36:01.488326 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-20775343-6cc4-45c5-b8f4-0f1ef36db47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:01.538181 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:36:01.556842 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1294/2577] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:36:01 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:36:01.561805 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebcbf09-9c15-44ac-b04a-679e8de60fd3 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:01.610901 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:36:01.623951 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebcbf09-9c15-44ac-b04a-679e8de60fd3 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:01.628986 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb369f93-9ddc-41c2-8b3b-b4f72eb555fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:01.629587 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb369f93-9ddc-41c2-8b3b-b4f72eb555fe admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:01.629869 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb369f93-9ddc-41c2-8b3b-b4f72eb555fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:01.630144 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb369f93-9ddc-41c2-8b3b-b4f72eb555fe admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:01.630780 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb369f93-9ddc-41c2-8b3b-b4f72eb555fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:01.632707 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb369f93-9ddc-41c2-8b3b-b4f72eb555fe admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:01.660141 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1284/2578] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:36:01 2022] POST /identity/v3/projects => generated 389 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:36:01.664237 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20775343-6cc4-45c5-b8f4-0f1ef36db47a None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:01.674673 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20775343-6cc4-45c5-b8f4-0f1ef36db47a None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:01.730173 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1f42cf-54ca-44b8-a963-f134fcb71dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:01.730771 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1f42cf-54ca-44b8-a963-f134fcb71dfa admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:01.731051 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1f42cf-54ca-44b8-a963-f134fcb71dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:01.731322 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1f42cf-54ca-44b8-a963-f134fcb71dfa admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:01.732012 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1f42cf-54ca-44b8-a963-f134fcb71dfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:01.733894 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1f42cf-54ca-44b8-a963-f134fcb71dfa admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:01.755378 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1295/2579] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:36:01 2022] POST /identity/v3/users => generated 301 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:36:01.759301 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb369f93-9ddc-41c2-8b3b-b4f72eb555fe admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:01.770243 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb369f93-9ddc-41c2-8b3b-b4f72eb555fe admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:01.774937 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7440a745-0a49-4060-a185-cc44b1aed73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:01.775554 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440a745-0a49-4060-a185-cc44b1aed73e admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:01.775838 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440a745-0a49-4060-a185-cc44b1aed73e admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:01.776109 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440a745-0a49-4060-a185-cc44b1aed73e admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:01.776840 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7440a745-0a49-4060-a185-cc44b1aed73e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:01.778406 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7440a745-0a49-4060-a185-cc44b1aed73e admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:01.788586 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1285/2580] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:36:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:36:01.792918 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1f42cf-54ca-44b8-a963-f134fcb71dfa admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:01.802596 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1f42cf-54ca-44b8-a963-f134fcb71dfa admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:01.807022 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c18a9c-b1ac-4fb2-905d-60e3c22eefc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:01.808274 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c18a9c-b1ac-4fb2-905d-60e3c22eefc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:01.808560 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c18a9c-b1ac-4fb2-905d-60e3c22eefc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:01.808833 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c18a9c-b1ac-4fb2-905d-60e3c22eefc8 admin admin] PATH_INFO: `/v3/projects/a534626904574972a2310b24b241fe37/users/8e029287922c4a52bfa848fa23821abb/roles/fe9379cda35c4ff78576fe48b60bea3c` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:01.823925 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c18a9c-b1ac-4fb2-905d-60e3c22eefc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a534626904574972a2310b24b241fe37, user_id=8e029287922c4a52bfa848fa23821abb, role_id=fe9379cda35c4ff78576fe48b60bea3c)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:01.826512 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c18a9c-b1ac-4fb2-905d-60e3c22eefc8 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:01.838721 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1296/2581] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:36:01 2022] PUT /identity/v3/projects/a534626904574972a2310b24b241fe37/users/8e029287922c4a52bfa848fa23821abb/roles/fe9379cda35c4ff78576fe48b60bea3c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:36:01.842573 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7440a745-0a49-4060-a185-cc44b1aed73e admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:01.852303 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7440a745-0a49-4060-a185-cc44b1aed73e admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:01.908160 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8bdc88-d230-47d2-8cc8-cd6285a49851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:01.908791 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8bdc88-d230-47d2-8cc8-cd6285a49851 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:01.908956 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8bdc88-d230-47d2-8cc8-cd6285a49851 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:01.909279 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8bdc88-d230-47d2-8cc8-cd6285a49851 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:01.909873 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8bdc88-d230-47d2-8cc8-cd6285a49851 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:01.911456 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8bdc88-d230-47d2-8cc8-cd6285a49851 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:01.921413 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1286/2582] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:36:01 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 03:36:01.925626 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c18a9c-b1ac-4fb2-905d-60e3c22eefc8 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:01.935872 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c18a9c-b1ac-4fb2-905d-60e3c22eefc8 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:01.940447 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8d73d7-27ee-4ee0-85ff-fcd1b6910d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:01.941078 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d73d7-27ee-4ee0-85ff-fcd1b6910d31 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:01.941358 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d73d7-27ee-4ee0-85ff-fcd1b6910d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:01.941649 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d73d7-27ee-4ee0-85ff-fcd1b6910d31 admin admin] PATH_INFO: `/v3/projects/a534626904574972a2310b24b241fe37/users/8e029287922c4a52bfa848fa23821abb/roles/fe9379cda35c4ff78576fe48b60bea3c` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:01.943546 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8d73d7-27ee-4ee0-85ff-fcd1b6910d31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a534626904574972a2310b24b241fe37, user_id=8e029287922c4a52bfa848fa23821abb, role_id=fe9379cda35c4ff78576fe48b60bea3c)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:01.946391 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8d73d7-27ee-4ee0-85ff-fcd1b6910d31 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:01.957037 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1297/2583] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:36:01 2022] PUT /identity/v3/projects/a534626904574972a2310b24b241fe37/users/8e029287922c4a52bfa848fa23821abb/roles/fe9379cda35c4ff78576fe48b60bea3c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:36:01.968848 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beadd95a-9c26-4b6e-b93b-260e0dc761f2 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:01.969134 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beadd95a-9c26-4b6e-b93b-260e0dc761f2 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:01.969432 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beadd95a-9c26-4b6e-b93b-260e0dc761f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:01.998804 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-beadd95a-9c26-4b6e-b93b-260e0dc761f2 None None] MFA Rules not processed for user `8e029287922c4a52bfa848fa23821abb`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:36:02.000029 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-beadd95a-9c26-4b6e-b93b-260e0dc761f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:02.066644 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1287/2584] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:36:01 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:36:02.078110 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8d73d7-27ee-4ee0-85ff-fcd1b6910d31 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:02.079894 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-6b8d73d7-27ee-4ee0-85ff-fcd1b6910d31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:02.136402 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8d73d7-27ee-4ee0-85ff-fcd1b6910d31 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:02.140041 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cd2956-411d-4aaf-b53d-8b5226af1123 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f537aabf3d1040ff840b02616f839975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:02.140633 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd2956-411d-4aaf-b53d-8b5226af1123 service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:02.140918 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd2956-411d-4aaf-b53d-8b5226af1123 service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:02.141192 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd2956-411d-4aaf-b53d-8b5226af1123 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:02.149936 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cd2956-411d-4aaf-b53d-8b5226af1123 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:02.151369 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cd2956-411d-4aaf-b53d-8b5226af1123 service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:02.160682 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1298/2585] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:36:02 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:36:02.297745 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beadd95a-9c26-4b6e-b93b-260e0dc761f2 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:02.349183 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:36:02.365195 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beadd95a-9c26-4b6e-b93b-260e0dc761f2 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:02.370051 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc45278b-0cc4-40c1-8949-71d92114c261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:02.370708 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc45278b-0cc4-40c1-8949-71d92114c261 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:02.370963 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc45278b-0cc4-40c1-8949-71d92114c261 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:02.371218 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc45278b-0cc4-40c1-8949-71d92114c261 admin admin] PATH_INFO: `/v3/users/0aafaf1f1b2543218609a3c9cd328279` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:02.372595 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc45278b-0cc4-40c1-8949-71d92114c261 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0aafaf1f1b2543218609a3c9cd328279)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:02.374867 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc45278b-0cc4-40c1-8949-71d92114c261 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:02.426827 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-dc45278b-0cc4-40c1-8949-71d92114c261 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0aafaf1f1b2543218609a3c9cd328279'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:02.434156 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-dc45278b-0cc4-40c1-8949-71d92114c261 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0aafaf1f1b2543218609a3c9cd328279'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:02.444910 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-dc45278b-0cc4-40c1-8949-71d92114c261 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0aafaf1f1b2543218609a3c9cd328279'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:02.445628 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-dc45278b-0cc4-40c1-8949-71d92114c261 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0aafaf1f1b2543218609a3c9cd328279'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:02.458236 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-dc45278b-0cc4-40c1-8949-71d92114c261 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0aafaf1f1b2543218609a3c9cd328279'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:02.464861 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1288/2586] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:36:02 2022] DELETE /identity/v3/users/0aafaf1f1b2543218609a3c9cd328279 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:36:02.469390 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066f378-c7fe-4d0c-abe3-58771e7516c9 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:02.469681 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066f378-c7fe-4d0c-abe3-58771e7516c9 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:02.469985 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066f378-c7fe-4d0c-abe3-58771e7516c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:02.489449 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-3066f378-c7fe-4d0c-abe3-58771e7516c9 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:36:02.490754 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-3066f378-c7fe-4d0c-abe3-58771e7516c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:02.532342 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:36:02.554964 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1299/2587] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:36:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:36:02.564864 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc45278b-0cc4-40c1-8949-71d92114c261 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:02.566288 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-dc45278b-0cc4-40c1-8949-71d92114c261 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:02.624917 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc45278b-0cc4-40c1-8949-71d92114c261 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:02.628588 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26158990-6ebe-4d15-b8ed-d58545e1b27c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:02.629197 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26158990-6ebe-4d15-b8ed-d58545e1b27c service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:02.629478 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26158990-6ebe-4d15-b8ed-d58545e1b27c service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:02.629755 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26158990-6ebe-4d15-b8ed-d58545e1b27c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:02.639823 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26158990-6ebe-4d15-b8ed-d58545e1b27c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:02.641254 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26158990-6ebe-4d15-b8ed-d58545e1b27c service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:02.650816 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1289/2588] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:36:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:36:02.922066 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3066f378-c7fe-4d0c-abe3-58771e7516c9 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:02.923766 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-3066f378-c7fe-4d0c-abe3-58771e7516c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:02.937497 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3066f378-c7fe-4d0c-abe3-58771e7516c9 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:02.942341 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f920fa8-206d-4c4c-8cdc-2dccc451261d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:02.942966 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f920fa8-206d-4c4c-8cdc-2dccc451261d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:02.943243 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f920fa8-206d-4c4c-8cdc-2dccc451261d admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:02.943538 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f920fa8-206d-4c4c-8cdc-2dccc451261d admin admin] PATH_INFO: `/v3/projects/bd63ff28400b426c9f17727fedfd6f68` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:02.944926 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f920fa8-206d-4c4c-8cdc-2dccc451261d admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd63ff28400b426c9f17727fedfd6f68)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:02.946942 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f920fa8-206d-4c4c-8cdc-2dccc451261d admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:02.993968 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-7f920fa8-206d-4c4c-8cdc-2dccc451261d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd63ff28400b426c9f17727fedfd6f68', 'request_id': 'req-7f920fa8-206d-4c4c-8cdc-2dccc451261d'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:03.000099 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-7f920fa8-206d-4c4c-8cdc-2dccc451261d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd63ff28400b426c9f17727fedfd6f68', 'request_id': 'req-7f920fa8-206d-4c4c-8cdc-2dccc451261d'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:03.006147 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-7f920fa8-206d-4c4c-8cdc-2dccc451261d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd63ff28400b426c9f17727fedfd6f68', 'request_id': 'req-7f920fa8-206d-4c4c-8cdc-2dccc451261d'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:03.018735 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-7f920fa8-206d-4c4c-8cdc-2dccc451261d admin admin] The token cache is being invalidate because project bd63ff28400b426c9f17727fedfd6f68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:36:03.019025 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-7f920fa8-206d-4c4c-8cdc-2dccc451261d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:03.019676 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-7f920fa8-206d-4c4c-8cdc-2dccc451261d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:03.021139 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1300/2589] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:36:02 2022] DELETE /identity/v3/projects/bd63ff28400b426c9f17727fedfd6f68 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:36:03.025110 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26158990-6ebe-4d15-b8ed-d58545e1b27c service neutron] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:03.035209 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26158990-6ebe-4d15-b8ed-d58545e1b27c service neutron] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:03.098517 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe95590-3c8d-4792-ada8-218f546690ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:03.099133 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe95590-3c8d-4792-ada8-218f546690ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:03.099417 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe95590-3c8d-4792-ada8-218f546690ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:03.099727 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe95590-3c8d-4792-ada8-218f546690ea admin admin] PATH_INFO: `/v3/users/8e029287922c4a52bfa848fa23821abb` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:03.100848 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe95590-3c8d-4792-ada8-218f546690ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e029287922c4a52bfa848fa23821abb)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:03.102748 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe95590-3c8d-4792-ada8-218f546690ea admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:03.113474 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:36:03.150228 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-1fe95590-3c8d-4792-ada8-218f546690ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e029287922c4a52bfa848fa23821abb'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:03.157240 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-1fe95590-3c8d-4792-ada8-218f546690ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e029287922c4a52bfa848fa23821abb'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:03.163807 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-1fe95590-3c8d-4792-ada8-218f546690ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e029287922c4a52bfa848fa23821abb'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:03.164411 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-1fe95590-3c8d-4792-ada8-218f546690ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e029287922c4a52bfa848fa23821abb'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:03.175973 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-1fe95590-3c8d-4792-ada8-218f546690ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e029287922c4a52bfa848fa23821abb'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:03.181588 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1290/2590] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:36:03 2022] DELETE /identity/v3/users/8e029287922c4a52bfa848fa23821abb => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:36:03.460027 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f920fa8-206d-4c4c-8cdc-2dccc451261d admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:03.462650 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-7f920fa8-206d-4c4c-8cdc-2dccc451261d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:03.482622 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f920fa8-206d-4c4c-8cdc-2dccc451261d admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:03.545451 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f42837-6a69-4685-9b49-813f9884effe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:03.546109 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f42837-6a69-4685-9b49-813f9884effe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:03.546421 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f42837-6a69-4685-9b49-813f9884effe admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:03.546666 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f42837-6a69-4685-9b49-813f9884effe admin admin] PATH_INFO: `/v3/projects/a534626904574972a2310b24b241fe37` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:03.547906 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f42837-6a69-4685-9b49-813f9884effe admin admin] RBAC: Authorizing `identity:delete_project(project_id=a534626904574972a2310b24b241fe37)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:03.550016 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f42837-6a69-4685-9b49-813f9884effe admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:03.601599 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-f8f42837-6a69-4685-9b49-813f9884effe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a534626904574972a2310b24b241fe37', 'request_id': 'req-f8f42837-6a69-4685-9b49-813f9884effe'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:03.607435 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-f8f42837-6a69-4685-9b49-813f9884effe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a534626904574972a2310b24b241fe37', 'request_id': 'req-f8f42837-6a69-4685-9b49-813f9884effe'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:03.613937 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-f8f42837-6a69-4685-9b49-813f9884effe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a534626904574972a2310b24b241fe37', 'request_id': 'req-f8f42837-6a69-4685-9b49-813f9884effe'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:03.622486 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:36:03.628969 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-f8f42837-6a69-4685-9b49-813f9884effe admin admin] The token cache is being invalidate because project a534626904574972a2310b24b241fe37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:36:03.629267 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-f8f42837-6a69-4685-9b49-813f9884effe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:03.629927 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-f8f42837-6a69-4685-9b49-813f9884effe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:03.631464 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1301/2591] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:36:03 2022] DELETE /identity/v3/projects/a534626904574972a2310b24b241fe37 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:36:03.637087 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cccf4b-e1b2-43f1-9264-387bd4c46703 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:03.637874 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cccf4b-e1b2-43f1-9264-387bd4c46703 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:03.637874 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cccf4b-e1b2-43f1-9264-387bd4c46703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:03.658685 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-11cccf4b-e1b2-43f1-9264-387bd4c46703 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:36:03.659927 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-11cccf4b-e1b2-43f1-9264-387bd4c46703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:03.720561 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1291/2592] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:36:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:36:03.728475 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b169191-9927-4d6a-9edf-515e50fc9906 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:03.728792 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b169191-9927-4d6a-9edf-515e50fc9906 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:03.729099 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b169191-9927-4d6a-9edf-515e50fc9906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:03.750624 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-0b169191-9927-4d6a-9edf-515e50fc9906 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:36:03.751873 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-0b169191-9927-4d6a-9edf-515e50fc9906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:03.760195 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1302/2593] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:36:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:36:03.765073 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cccf4b-e1b2-43f1-9264-387bd4c46703 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:03.774603 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cccf4b-e1b2-43f1-9264-387bd4c46703 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:03.779743 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419651f9-651a-465b-ad28-7cf34298ad39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:03.780331 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419651f9-651a-465b-ad28-7cf34298ad39 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:03.780610 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419651f9-651a-465b-ad28-7cf34298ad39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:03.780883 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419651f9-651a-465b-ad28-7cf34298ad39 admin admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:03.781518 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419651f9-651a-465b-ad28-7cf34298ad39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:36:03.781879 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419651f9-651a-465b-ad28-7cf34298ad39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:03.783463 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419651f9-651a-465b-ad28-7cf34298ad39 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:03.794891 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1292/2594] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 03:36:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:36:03.799175 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b169191-9927-4d6a-9edf-515e50fc9906 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:03.809221 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b169191-9927-4d6a-9edf-515e50fc9906 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:03.813844 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdb87c7-01ac-42cb-a72f-2ae59706545a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:03.814431 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb87c7-01ac-42cb-a72f-2ae59706545a admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:03.814711 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb87c7-01ac-42cb-a72f-2ae59706545a admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:03.814984 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb87c7-01ac-42cb-a72f-2ae59706545a admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:03.815664 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdb87c7-01ac-42cb-a72f-2ae59706545a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:03.817639 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdb87c7-01ac-42cb-a72f-2ae59706545a admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:03.844987 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1303/2595] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:36:03 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:36:03.849208 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419651f9-651a-465b-ad28-7cf34298ad39 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:03.859037 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419651f9-651a-465b-ad28-7cf34298ad39 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:03.913676 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b4249f-0972-48be-900b-89722717222c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:03.914261 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b4249f-0972-48be-900b-89722717222c admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:03.914539 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b4249f-0972-48be-900b-89722717222c admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:03.914814 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b4249f-0972-48be-900b-89722717222c admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:03.915438 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b4249f-0972-48be-900b-89722717222c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:03.917382 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b4249f-0972-48be-900b-89722717222c admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:03.938344 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1293/2596] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:36:03 2022] POST /identity/v3/users => generated 290 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:36:03.942408 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdb87c7-01ac-42cb-a72f-2ae59706545a admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:03.953526 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdb87c7-01ac-42cb-a72f-2ae59706545a admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:03.958048 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab97f681-9d09-43d5-afb0-c3e6db5c53d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:03.958628 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab97f681-9d09-43d5-afb0-c3e6db5c53d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:03.958904 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab97f681-9d09-43d5-afb0-c3e6db5c53d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:03.959173 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab97f681-9d09-43d5-afb0-c3e6db5c53d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:03.959850 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab97f681-9d09-43d5-afb0-c3e6db5c53d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:03.961413 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab97f681-9d09-43d5-afb0-c3e6db5c53d1 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:03.971239 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1304/2597] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:36:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:36:03.975000 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b4249f-0972-48be-900b-89722717222c admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:03.981521 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:36:03.985731 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b4249f-0972-48be-900b-89722717222c admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:03.991820 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd75fc5-6aec-4386-bc12-f242bfd52356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:03.992424 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd75fc5-6aec-4386-bc12-f242bfd52356 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:03.992873 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd75fc5-6aec-4386-bc12-f242bfd52356 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:03.993359 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd75fc5-6aec-4386-bc12-f242bfd52356 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:03.994030 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd75fc5-6aec-4386-bc12-f242bfd52356 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:03.996331 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd75fc5-6aec-4386-bc12-f242bfd52356 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:04.007117 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1294/2598] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:36:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:36:04.012143 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab97f681-9d09-43d5-afb0-c3e6db5c53d1 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:04.022474 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab97f681-9d09-43d5-afb0-c3e6db5c53d1 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:04.027156 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186eb2ea-f160-4fa8-85ae-31a897845070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:04.027842 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186eb2ea-f160-4fa8-85ae-31a897845070 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:04.028127 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186eb2ea-f160-4fa8-85ae-31a897845070 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:04.028404 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186eb2ea-f160-4fa8-85ae-31a897845070 admin admin] PATH_INFO: `/v3/projects/84c7f641ed5d4df09201b5e412a72b52/users/de06b2ca8db34ba9b2a24b9cd06f7a89/roles/04d0e4575a28440eb4349b4a6565e8b8` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:04.042773 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186eb2ea-f160-4fa8-85ae-31a897845070 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84c7f641ed5d4df09201b5e412a72b52, user_id=de06b2ca8db34ba9b2a24b9cd06f7a89, role_id=04d0e4575a28440eb4349b4a6565e8b8)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:04.045400 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186eb2ea-f160-4fa8-85ae-31a897845070 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:04.058172 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1305/2599] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:36:04 2022] PUT /identity/v3/projects/84c7f641ed5d4df09201b5e412a72b52/users/de06b2ca8db34ba9b2a24b9cd06f7a89/roles/04d0e4575a28440eb4349b4a6565e8b8 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 03:36:04.072101 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac32176-be90-41f8-8c4b-48d571967291 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:04.072606 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac32176-be90-41f8-8c4b-48d571967291 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:04.072726 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac32176-be90-41f8-8c4b-48d571967291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:04.100727 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-1ac32176-be90-41f8-8c4b-48d571967291 None None] MFA Rules not processed for user `de06b2ca8db34ba9b2a24b9cd06f7a89`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:36:04.101944 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-1ac32176-be90-41f8-8c4b-48d571967291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:04.165989 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1295/2600] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:36:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:36:04.171239 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186eb2ea-f160-4fa8-85ae-31a897845070 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:04.232658 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186eb2ea-f160-4fa8-85ae-31a897845070 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:04.237144 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84194cab-b333-467d-9a54-1f4d5cdd3403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:04.237732 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84194cab-b333-467d-9a54-1f4d5cdd3403 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:04.238009 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84194cab-b333-467d-9a54-1f4d5cdd3403 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:04.238279 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84194cab-b333-467d-9a54-1f4d5cdd3403 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:04.238893 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84194cab-b333-467d-9a54-1f4d5cdd3403 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:04.240790 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84194cab-b333-467d-9a54-1f4d5cdd3403 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:04.266847 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1306/2601] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:36:04 2022] POST /identity/v3/projects => generated 377 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:36:04.270824 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac32176-be90-41f8-8c4b-48d571967291 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:04.281423 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac32176-be90-41f8-8c4b-48d571967291 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:04.338381 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1e2c86-598f-4b01-9106-13124b5f208b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:04.338984 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e2c86-598f-4b01-9106-13124b5f208b admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:04.339264 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e2c86-598f-4b01-9106-13124b5f208b admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:04.339565 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e2c86-598f-4b01-9106-13124b5f208b admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:04.340203 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1e2c86-598f-4b01-9106-13124b5f208b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:04.342093 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1e2c86-598f-4b01-9106-13124b5f208b admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:04.364227 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1296/2602] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:36:04 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:36:04.368148 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84194cab-b333-467d-9a54-1f4d5cdd3403 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:04.380139 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84194cab-b333-467d-9a54-1f4d5cdd3403 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:04.384712 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44dcf96-0349-4dd9-a63c-b640f30c9b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:04.385304 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44dcf96-0349-4dd9-a63c-b640f30c9b55 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:04.385707 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44dcf96-0349-4dd9-a63c-b640f30c9b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:04.386085 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44dcf96-0349-4dd9-a63c-b640f30c9b55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:04.386955 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44dcf96-0349-4dd9-a63c-b640f30c9b55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:04.389375 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44dcf96-0349-4dd9-a63c-b640f30c9b55 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:04.400323 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1307/2603] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:36:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:36:04.404445 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1e2c86-598f-4b01-9106-13124b5f208b admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:04.414323 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1e2c86-598f-4b01-9106-13124b5f208b admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:04.419854 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6718a85e-d8c2-40a8-93ca-fcc3e94727e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:04.420442 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6718a85e-d8c2-40a8-93ca-fcc3e94727e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:04.420748 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6718a85e-d8c2-40a8-93ca-fcc3e94727e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:04.421018 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6718a85e-d8c2-40a8-93ca-fcc3e94727e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:04.421647 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6718a85e-d8c2-40a8-93ca-fcc3e94727e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:04.423214 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6718a85e-d8c2-40a8-93ca-fcc3e94727e7 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:04.433696 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1297/2604] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:36:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:36:04.437787 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44dcf96-0349-4dd9-a63c-b640f30c9b55 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:04.447990 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44dcf96-0349-4dd9-a63c-b640f30c9b55 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:04.452662 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4986279-9c9a-418e-a802-26bcd54788d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:04.453296 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4986279-9c9a-418e-a802-26bcd54788d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:04.453583 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4986279-9c9a-418e-a802-26bcd54788d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:04.453860 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4986279-9c9a-418e-a802-26bcd54788d5 admin admin] PATH_INFO: `/v3/projects/2af6730edaf64a569abc6c84f09f4904/users/e212b21a5f1741008ca8c30a710146d4/roles/04d0e4575a28440eb4349b4a6565e8b8` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:04.468607 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4986279-9c9a-418e-a802-26bcd54788d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2af6730edaf64a569abc6c84f09f4904, user_id=e212b21a5f1741008ca8c30a710146d4, role_id=04d0e4575a28440eb4349b4a6565e8b8)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:04.471204 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4986279-9c9a-418e-a802-26bcd54788d5 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:04.484379 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1308/2605] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:36:04 2022] PUT /identity/v3/projects/2af6730edaf64a569abc6c84f09f4904/users/e212b21a5f1741008ca8c30a710146d4/roles/04d0e4575a28440eb4349b4a6565e8b8 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 03:36:04.494283 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9600bd-8705-491a-b518-8cc38d58c121 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:04.494569 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9600bd-8705-491a-b518-8cc38d58c121 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:04.494908 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9600bd-8705-491a-b518-8cc38d58c121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:04.521789 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-0e9600bd-8705-491a-b518-8cc38d58c121 None None] MFA Rules not processed for user `e212b21a5f1741008ca8c30a710146d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:36:04.522975 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-0e9600bd-8705-491a-b518-8cc38d58c121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:04.571314 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:36:04.588220 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1298/2606] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:36:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:36:04.593162 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4986279-9c9a-418e-a802-26bcd54788d5 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:04.643358 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:36:04.663336 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4986279-9c9a-418e-a802-26bcd54788d5 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:04.669185 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d4631-d9e5-41a8-8d89-f934bb132048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:04.669955 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d4631-d9e5-41a8-8d89-f934bb132048 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:04.670458 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d4631-d9e5-41a8-8d89-f934bb132048 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:04.670758 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d4631-d9e5-41a8-8d89-f934bb132048 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:04.671436 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56d4631-d9e5-41a8-8d89-f934bb132048 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:04.673410 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56d4631-d9e5-41a8-8d89-f934bb132048 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:04.701618 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1309/2607] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:36:04 2022] POST /identity/v3/projects => generated 379 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:36:04.705775 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9600bd-8705-491a-b518-8cc38d58c121 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:04.717365 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9600bd-8705-491a-b518-8cc38d58c121 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:04.772677 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4e9b80-9853-4709-a38c-9ffbe3e84a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:04.773193 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4e9b80-9853-4709-a38c-9ffbe3e84a00 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:04.773469 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4e9b80-9853-4709-a38c-9ffbe3e84a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:04.773738 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4e9b80-9853-4709-a38c-9ffbe3e84a00 admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:04.774348 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4e9b80-9853-4709-a38c-9ffbe3e84a00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:04.776295 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4e9b80-9853-4709-a38c-9ffbe3e84a00 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:04.797218 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1299/2608] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:36:04 2022] POST /identity/v3/users => generated 296 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 03:36:04.801258 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d4631-d9e5-41a8-8d89-f934bb132048 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:04.812250 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d4631-d9e5-41a8-8d89-f934bb132048 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:04.817161 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea6a31c-2210-4cb2-a061-f18b9cdc118d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:04.817785 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea6a31c-2210-4cb2-a061-f18b9cdc118d admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:04.818071 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea6a31c-2210-4cb2-a061-f18b9cdc118d admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:04.818346 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea6a31c-2210-4cb2-a061-f18b9cdc118d admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:04.819257 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea6a31c-2210-4cb2-a061-f18b9cdc118d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:04.820902 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea6a31c-2210-4cb2-a061-f18b9cdc118d admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:04.832498 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1310/2609] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:36:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:36:04.836931 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4e9b80-9853-4709-a38c-9ffbe3e84a00 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:04.847298 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4e9b80-9853-4709-a38c-9ffbe3e84a00 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:04.852167 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6efb432-bb85-4947-9aa8-cf1b85b52f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:04.852812 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6efb432-bb85-4947-9aa8-cf1b85b52f20 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:04.853173 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6efb432-bb85-4947-9aa8-cf1b85b52f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:04.853518 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6efb432-bb85-4947-9aa8-cf1b85b52f20 admin admin] PATH_INFO: `/v3/projects/4ee1084086b44016971408f392f78afc/users/df7f6a030e9943919e5678bef5f43f8c/roles/fe9379cda35c4ff78576fe48b60bea3c` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:04.869108 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6efb432-bb85-4947-9aa8-cf1b85b52f20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ee1084086b44016971408f392f78afc, user_id=df7f6a030e9943919e5678bef5f43f8c, role_id=fe9379cda35c4ff78576fe48b60bea3c)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:04.872471 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6efb432-bb85-4947-9aa8-cf1b85b52f20 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:04.885753 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1300/2610] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:36:04 2022] PUT /identity/v3/projects/4ee1084086b44016971408f392f78afc/users/df7f6a030e9943919e5678bef5f43f8c/roles/fe9379cda35c4ff78576fe48b60bea3c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:36:04.889981 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea6a31c-2210-4cb2-a061-f18b9cdc118d admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:04.900153 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea6a31c-2210-4cb2-a061-f18b9cdc118d admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:04.963809 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f6893-150d-480c-8147-5b31a0c577b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:04.964436 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f6893-150d-480c-8147-5b31a0c577b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:04.964828 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f6893-150d-480c-8147-5b31a0c577b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:04.965107 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f6893-150d-480c-8147-5b31a0c577b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:04.965762 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99f6893-150d-480c-8147-5b31a0c577b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:04.967634 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99f6893-150d-480c-8147-5b31a0c577b4 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:04.979810 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1311/2611] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:36:04 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:36:04.984119 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6efb432-bb85-4947-9aa8-cf1b85b52f20 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:04.994271 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6efb432-bb85-4947-9aa8-cf1b85b52f20 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:04.998907 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1732e3e1-1a86-4c50-a4a9-b7b69e16f20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:04.999582 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732e3e1-1a86-4c50-a4a9-b7b69e16f20e admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:04.999867 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732e3e1-1a86-4c50-a4a9-b7b69e16f20e admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:05.000144 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732e3e1-1a86-4c50-a4a9-b7b69e16f20e admin admin] PATH_INFO: `/v3/projects/4ee1084086b44016971408f392f78afc/users/df7f6a030e9943919e5678bef5f43f8c/roles/fe9379cda35c4ff78576fe48b60bea3c` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:05.002058 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1732e3e1-1a86-4c50-a4a9-b7b69e16f20e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ee1084086b44016971408f392f78afc, user_id=df7f6a030e9943919e5678bef5f43f8c, role_id=fe9379cda35c4ff78576fe48b60bea3c)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:05.004725 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1732e3e1-1a86-4c50-a4a9-b7b69e16f20e admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:05.015553 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1301/2612] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:36:04 2022] PUT /identity/v3/projects/4ee1084086b44016971408f392f78afc/users/df7f6a030e9943919e5678bef5f43f8c/roles/fe9379cda35c4ff78576fe48b60bea3c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:36:05.025929 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d982c349-e2b4-4da2-a1a7-104929e88532 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:05.026840 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d982c349-e2b4-4da2-a1a7-104929e88532 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:05.027140 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d982c349-e2b4-4da2-a1a7-104929e88532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:05.054341 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-d982c349-e2b4-4da2-a1a7-104929e88532 None None] MFA Rules not processed for user `df7f6a030e9943919e5678bef5f43f8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:36:05.055624 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-d982c349-e2b4-4da2-a1a7-104929e88532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:05.121894 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1312/2613] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:36:05 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:36:05.133188 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1732e3e1-1a86-4c50-a4a9-b7b69e16f20e admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:05.134957 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-1732e3e1-1a86-4c50-a4a9-b7b69e16f20e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:05.191833 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1732e3e1-1a86-4c50-a4a9-b7b69e16f20e admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:05.195737 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01665411-7411-4903-b2ed-8e29cb741fb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f537aabf3d1040ff840b02616f839975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:05.196327 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01665411-7411-4903-b2ed-8e29cb741fb7 service cinder] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:05.196614 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01665411-7411-4903-b2ed-8e29cb741fb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:05.196886 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01665411-7411-4903-b2ed-8e29cb741fb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:05.206133 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01665411-7411-4903-b2ed-8e29cb741fb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:05.207575 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01665411-7411-4903-b2ed-8e29cb741fb7 service cinder] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:05.217512 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1302/2614] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:36:05 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:36:05.258475 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d982c349-e2b4-4da2-a1a7-104929e88532 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:05.259938 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-d982c349-e2b4-4da2-a1a7-104929e88532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:05.272318 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d982c349-e2b4-4da2-a1a7-104929e88532 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:05.275849 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8738195-1b73-47b3-907e-dd6320b87789 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f537aabf3d1040ff840b02616f839975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:05.276560 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8738195-1b73-47b3-907e-dd6320b87789 service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:05.276781 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8738195-1b73-47b3-907e-dd6320b87789 service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:05.277051 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8738195-1b73-47b3-907e-dd6320b87789 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:05.315853 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:36:05.335129 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8738195-1b73-47b3-907e-dd6320b87789 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:05.336592 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8738195-1b73-47b3-907e-dd6320b87789 service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:05.346805 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1313/2615] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:36:05 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:36:06.889032 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01665411-7411-4903-b2ed-8e29cb741fb7 service cinder] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:06.890481 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-01665411-7411-4903-b2ed-8e29cb741fb7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:06.941061 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:36:06.960604 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01665411-7411-4903-b2ed-8e29cb741fb7 service cinder] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:06.965615 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69846961-02cb-496f-b751-7e983672719e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:06.966297 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69846961-02cb-496f-b751-7e983672719e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:06.966580 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69846961-02cb-496f-b751-7e983672719e admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:06.966862 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69846961-02cb-496f-b751-7e983672719e admin admin] PATH_INFO: `/v3/users/9ca91e6f09be439f8fe5a16f957e3024` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:06.968079 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69846961-02cb-496f-b751-7e983672719e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ca91e6f09be439f8fe5a16f957e3024)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:06.969987 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69846961-02cb-496f-b751-7e983672719e admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:07.016200 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-69846961-02cb-496f-b751-7e983672719e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ca91e6f09be439f8fe5a16f957e3024'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:07.023461 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-69846961-02cb-496f-b751-7e983672719e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ca91e6f09be439f8fe5a16f957e3024'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:07.032045 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-69846961-02cb-496f-b751-7e983672719e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ca91e6f09be439f8fe5a16f957e3024'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:07.032698 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-69846961-02cb-496f-b751-7e983672719e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ca91e6f09be439f8fe5a16f957e3024'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:07.047767 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-69846961-02cb-496f-b751-7e983672719e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ca91e6f09be439f8fe5a16f957e3024'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:07.053957 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1303/2616] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:36:06 2022] DELETE /identity/v3/users/9ca91e6f09be439f8fe5a16f957e3024 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:36:07.058829 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539981af-7ee7-466e-8394-f81287f3eae5 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:07.059281 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539981af-7ee7-466e-8394-f81287f3eae5 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:07.059711 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539981af-7ee7-466e-8394-f81287f3eae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:07.079478 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-539981af-7ee7-466e-8394-f81287f3eae5 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:36:07.080808 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-539981af-7ee7-466e-8394-f81287f3eae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:07.145788 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1314/2617] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:36:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:36:07.155556 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69846961-02cb-496f-b751-7e983672719e admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:07.157020 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-69846961-02cb-496f-b751-7e983672719e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:07.216671 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69846961-02cb-496f-b751-7e983672719e admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:07.220602 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba9e487-c121-45be-944d-b5e5f967c782 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:07.221205 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba9e487-c121-45be-944d-b5e5f967c782 service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:07.221482 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba9e487-c121-45be-944d-b5e5f967c782 service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:07.221754 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba9e487-c121-45be-944d-b5e5f967c782 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:07.231228 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba9e487-c121-45be-944d-b5e5f967c782 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:07.233013 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba9e487-c121-45be-944d-b5e5f967c782 service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:07.243119 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1304/2618] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:36:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:36:07.513158 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539981af-7ee7-466e-8394-f81287f3eae5 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:07.514582 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-539981af-7ee7-466e-8394-f81287f3eae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:07.526773 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539981af-7ee7-466e-8394-f81287f3eae5 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:07.531921 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57df45dc-3b08-4142-bfc2-bbb4ac07129e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:07.532613 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df45dc-3b08-4142-bfc2-bbb4ac07129e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:07.532957 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df45dc-3b08-4142-bfc2-bbb4ac07129e admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:07.533322 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df45dc-3b08-4142-bfc2-bbb4ac07129e admin admin] PATH_INFO: `/v3/projects/46ff434aea6640bfa06788b67de2d5bb` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:07.534491 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57df45dc-3b08-4142-bfc2-bbb4ac07129e admin admin] RBAC: Authorizing `identity:delete_project(project_id=46ff434aea6640bfa06788b67de2d5bb)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:07.536466 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57df45dc-3b08-4142-bfc2-bbb4ac07129e admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:07.584536 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-57df45dc-3b08-4142-bfc2-bbb4ac07129e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46ff434aea6640bfa06788b67de2d5bb', 'request_id': 'req-57df45dc-3b08-4142-bfc2-bbb4ac07129e'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:07.590480 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-57df45dc-3b08-4142-bfc2-bbb4ac07129e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46ff434aea6640bfa06788b67de2d5bb', 'request_id': 'req-57df45dc-3b08-4142-bfc2-bbb4ac07129e'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:07.596585 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-57df45dc-3b08-4142-bfc2-bbb4ac07129e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46ff434aea6640bfa06788b67de2d5bb', 'request_id': 'req-57df45dc-3b08-4142-bfc2-bbb4ac07129e'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:07.609348 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-57df45dc-3b08-4142-bfc2-bbb4ac07129e admin admin] The token cache is being invalidate because project 46ff434aea6640bfa06788b67de2d5bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:36:07.609640 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-57df45dc-3b08-4142-bfc2-bbb4ac07129e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:07.610283 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-57df45dc-3b08-4142-bfc2-bbb4ac07129e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:07.611771 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1315/2619] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:36:07 2022] DELETE /identity/v3/projects/46ff434aea6640bfa06788b67de2d5bb => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:36:07.616686 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c3ecf-7619-402c-8092-169d264aad3c None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:07.616968 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c3ecf-7619-402c-8092-169d264aad3c None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:07.617243 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c3ecf-7619-402c-8092-169d264aad3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:07.639207 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-125c3ecf-7619-402c-8092-169d264aad3c None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:36:07.640441 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-125c3ecf-7619-402c-8092-169d264aad3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:07.699659 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1305/2620] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:36:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:36:07.707408 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ca605-586f-4054-a231-6c6aa18c45ae None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:07.707731 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ca605-586f-4054-a231-6c6aa18c45ae None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:07.708010 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ca605-586f-4054-a231-6c6aa18c45ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:07.728046 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-2b7ca605-586f-4054-a231-6c6aa18c45ae None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:36:07.729326 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-2b7ca605-586f-4054-a231-6c6aa18c45ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:07.738599 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1316/2621] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:36:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:36:07.742876 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125c3ecf-7619-402c-8092-169d264aad3c None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:07.752895 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125c3ecf-7619-402c-8092-169d264aad3c None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:07.757357 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e690e5c-9193-4101-a71f-63e48a4b70b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:07.757941 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e690e5c-9193-4101-a71f-63e48a4b70b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:07.758217 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e690e5c-9193-4101-a71f-63e48a4b70b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:07.758487 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e690e5c-9193-4101-a71f-63e48a4b70b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:07.759122 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e690e5c-9193-4101-a71f-63e48a4b70b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:36:07.759419 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e690e5c-9193-4101-a71f-63e48a4b70b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:07.761016 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e690e5c-9193-4101-a71f-63e48a4b70b0 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:07.763411 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:36:07.774430 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1306/2622] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 03:36:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:36:07.779167 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7ca605-586f-4054-a231-6c6aa18c45ae None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:07.788339 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7ca605-586f-4054-a231-6c6aa18c45ae None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:07.793066 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee776bf-b1ea-42ef-9c02-3fe30a11b3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:07.793650 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee776bf-b1ea-42ef-9c02-3fe30a11b3b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:07.793952 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee776bf-b1ea-42ef-9c02-3fe30a11b3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:07.794210 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee776bf-b1ea-42ef-9c02-3fe30a11b3b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:07.794832 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee776bf-b1ea-42ef-9c02-3fe30a11b3b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:07.796861 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee776bf-b1ea-42ef-9c02-3fe30a11b3b1 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:07.824636 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1317/2623] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:36:07 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:36:07.828707 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e690e5c-9193-4101-a71f-63e48a4b70b0 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:07.838656 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e690e5c-9193-4101-a71f-63e48a4b70b0 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:07.893904 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef5100e-7e93-49c0-9ec2-f38f3caadfc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:07.894545 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5100e-7e93-49c0-9ec2-f38f3caadfc0 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:07.894755 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5100e-7e93-49c0-9ec2-f38f3caadfc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:07.895028 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5100e-7e93-49c0-9ec2-f38f3caadfc0 admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:07.895686 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef5100e-7e93-49c0-9ec2-f38f3caadfc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:07.897568 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef5100e-7e93-49c0-9ec2-f38f3caadfc0 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:07.919321 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1307/2624] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:36:07 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:36:07.923596 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee776bf-b1ea-42ef-9c02-3fe30a11b3b1 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:07.933675 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee776bf-b1ea-42ef-9c02-3fe30a11b3b1 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:07.938253 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7cae30-04ad-4819-acc4-abd8ba47d8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:07.938834 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7cae30-04ad-4819-acc4-abd8ba47d8b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:07.939114 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7cae30-04ad-4819-acc4-abd8ba47d8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:07.939383 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7cae30-04ad-4819-acc4-abd8ba47d8b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:07.940047 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7cae30-04ad-4819-acc4-abd8ba47d8b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:07.941601 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7cae30-04ad-4819-acc4-abd8ba47d8b0 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:07.952203 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1318/2625] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:36:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:36:07.956159 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef5100e-7e93-49c0-9ec2-f38f3caadfc0 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:07.966596 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef5100e-7e93-49c0-9ec2-f38f3caadfc0 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:07.971191 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622c2507-4ed6-49a6-9e17-f2a626f5b591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:07.971822 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c2507-4ed6-49a6-9e17-f2a626f5b591 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:07.972107 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c2507-4ed6-49a6-9e17-f2a626f5b591 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:07.972383 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c2507-4ed6-49a6-9e17-f2a626f5b591 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:07.973023 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622c2507-4ed6-49a6-9e17-f2a626f5b591 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:07.974595 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622c2507-4ed6-49a6-9e17-f2a626f5b591 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:07.985119 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1308/2626] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:36:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:36:07.989048 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7cae30-04ad-4819-acc4-abd8ba47d8b0 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:07.998981 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7cae30-04ad-4819-acc4-abd8ba47d8b0 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:08.003467 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4138332-d38f-44f8-a89e-fae2539108ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:08.004119 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4138332-d38f-44f8-a89e-fae2539108ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:08.004395 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4138332-d38f-44f8-a89e-fae2539108ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:08.004663 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4138332-d38f-44f8-a89e-fae2539108ae admin admin] PATH_INFO: `/v3/projects/71fd6f101c654c5d83ce664336177292/users/552584c83fa846afa9a10aee2ae2968e/roles/04d0e4575a28440eb4349b4a6565e8b8` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:08.019335 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4138332-d38f-44f8-a89e-fae2539108ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=71fd6f101c654c5d83ce664336177292, user_id=552584c83fa846afa9a10aee2ae2968e, role_id=04d0e4575a28440eb4349b4a6565e8b8)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:08.022007 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4138332-d38f-44f8-a89e-fae2539108ae admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:08.029743 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:36:08.035976 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1319/2627] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:36:07 2022] PUT /identity/v3/projects/71fd6f101c654c5d83ce664336177292/users/552584c83fa846afa9a10aee2ae2968e/roles/04d0e4575a28440eb4349b4a6565e8b8 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 03:36:08.046912 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de2cc4c-83af-4883-aae1-94a0734e6e6f None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:08.047196 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de2cc4c-83af-4883-aae1-94a0734e6e6f None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:08.047470 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de2cc4c-83af-4883-aae1-94a0734e6e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:08.076054 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-3de2cc4c-83af-4883-aae1-94a0734e6e6f None None] MFA Rules not processed for user `552584c83fa846afa9a10aee2ae2968e`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:36:08.077255 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-3de2cc4c-83af-4883-aae1-94a0734e6e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:08.141069 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1309/2628] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:36:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:36:08.152054 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4138332-d38f-44f8-a89e-fae2539108ae admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:08.153822 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-c4138332-d38f-44f8-a89e-fae2539108ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:08.222535 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4138332-d38f-44f8-a89e-fae2539108ae admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:08.226480 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a00f6e-c7bd-4931-a6f5-5b9ef6e2d3e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f537aabf3d1040ff840b02616f839975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:08.227087 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a00f6e-c7bd-4931-a6f5-5b9ef6e2d3e9 service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:08.227366 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a00f6e-c7bd-4931-a6f5-5b9ef6e2d3e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:08.227677 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a00f6e-c7bd-4931-a6f5-5b9ef6e2d3e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:08.239242 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a00f6e-c7bd-4931-a6f5-5b9ef6e2d3e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:08.243623 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a00f6e-c7bd-4931-a6f5-5b9ef6e2d3e9 service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:08.253316 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1320/2629] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:36:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:36:08.260314 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de2cc4c-83af-4883-aae1-94a0734e6e6f None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:08.261749 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-3de2cc4c-83af-4883-aae1-94a0734e6e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:08.279187 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a00f6e-c7bd-4931-a6f5-5b9ef6e2d3e9 service cinder] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:08.332174 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de2cc4c-83af-4883-aae1-94a0734e6e6f None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:08.336850 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd8eed2-3422-4105-8994-dfd87aa67fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:08.337471 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8eed2-3422-4105-8994-dfd87aa67fa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:08.337751 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8eed2-3422-4105-8994-dfd87aa67fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:08.338022 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8eed2-3422-4105-8994-dfd87aa67fa9 admin admin] PATH_INFO: `/v3/users/de06b2ca8db34ba9b2a24b9cd06f7a89` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:08.339186 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd8eed2-3422-4105-8994-dfd87aa67fa9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de06b2ca8db34ba9b2a24b9cd06f7a89)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:08.342132 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd8eed2-3422-4105-8994-dfd87aa67fa9 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:08.342498 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a00f6e-c7bd-4931-a6f5-5b9ef6e2d3e9 service cinder] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:08.346793 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:36:08.347719 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e931354-74a4-451a-b948-87b6243acdbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:08.348384 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e931354-74a4-451a-b948-87b6243acdbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:08.348772 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e931354-74a4-451a-b948-87b6243acdbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:08.349051 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e931354-74a4-451a-b948-87b6243acdbf admin admin] PATH_INFO: `/v3/users/552584c83fa846afa9a10aee2ae2968e` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:08.350353 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e931354-74a4-451a-b948-87b6243acdbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=552584c83fa846afa9a10aee2ae2968e)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:08.352312 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e931354-74a4-451a-b948-87b6243acdbf admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:08.394062 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-9bd8eed2-3422-4105-8994-dfd87aa67fa9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de06b2ca8db34ba9b2a24b9cd06f7a89'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:08.401204 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-9bd8eed2-3422-4105-8994-dfd87aa67fa9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de06b2ca8db34ba9b2a24b9cd06f7a89'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:08.403970 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-5e931354-74a4-451a-b948-87b6243acdbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '552584c83fa846afa9a10aee2ae2968e'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:08.404654 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-5e931354-74a4-451a-b948-87b6243acdbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '552584c83fa846afa9a10aee2ae2968e'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:08.409094 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-9bd8eed2-3422-4105-8994-dfd87aa67fa9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de06b2ca8db34ba9b2a24b9cd06f7a89'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:08.409892 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-9bd8eed2-3422-4105-8994-dfd87aa67fa9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de06b2ca8db34ba9b2a24b9cd06f7a89'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:08.412506 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-5e931354-74a4-451a-b948-87b6243acdbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '552584c83fa846afa9a10aee2ae2968e'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:08.413213 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-5e931354-74a4-451a-b948-87b6243acdbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '552584c83fa846afa9a10aee2ae2968e'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:08.423199 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-9bd8eed2-3422-4105-8994-dfd87aa67fa9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de06b2ca8db34ba9b2a24b9cd06f7a89'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:08.426637 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-5e931354-74a4-451a-b948-87b6243acdbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '552584c83fa846afa9a10aee2ae2968e'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:08.429604 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1310/2630] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:36:08 2022] DELETE /identity/v3/users/de06b2ca8db34ba9b2a24b9cd06f7a89 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:36:08.434977 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fbe388-b63f-4b13-a0e8-0a33d1726908 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:08.435264 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fbe388-b63f-4b13-a0e8-0a33d1726908 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:08.435565 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fbe388-b63f-4b13-a0e8-0a33d1726908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:08.440549 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1321/2631] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:36:08 2022] DELETE /identity/v3/users/552584c83fa846afa9a10aee2ae2968e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 03:36:08.445110 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050af6e-b666-44b4-ab2c-bb3d286ed302 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:08.445391 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050af6e-b666-44b4-ab2c-bb3d286ed302 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:08.445665 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050af6e-b666-44b4-ab2c-bb3d286ed302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:08.455182 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-09fbe388-b63f-4b13-a0e8-0a33d1726908 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:36:08.456429 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-09fbe388-b63f-4b13-a0e8-0a33d1726908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:08.464115 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-d050af6e-b666-44b4-ab2c-bb3d286ed302 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:36:08.465825 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-d050af6e-b666-44b4-ab2c-bb3d286ed302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:08.478565 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:36:08.517461 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1311/2632] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:36:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 03:36:08.527511 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fbe388-b63f-4b13-a0e8-0a33d1726908 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:08.529361 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-09fbe388-b63f-4b13-a0e8-0a33d1726908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:08.529662 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1322/2633] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:36:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:36:08.539160 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d050af6e-b666-44b4-ab2c-bb3d286ed302 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:08.540602 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-d050af6e-b666-44b4-ab2c-bb3d286ed302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:08.588859 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fbe388-b63f-4b13-a0e8-0a33d1726908 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:08.594173 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564d8bc9-ecb0-4411-b167-461ff82b8213 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:08.594860 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d8bc9-ecb0-4411-b167-461ff82b8213 service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:08.595067 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d8bc9-ecb0-4411-b167-461ff82b8213 service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:08.595300 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d8bc9-ecb0-4411-b167-461ff82b8213 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:08.606349 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d050af6e-b666-44b4-ab2c-bb3d286ed302 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:08.610063 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79eda75-7f89-404c-a494-2a35b9901029 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:08.610666 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79eda75-7f89-404c-a494-2a35b9901029 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:08.610952 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79eda75-7f89-404c-a494-2a35b9901029 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:08.611191 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564d8bc9-ecb0-4411-b167-461ff82b8213 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:08.611305 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79eda75-7f89-404c-a494-2a35b9901029 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:08.612657 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564d8bc9-ecb0-4411-b167-461ff82b8213 service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:08.621130 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79eda75-7f89-404c-a494-2a35b9901029 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:08.622730 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79eda75-7f89-404c-a494-2a35b9901029 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:08.623401 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1312/2634] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:36:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 03:36:08.638058 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1323/2635] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:36:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 03:36:08.932450 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564d8bc9-ecb0-4411-b167-461ff82b8213 service neutron] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:08.934061 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-564d8bc9-ecb0-4411-b167-461ff82b8213 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:08.941545 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79eda75-7f89-404c-a494-2a35b9901029 service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:08.942958 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-e79eda75-7f89-404c-a494-2a35b9901029 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:08.956507 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564d8bc9-ecb0-4411-b167-461ff82b8213 service neutron] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:08.962718 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13806754-f9ab-4b55-a8c1-33c0b1591623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:08.963792 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13806754-f9ab-4b55-a8c1-33c0b1591623 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:08.964246 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13806754-f9ab-4b55-a8c1-33c0b1591623 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:08.965024 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13806754-f9ab-4b55-a8c1-33c0b1591623 admin admin] PATH_INFO: `/v3/projects/84c7f641ed5d4df09201b5e412a72b52` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:08.966229 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13806754-f9ab-4b55-a8c1-33c0b1591623 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84c7f641ed5d4df09201b5e412a72b52)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:08.968212 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13806754-f9ab-4b55-a8c1-33c0b1591623 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:08.969012 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79eda75-7f89-404c-a494-2a35b9901029 service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:08.977462 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e451b1-279d-466d-b95a-8054de8d5474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:08.978101 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e451b1-279d-466d-b95a-8054de8d5474 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:08.978390 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e451b1-279d-466d-b95a-8054de8d5474 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:08.978665 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e451b1-279d-466d-b95a-8054de8d5474 admin admin] PATH_INFO: `/v3/projects/71fd6f101c654c5d83ce664336177292` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:08.981067 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e451b1-279d-466d-b95a-8054de8d5474 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71fd6f101c654c5d83ce664336177292)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:08.982887 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e451b1-279d-466d-b95a-8054de8d5474 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:08.997266 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:36:09.031405 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-13806754-f9ab-4b55-a8c1-33c0b1591623 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84c7f641ed5d4df09201b5e412a72b52', 'request_id': 'req-13806754-f9ab-4b55-a8c1-33c0b1591623'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:09.038062 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-13806754-f9ab-4b55-a8c1-33c0b1591623 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84c7f641ed5d4df09201b5e412a72b52', 'request_id': 'req-13806754-f9ab-4b55-a8c1-33c0b1591623'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:09.045492 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-13806754-f9ab-4b55-a8c1-33c0b1591623 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84c7f641ed5d4df09201b5e412a72b52', 'request_id': 'req-13806754-f9ab-4b55-a8c1-33c0b1591623'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:09.048775 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-27e451b1-279d-466d-b95a-8054de8d5474 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71fd6f101c654c5d83ce664336177292', 'request_id': 'req-27e451b1-279d-466d-b95a-8054de8d5474'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:09.055457 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-27e451b1-279d-466d-b95a-8054de8d5474 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71fd6f101c654c5d83ce664336177292', 'request_id': 'req-27e451b1-279d-466d-b95a-8054de8d5474'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:09.061796 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-13806754-f9ab-4b55-a8c1-33c0b1591623 admin admin] The token cache is being invalidate because project 84c7f641ed5d4df09201b5e412a72b52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:36:09.061796 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-13806754-f9ab-4b55-a8c1-33c0b1591623 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:09.062577 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-13806754-f9ab-4b55-a8c1-33c0b1591623 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:09.062753 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-27e451b1-279d-466d-b95a-8054de8d5474 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71fd6f101c654c5d83ce664336177292', 'request_id': 'req-27e451b1-279d-466d-b95a-8054de8d5474'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:09.066830 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1313/2636] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:36:08 2022] DELETE /identity/v3/projects/84c7f641ed5d4df09201b5e412a72b52 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:36:09.067942 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13806754-f9ab-4b55-a8c1-33c0b1591623 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:09.069672 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-13806754-f9ab-4b55-a8c1-33c0b1591623 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:09.076831 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-27e451b1-279d-466d-b95a-8054de8d5474 admin admin] The token cache is being invalidate because project 71fd6f101c654c5d83ce664336177292 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:36:09.077125 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-27e451b1-279d-466d-b95a-8054de8d5474 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:09.077780 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-27e451b1-279d-466d-b95a-8054de8d5474 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:09.079464 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1324/2637] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:36:08 2022] DELETE /identity/v3/projects/71fd6f101c654c5d83ce664336177292 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:36:09.084334 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a791481c-ad89-4082-b2f6-6eda91405f66 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:09.084902 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a791481c-ad89-4082-b2f6-6eda91405f66 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:09.085278 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a791481c-ad89-4082-b2f6-6eda91405f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:09.111738 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-a791481c-ad89-4082-b2f6-6eda91405f66 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:36:09.113135 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-a791481c-ad89-4082-b2f6-6eda91405f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:09.145337 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13806754-f9ab-4b55-a8c1-33c0b1591623 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:09.164724 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:36:09.183875 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1325/2638] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:36:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 03:36:09.207393 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b4e034-a37e-42cd-9b07-e12a6b318576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:09.208090 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b4e034-a37e-42cd-9b07-e12a6b318576 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:09.208378 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b4e034-a37e-42cd-9b07-e12a6b318576 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:09.208654 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b4e034-a37e-42cd-9b07-e12a6b318576 admin admin] PATH_INFO: `/v3/users/e212b21a5f1741008ca8c30a710146d4` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:09.210001 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b4e034-a37e-42cd-9b07-e12a6b318576 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e212b21a5f1741008ca8c30a710146d4)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:09.212007 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b4e034-a37e-42cd-9b07-e12a6b318576 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:09.250466 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da42cebf-7f79-4b35-9af4-39a5863f7444 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:09.250706 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da42cebf-7f79-4b35-9af4-39a5863f7444 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:09.250955 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da42cebf-7f79-4b35-9af4-39a5863f7444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:09.266072 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-e0b4e034-a37e-42cd-9b07-e12a6b318576 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e212b21a5f1741008ca8c30a710146d4'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:09.271567 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-da42cebf-7f79-4b35-9af4-39a5863f7444 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:36:09.272775 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-da42cebf-7f79-4b35-9af4-39a5863f7444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:09.273512 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-e0b4e034-a37e-42cd-9b07-e12a6b318576 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e212b21a5f1741008ca8c30a710146d4'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:09.276599 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:36:09.281884 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1326/2639] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:36:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 03:36:09.283424 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-e0b4e034-a37e-42cd-9b07-e12a6b318576 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e212b21a5f1741008ca8c30a710146d4'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:09.284359 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-e0b4e034-a37e-42cd-9b07-e12a6b318576 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e212b21a5f1741008ca8c30a710146d4'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:09.286035 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da42cebf-7f79-4b35-9af4-39a5863f7444 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:09.296043 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da42cebf-7f79-4b35-9af4-39a5863f7444 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:09.298955 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-e0b4e034-a37e-42cd-9b07-e12a6b318576 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e212b21a5f1741008ca8c30a710146d4'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:09.300669 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251b6f57-f28e-4c2e-8a16-07d78932b81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:09.301247 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b6f57-f28e-4c2e-8a16-07d78932b81b admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:09.301523 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b6f57-f28e-4c2e-8a16-07d78932b81b admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:09.301791 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b6f57-f28e-4c2e-8a16-07d78932b81b admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:09.302428 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251b6f57-f28e-4c2e-8a16-07d78932b81b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:36:09.302727 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251b6f57-f28e-4c2e-8a16-07d78932b81b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:09.304369 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251b6f57-f28e-4c2e-8a16-07d78932b81b admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:09.304972 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1314/2640] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:36:09 2022] DELETE /identity/v3/users/e212b21a5f1741008ca8c30a710146d4 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 03:36:09.316133 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1327/2641] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 03:36:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:36:09.320749 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b4e034-a37e-42cd-9b07-e12a6b318576 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:09.322257 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-e0b4e034-a37e-42cd-9b07-e12a6b318576 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:09.397209 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b4e034-a37e-42cd-9b07-e12a6b318576 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:09.402195 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd76eb0b-4092-42e0-a630-acc02228d8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:09.403929 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76eb0b-4092-42e0-a630-acc02228d8df admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:09.404208 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76eb0b-4092-42e0-a630-acc02228d8df admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:09.404481 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76eb0b-4092-42e0-a630-acc02228d8df admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:09.405129 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd76eb0b-4092-42e0-a630-acc02228d8df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:09.407014 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd76eb0b-4092-42e0-a630-acc02228d8df admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:09.435934 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1315/2642] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:36:09 2022] POST /identity/v3/projects => generated 383 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:36:09.440386 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251b6f57-f28e-4c2e-8a16-07d78932b81b admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:09.450971 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251b6f57-f28e-4c2e-8a16-07d78932b81b admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:09.511439 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdc9358-8fba-4e19-bb7e-7cb986c8c588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:09.512037 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc9358-8fba-4e19-bb7e-7cb986c8c588 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:09.512317 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc9358-8fba-4e19-bb7e-7cb986c8c588 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:09.512584 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc9358-8fba-4e19-bb7e-7cb986c8c588 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:09.513213 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdc9358-8fba-4e19-bb7e-7cb986c8c588 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:09.515099 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdc9358-8fba-4e19-bb7e-7cb986c8c588 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:09.538859 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1328/2643] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:36:09 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 03:36:09.540348 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd76eb0b-4092-42e0-a630-acc02228d8df admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:09.551075 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd76eb0b-4092-42e0-a630-acc02228d8df admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:09.556296 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0718f008-4aea-4e76-b040-dffdb964b5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:09.556894 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718f008-4aea-4e76-b040-dffdb964b5e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:09.557174 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718f008-4aea-4e76-b040-dffdb964b5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:09.557446 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718f008-4aea-4e76-b040-dffdb964b5e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:09.558108 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0718f008-4aea-4e76-b040-dffdb964b5e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:09.560322 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0718f008-4aea-4e76-b040-dffdb964b5e4 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:09.572676 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1316/2644] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:36:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:36:09.577017 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdc9358-8fba-4e19-bb7e-7cb986c8c588 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:09.587981 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdc9358-8fba-4e19-bb7e-7cb986c8c588 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:09.593243 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc72946a-34c0-48c0-b3fd-6dc1d458ca99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:09.593924 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72946a-34c0-48c0-b3fd-6dc1d458ca99 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:09.594218 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72946a-34c0-48c0-b3fd-6dc1d458ca99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:09.594570 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72946a-34c0-48c0-b3fd-6dc1d458ca99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:09.595335 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc72946a-34c0-48c0-b3fd-6dc1d458ca99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:09.597149 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc72946a-34c0-48c0-b3fd-6dc1d458ca99 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:09.603511 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0718f008-4aea-4e76-b040-dffdb964b5e4 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:09.606501 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-0718f008-4aea-4e76-b040-dffdb964b5e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:09.609059 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1329/2645] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:36:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:36:09.614118 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc72946a-34c0-48c0-b3fd-6dc1d458ca99 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:09.626288 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc72946a-34c0-48c0-b3fd-6dc1d458ca99 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:09.630015 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0718f008-4aea-4e76-b040-dffdb964b5e4 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:09.641018 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad76ef80-b926-4585-951c-0e2c15535532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:09.641173 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c6520b-d178-4b8d-bdf3-84448610bcda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:09.641798 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad76ef80-b926-4585-951c-0e2c15535532 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:09.642147 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad76ef80-b926-4585-951c-0e2c15535532 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:09.642288 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6520b-d178-4b8d-bdf3-84448610bcda admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:09.642557 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad76ef80-b926-4585-951c-0e2c15535532 admin admin] PATH_INFO: `/v3/projects/2af6730edaf64a569abc6c84f09f4904` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:09.643617 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6520b-d178-4b8d-bdf3-84448610bcda admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:09.643860 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad76ef80-b926-4585-951c-0e2c15535532 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2af6730edaf64a569abc6c84f09f4904)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:09.644014 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6520b-d178-4b8d-bdf3-84448610bcda admin admin] PATH_INFO: `/v3/projects/b3442e6424b9446c90d15225faa9553f/users/926111af89d943a597ec28264b1ef026/roles/04d0e4575a28440eb4349b4a6565e8b8` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:09.645895 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad76ef80-b926-4585-951c-0e2c15535532 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:09.660401 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c6520b-d178-4b8d-bdf3-84448610bcda admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3442e6424b9446c90d15225faa9553f, user_id=926111af89d943a597ec28264b1ef026, role_id=04d0e4575a28440eb4349b4a6565e8b8)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:09.663047 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c6520b-d178-4b8d-bdf3-84448610bcda admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:09.677694 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1330/2646] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:36:09 2022] PUT /identity/v3/projects/b3442e6424b9446c90d15225faa9553f/users/926111af89d943a597ec28264b1ef026/roles/04d0e4575a28440eb4349b4a6565e8b8 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 03:36:09.683351 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0a87d-ddf0-463a-b3aa-5db3022fe0d1 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:09.683927 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0a87d-ddf0-463a-b3aa-5db3022fe0d1 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:09.684353 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0a87d-ddf0-463a-b3aa-5db3022fe0d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:09.697713 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-ad76ef80-b926-4585-951c-0e2c15535532 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2af6730edaf64a569abc6c84f09f4904', 'request_id': 'req-ad76ef80-b926-4585-951c-0e2c15535532'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:09.703701 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-5ed0a87d-ddf0-463a-b3aa-5db3022fe0d1 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:36:09.704114 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-ad76ef80-b926-4585-951c-0e2c15535532 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2af6730edaf64a569abc6c84f09f4904', 'request_id': 'req-ad76ef80-b926-4585-951c-0e2c15535532'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:09.704962 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-5ed0a87d-ddf0-463a-b3aa-5db3022fe0d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:09.710347 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-ad76ef80-b926-4585-951c-0e2c15535532 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2af6730edaf64a569abc6c84f09f4904', 'request_id': 'req-ad76ef80-b926-4585-951c-0e2c15535532'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:09.724126 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-ad76ef80-b926-4585-951c-0e2c15535532 admin admin] The token cache is being invalidate because project 2af6730edaf64a569abc6c84f09f4904 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:36:09.724424 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-ad76ef80-b926-4585-951c-0e2c15535532 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:09.725109 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-ad76ef80-b926-4585-951c-0e2c15535532 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:09.726798 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1317/2647] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:36:09 2022] DELETE /identity/v3/projects/2af6730edaf64a569abc6c84f09f4904 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 03:36:09.730406 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad76ef80-b926-4585-951c-0e2c15535532 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:09.731886 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-ad76ef80-b926-4585-951c-0e2c15535532 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:09.765750 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1331/2648] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:36:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 03:36:09.770432 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:36:09.774890 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed0a87d-ddf0-463a-b3aa-5db3022fe0d1 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:09.776447 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-5ed0a87d-ddf0-463a-b3aa-5db3022fe0d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:09.802389 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad76ef80-b926-4585-951c-0e2c15535532 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:09.803400 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:36:09.807571 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f7dd4a-8987-4541-ad90-4c2daaa74f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:09.808745 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f7dd4a-8987-4541-ad90-4c2daaa74f0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:09.809024 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f7dd4a-8987-4541-ad90-4c2daaa74f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:09.809370 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f7dd4a-8987-4541-ad90-4c2daaa74f0e admin admin] PATH_INFO: `/v3/users/df7f6a030e9943919e5678bef5f43f8c` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:09.810514 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f7dd4a-8987-4541-ad90-4c2daaa74f0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=df7f6a030e9943919e5678bef5f43f8c)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:09.812506 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f7dd4a-8987-4541-ad90-4c2daaa74f0e admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:09.836954 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed0a87d-ddf0-463a-b3aa-5db3022fe0d1 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:09.841698 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a6cb86-2cee-4f2b-9391-444c2558e5fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:09.842312 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a6cb86-2cee-4f2b-9391-444c2558e5fc service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:09.842578 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a6cb86-2cee-4f2b-9391-444c2558e5fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:09.842858 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a6cb86-2cee-4f2b-9391-444c2558e5fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:09.852553 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a6cb86-2cee-4f2b-9391-444c2558e5fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:09.853961 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a6cb86-2cee-4f2b-9391-444c2558e5fc service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:09.860293 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-28f7dd4a-8987-4541-ad90-4c2daaa74f0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df7f6a030e9943919e5678bef5f43f8c'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:09.863664 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1332/2649] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:36:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 03:36:09.867099 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-28f7dd4a-8987-4541-ad90-4c2daaa74f0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df7f6a030e9943919e5678bef5f43f8c'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:09.875137 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-28f7dd4a-8987-4541-ad90-4c2daaa74f0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df7f6a030e9943919e5678bef5f43f8c'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:09.875799 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-28f7dd4a-8987-4541-ad90-4c2daaa74f0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df7f6a030e9943919e5678bef5f43f8c'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:09.890456 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-28f7dd4a-8987-4541-ad90-4c2daaa74f0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df7f6a030e9943919e5678bef5f43f8c'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:09.896623 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1318/2650] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:36:09 2022] DELETE /identity/v3/users/df7f6a030e9943919e5678bef5f43f8c => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 03:36:10.205468 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a6cb86-2cee-4f2b-9391-444c2558e5fc service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:10.217314 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a6cb86-2cee-4f2b-9391-444c2558e5fc service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:10.318037 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5651234d-aac4-4283-9189-8787ba4ab8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:10.318766 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651234d-aac4-4283-9189-8787ba4ab8e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:10.320170 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651234d-aac4-4283-9189-8787ba4ab8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:10.320574 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651234d-aac4-4283-9189-8787ba4ab8e3 admin admin] PATH_INFO: `/v3/projects/4ee1084086b44016971408f392f78afc` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:10.321940 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5651234d-aac4-4283-9189-8787ba4ab8e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ee1084086b44016971408f392f78afc)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:10.325832 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5651234d-aac4-4283-9189-8787ba4ab8e3 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:10.391789 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-5651234d-aac4-4283-9189-8787ba4ab8e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ee1084086b44016971408f392f78afc', 'request_id': 'req-5651234d-aac4-4283-9189-8787ba4ab8e3'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:10.405203 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-5651234d-aac4-4283-9189-8787ba4ab8e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ee1084086b44016971408f392f78afc', 'request_id': 'req-5651234d-aac4-4283-9189-8787ba4ab8e3'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:10.414206 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-5651234d-aac4-4283-9189-8787ba4ab8e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ee1084086b44016971408f392f78afc', 'request_id': 'req-5651234d-aac4-4283-9189-8787ba4ab8e3'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:10.430557 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-5651234d-aac4-4283-9189-8787ba4ab8e3 admin admin] The token cache is being invalidate because project 4ee1084086b44016971408f392f78afc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:36:10.430856 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-5651234d-aac4-4283-9189-8787ba4ab8e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:10.432224 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-5651234d-aac4-4283-9189-8787ba4ab8e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:10.437942 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1333/2651] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:36:10 2022] DELETE /identity/v3/projects/4ee1084086b44016971408f392f78afc => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 03:36:10.440031 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6daea3e-525b-4774-aee4-8b04126930bd None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:10.440918 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6daea3e-525b-4774-aee4-8b04126930bd None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:10.441410 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6daea3e-525b-4774-aee4-8b04126930bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:10.482129 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-f6daea3e-525b-4774-aee4-8b04126930bd None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:36:10.483523 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-f6daea3e-525b-4774-aee4-8b04126930bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:10.608943 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1319/2652] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:36:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:36:10.684440 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d092e-51fa-452f-a081-be81f8b8bde6 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:10.684799 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d092e-51fa-452f-a081-be81f8b8bde6 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:10.685049 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d092e-51fa-452f-a081-be81f8b8bde6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:10.728649 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-f53d092e-51fa-452f-a081-be81f8b8bde6 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:36:10.731121 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-f53d092e-51fa-452f-a081-be81f8b8bde6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:10.754203 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1334/2653] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:36:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:36:10.756398 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6daea3e-525b-4774-aee4-8b04126930bd None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:10.769522 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6daea3e-525b-4774-aee4-8b04126930bd None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:10.773259 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9625e68-d0ee-4000-a759-dc25f1e58eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:10.773876 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9625e68-d0ee-4000-a759-dc25f1e58eb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:10.774154 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9625e68-d0ee-4000-a759-dc25f1e58eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:10.774427 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9625e68-d0ee-4000-a759-dc25f1e58eb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:10.775079 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9625e68-d0ee-4000-a759-dc25f1e58eb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:36:10.775379 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9625e68-d0ee-4000-a759-dc25f1e58eb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:10.777148 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9625e68-d0ee-4000-a759-dc25f1e58eb4 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:10.794302 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1320/2654] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 03:36:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:36:10.795739 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53d092e-51fa-452f-a081-be81f8b8bde6 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:10.805979 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53d092e-51fa-452f-a081-be81f8b8bde6 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:10.811668 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3c0cb6-2d9e-4908-b3a5-cfd1ee9d3fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:10.812268 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c0cb6-2d9e-4908-b3a5-cfd1ee9d3fe2 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:10.812548 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c0cb6-2d9e-4908-b3a5-cfd1ee9d3fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:10.812820 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c0cb6-2d9e-4908-b3a5-cfd1ee9d3fe2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:10.813509 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3c0cb6-2d9e-4908-b3a5-cfd1ee9d3fe2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:10.815398 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3c0cb6-2d9e-4908-b3a5-cfd1ee9d3fe2 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:10.861469 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1335/2655] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:36:10 2022] POST /identity/v3/projects => generated 383 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:36:10.862148 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9625e68-d0ee-4000-a759-dc25f1e58eb4 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:10.890323 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9625e68-d0ee-4000-a759-dc25f1e58eb4 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:10.943600 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:36:10.988190 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462ef2eb-aa7a-4122-bb4e-a048154dbe91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:10.988874 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ef2eb-aa7a-4122-bb4e-a048154dbe91 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:10.989156 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ef2eb-aa7a-4122-bb4e-a048154dbe91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:10.989427 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ef2eb-aa7a-4122-bb4e-a048154dbe91 admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:10.990059 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462ef2eb-aa7a-4122-bb4e-a048154dbe91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:10.992186 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462ef2eb-aa7a-4122-bb4e-a048154dbe91 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:11.022810 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1321/2656] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:36:10 2022] POST /identity/v3/users => generated 292 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:36:11.027464 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3c0cb6-2d9e-4908-b3a5-cfd1ee9d3fe2 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:11.042259 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3c0cb6-2d9e-4908-b3a5-cfd1ee9d3fe2 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:11.051898 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24da3e9a-db82-4fe6-903f-5d866e20cd51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:11.053175 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24da3e9a-db82-4fe6-903f-5d866e20cd51 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:11.053620 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24da3e9a-db82-4fe6-903f-5d866e20cd51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:11.053942 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24da3e9a-db82-4fe6-903f-5d866e20cd51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:11.055572 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24da3e9a-db82-4fe6-903f-5d866e20cd51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:11.058918 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24da3e9a-db82-4fe6-903f-5d866e20cd51 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:11.082387 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462ef2eb-aa7a-4122-bb4e-a048154dbe91 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:11.087684 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1336/2657] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:36:11 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:36:11.096220 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462ef2eb-aa7a-4122-bb4e-a048154dbe91 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:11.104102 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216d5f2e-6b68-457c-ac71-5a10551af38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:11.104642 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d5f2e-6b68-457c-ac71-5a10551af38c admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:11.104926 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d5f2e-6b68-457c-ac71-5a10551af38c admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:11.106095 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d5f2e-6b68-457c-ac71-5a10551af38c admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:11.106969 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216d5f2e-6b68-457c-ac71-5a10551af38c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:11.108953 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216d5f2e-6b68-457c-ac71-5a10551af38c admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:11.125645 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1322/2658] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:36:11 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:36:11.126396 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24da3e9a-db82-4fe6-903f-5d866e20cd51 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:11.141448 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24da3e9a-db82-4fe6-903f-5d866e20cd51 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:11.150334 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be823f99-f9cb-4cea-b171-8b95617ed92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:11.151120 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be823f99-f9cb-4cea-b171-8b95617ed92a admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:11.151461 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be823f99-f9cb-4cea-b171-8b95617ed92a admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:11.152016 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be823f99-f9cb-4cea-b171-8b95617ed92a admin admin] PATH_INFO: `/v3/projects/bfe1d27e6d7b481592076e7728368208/users/157cb3191dae45e184ce96ca71eb8682/roles/04d0e4575a28440eb4349b4a6565e8b8` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:11.171862 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:36:11.178067 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be823f99-f9cb-4cea-b171-8b95617ed92a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfe1d27e6d7b481592076e7728368208, user_id=157cb3191dae45e184ce96ca71eb8682, role_id=04d0e4575a28440eb4349b4a6565e8b8)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:11.184321 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be823f99-f9cb-4cea-b171-8b95617ed92a admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:11.214263 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1337/2659] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:36:11 2022] PUT /identity/v3/projects/bfe1d27e6d7b481592076e7728368208/users/157cb3191dae45e184ce96ca71eb8682/roles/04d0e4575a28440eb4349b4a6565e8b8 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:36:11.227246 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3962898e-59d6-468a-84b9-83d1b8a7632b None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:11.227566 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3962898e-59d6-468a-84b9-83d1b8a7632b None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:11.227972 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3962898e-59d6-468a-84b9-83d1b8a7632b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:11.269083 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-3962898e-59d6-468a-84b9-83d1b8a7632b None None] MFA Rules not processed for user `157cb3191dae45e184ce96ca71eb8682`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:36:11.275999 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-3962898e-59d6-468a-84b9-83d1b8a7632b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:11.406628 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be823f99-f9cb-4cea-b171-8b95617ed92a admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:11.408956 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1323/2660] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:36:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:36:11.510881 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be823f99-f9cb-4cea-b171-8b95617ed92a admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:11.524431 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd9a54-cd9f-4c9b-a51b-5f48ea8b8406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:11.525444 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd9a54-cd9f-4c9b-a51b-5f48ea8b8406 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:11.525951 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd9a54-cd9f-4c9b-a51b-5f48ea8b8406 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:11.526502 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd9a54-cd9f-4c9b-a51b-5f48ea8b8406 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:11.528418 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbd9a54-cd9f-4c9b-a51b-5f48ea8b8406 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:11.530654 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbd9a54-cd9f-4c9b-a51b-5f48ea8b8406 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:11.588444 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1338/2661] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:36:11 2022] POST /identity/v3/projects => generated 383 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:36:11.590497 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3962898e-59d6-468a-84b9-83d1b8a7632b None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:11.603334 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3962898e-59d6-468a-84b9-83d1b8a7632b None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:11.742602 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549a3018-a13f-4cab-b1f2-18fad3807dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:11.743415 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549a3018-a13f-4cab-b1f2-18fad3807dc3 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:11.743926 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549a3018-a13f-4cab-b1f2-18fad3807dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:11.744666 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549a3018-a13f-4cab-b1f2-18fad3807dc3 admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:11.745751 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549a3018-a13f-4cab-b1f2-18fad3807dc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:11.748464 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549a3018-a13f-4cab-b1f2-18fad3807dc3 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:11.780517 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1324/2662] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:36:11 2022] POST /identity/v3/users => generated 298 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 03:36:11.784660 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd9a54-cd9f-4c9b-a51b-5f48ea8b8406 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:11.799395 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd9a54-cd9f-4c9b-a51b-5f48ea8b8406 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:11.823445 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc11b0e5-9acf-48b8-b993-f4b89e429db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:11.826317 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11b0e5-9acf-48b8-b993-f4b89e429db5 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:11.826656 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11b0e5-9acf-48b8-b993-f4b89e429db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:11.829848 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11b0e5-9acf-48b8-b993-f4b89e429db5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:11.831862 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc11b0e5-9acf-48b8-b993-f4b89e429db5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:11.834865 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc11b0e5-9acf-48b8-b993-f4b89e429db5 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:11.863342 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1339/2663] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:36:11 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:36:11.864571 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549a3018-a13f-4cab-b1f2-18fad3807dc3 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:11.926475 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549a3018-a13f-4cab-b1f2-18fad3807dc3 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:11.939480 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3d16e3-cd65-4115-84dd-9cad581e393b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:11.940412 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d16e3-cd65-4115-84dd-9cad581e393b admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:11.940713 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d16e3-cd65-4115-84dd-9cad581e393b admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:11.940974 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d16e3-cd65-4115-84dd-9cad581e393b admin admin] PATH_INFO: `/v3/projects/c3c365437dad4347b94f1ad5d38e7e9e/users/6ebfc21a3180402bb6474866a8cd6e31/roles/fe9379cda35c4ff78576fe48b60bea3c` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:11.988341 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3d16e3-cd65-4115-84dd-9cad581e393b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3c365437dad4347b94f1ad5d38e7e9e, user_id=6ebfc21a3180402bb6474866a8cd6e31, role_id=fe9379cda35c4ff78576fe48b60bea3c)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:11.994282 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3d16e3-cd65-4115-84dd-9cad581e393b admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:12.024587 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1325/2664] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:36:11 2022] PUT /identity/v3/projects/c3c365437dad4347b94f1ad5d38e7e9e/users/6ebfc21a3180402bb6474866a8cd6e31/roles/fe9379cda35c4ff78576fe48b60bea3c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:36:12.030014 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc11b0e5-9acf-48b8-b993-f4b89e429db5 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:12.043863 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc11b0e5-9acf-48b8-b993-f4b89e429db5 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:12.131279 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced04910-6ec2-4df8-bd48-64ac6ac6c98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:12.132193 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced04910-6ec2-4df8-bd48-64ac6ac6c98a admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:12.132718 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced04910-6ec2-4df8-bd48-64ac6ac6c98a admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:12.133201 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced04910-6ec2-4df8-bd48-64ac6ac6c98a admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:12.133869 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced04910-6ec2-4df8-bd48-64ac6ac6c98a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:12.135759 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced04910-6ec2-4df8-bd48-64ac6ac6c98a admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:12.159109 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1340/2665] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:36:12 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:36:12.160147 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3d16e3-cd65-4115-84dd-9cad581e393b admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:12.170744 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3d16e3-cd65-4115-84dd-9cad581e393b admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:12.176034 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4fa225-4295-44a1-94d5-f57fb91c2baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:12.176700 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4fa225-4295-44a1-94d5-f57fb91c2baf admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:12.177613 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4fa225-4295-44a1-94d5-f57fb91c2baf admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:12.177906 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4fa225-4295-44a1-94d5-f57fb91c2baf admin admin] PATH_INFO: `/v3/projects/c3c365437dad4347b94f1ad5d38e7e9e/users/6ebfc21a3180402bb6474866a8cd6e31/roles/fe9379cda35c4ff78576fe48b60bea3c` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:12.180102 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4fa225-4295-44a1-94d5-f57fb91c2baf admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3c365437dad4347b94f1ad5d38e7e9e, user_id=6ebfc21a3180402bb6474866a8cd6e31, role_id=fe9379cda35c4ff78576fe48b60bea3c)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:12.183005 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4fa225-4295-44a1-94d5-f57fb91c2baf admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:12.191828 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:36:12.198009 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1326/2666] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:36:12 2022] PUT /identity/v3/projects/c3c365437dad4347b94f1ad5d38e7e9e/users/6ebfc21a3180402bb6474866a8cd6e31/roles/fe9379cda35c4ff78576fe48b60bea3c => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 03:36:12.209253 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd87bb0-c65f-4a86-b701-641e31d07b49 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:12.209543 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd87bb0-c65f-4a86-b701-641e31d07b49 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:12.209829 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd87bb0-c65f-4a86-b701-641e31d07b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:12.242512 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-6dd87bb0-c65f-4a86-b701-641e31d07b49 None None] MFA Rules not processed for user `6ebfc21a3180402bb6474866a8cd6e31`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:36:12.244302 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-6dd87bb0-c65f-4a86-b701-641e31d07b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:12.304765 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:36:12.327929 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1341/2667] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:36:12 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:36:12.339752 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4fa225-4295-44a1-94d5-f57fb91c2baf admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:12.342734 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-5d4fa225-4295-44a1-94d5-f57fb91c2baf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:12.413632 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4fa225-4295-44a1-94d5-f57fb91c2baf admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:12.417644 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a539d91f-5230-4f93-8b98-b87fcf070aee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f537aabf3d1040ff840b02616f839975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:12.418652 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539d91f-5230-4f93-8b98-b87fcf070aee service cinder] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:12.418983 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539d91f-5230-4f93-8b98-b87fcf070aee service cinder] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:12.419335 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539d91f-5230-4f93-8b98-b87fcf070aee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:12.562610 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a539d91f-5230-4f93-8b98-b87fcf070aee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:12.564120 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a539d91f-5230-4f93-8b98-b87fcf070aee service cinder] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:12.587967 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1327/2668] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:36:12 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:36:15.338212 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b30210-7542-4d06-9376-f22c817f5222 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:15.338732 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b30210-7542-4d06-9376-f22c817f5222 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:15.338829 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b30210-7542-4d06-9376-f22c817f5222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:15.388311 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-41b30210-7542-4d06-9376-f22c817f5222 None None] MFA Rules not processed for user `926111af89d943a597ec28264b1ef026`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:36:15.389615 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-41b30210-7542-4d06-9376-f22c817f5222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:15.455290 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1342/2669] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:36:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:36:15.459969 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a539d91f-5230-4f93-8b98-b87fcf070aee service cinder] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:15.461393 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-a539d91f-5230-4f93-8b98-b87fcf070aee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:15.527676 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a539d91f-5230-4f93-8b98-b87fcf070aee service cinder] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:15.532241 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad76a4fe-b4d4-42f1-bbf3-5ca923231e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:15.532849 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad76a4fe-b4d4-42f1-bbf3-5ca923231e1f admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:15.533129 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad76a4fe-b4d4-42f1-bbf3-5ca923231e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:15.533405 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad76a4fe-b4d4-42f1-bbf3-5ca923231e1f admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:15.534089 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad76a4fe-b4d4-42f1-bbf3-5ca923231e1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:15.536000 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad76a4fe-b4d4-42f1-bbf3-5ca923231e1f admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:15.568249 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1328/2670] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:36:15 2022] POST /identity/v3/projects => generated 385 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:36:15.569623 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b30210-7542-4d06-9376-f22c817f5222 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:15.581861 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b30210-7542-4d06-9376-f22c817f5222 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:15.647985 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bfaea4-95d8-4f70-b5c2-db075e072124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:15.648605 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bfaea4-95d8-4f70-b5c2-db075e072124 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:15.648894 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bfaea4-95d8-4f70-b5c2-db075e072124 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:15.649156 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bfaea4-95d8-4f70-b5c2-db075e072124 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:15.649814 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bfaea4-95d8-4f70-b5c2-db075e072124 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:15.651894 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bfaea4-95d8-4f70-b5c2-db075e072124 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:15.679748 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1343/2671] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:36:15 2022] POST /identity/v3/users => generated 299 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:36:15.681467 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad76a4fe-b4d4-42f1-bbf3-5ca923231e1f admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:15.692813 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad76a4fe-b4d4-42f1-bbf3-5ca923231e1f admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:15.707680 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a6166-26ba-4947-99a3-e8f8f402db89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:15.707680 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a6166-26ba-4947-99a3-e8f8f402db89 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:15.707680 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a6166-26ba-4947-99a3-e8f8f402db89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:15.707680 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a6166-26ba-4947-99a3-e8f8f402db89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:15.708086 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09a6166-26ba-4947-99a3-e8f8f402db89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:15.708086 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09a6166-26ba-4947-99a3-e8f8f402db89 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:15.713030 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1329/2672] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:36:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:36:15.718010 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bfaea4-95d8-4f70-b5c2-db075e072124 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:15.728075 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bfaea4-95d8-4f70-b5c2-db075e072124 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:15.733504 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb885aed-77f3-4193-981e-6f9222fe7fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:15.734171 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb885aed-77f3-4193-981e-6f9222fe7fef admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:15.734461 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb885aed-77f3-4193-981e-6f9222fe7fef admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:15.734760 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb885aed-77f3-4193-981e-6f9222fe7fef admin admin] PATH_INFO: `/v3/projects/b6759b706a55486eb05f5a75fa01b070/users/f182e20d1a9141b7951d20e007412be4/roles/fe9379cda35c4ff78576fe48b60bea3c` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:15.756676 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb885aed-77f3-4193-981e-6f9222fe7fef admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6759b706a55486eb05f5a75fa01b070, user_id=f182e20d1a9141b7951d20e007412be4, role_id=fe9379cda35c4ff78576fe48b60bea3c)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:15.759869 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb885aed-77f3-4193-981e-6f9222fe7fef admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:15.776964 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1344/2673] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:36:15 2022] PUT /identity/v3/projects/b6759b706a55486eb05f5a75fa01b070/users/f182e20d1a9141b7951d20e007412be4/roles/fe9379cda35c4ff78576fe48b60bea3c => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:36:15.781346 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a6166-26ba-4947-99a3-e8f8f402db89 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:15.796193 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a6166-26ba-4947-99a3-e8f8f402db89 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:15.829148 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:36:15.872536 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23753740-ac57-494b-b209-08c98ad1311f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:15.873158 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23753740-ac57-494b-b209-08c98ad1311f admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:15.873491 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23753740-ac57-494b-b209-08c98ad1311f admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:15.873773 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23753740-ac57-494b-b209-08c98ad1311f admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:15.874420 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23753740-ac57-494b-b209-08c98ad1311f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:15.876096 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23753740-ac57-494b-b209-08c98ad1311f admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:15.887693 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1330/2674] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:36:15 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 03:36:15.892698 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb885aed-77f3-4193-981e-6f9222fe7fef admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:15.907686 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb885aed-77f3-4193-981e-6f9222fe7fef admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:15.913929 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78024a6e-dca4-446c-abad-4699b291554f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:15.914593 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78024a6e-dca4-446c-abad-4699b291554f admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:15.914873 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78024a6e-dca4-446c-abad-4699b291554f admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:15.915146 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78024a6e-dca4-446c-abad-4699b291554f admin admin] PATH_INFO: `/v3/projects/b6759b706a55486eb05f5a75fa01b070/users/f182e20d1a9141b7951d20e007412be4/roles/fe9379cda35c4ff78576fe48b60bea3c` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:15.917292 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78024a6e-dca4-446c-abad-4699b291554f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6759b706a55486eb05f5a75fa01b070, user_id=f182e20d1a9141b7951d20e007412be4, role_id=fe9379cda35c4ff78576fe48b60bea3c)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:15.920459 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78024a6e-dca4-446c-abad-4699b291554f admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:15.933935 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1345/2675] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:36:15 2022] PUT /identity/v3/projects/b6759b706a55486eb05f5a75fa01b070/users/f182e20d1a9141b7951d20e007412be4/roles/fe9379cda35c4ff78576fe48b60bea3c => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:36:16.845513 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23753740-ac57-494b-b209-08c98ad1311f admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:16.848238 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-23753740-ac57-494b-b209-08c98ad1311f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:16.938359 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23753740-ac57-494b-b209-08c98ad1311f admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:17.003043 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a150d95-b850-40b9-9e5d-ecfd316f9d50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:17.003559 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a150d95-b850-40b9-9e5d-ecfd316f9d50 service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:17.003990 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a150d95-b850-40b9-9e5d-ecfd316f9d50 service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:17.004754 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a150d95-b850-40b9-9e5d-ecfd316f9d50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:17.008556 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-5a150d95-b850-40b9-9e5d-ecfd316f9d50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:17.091265 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a150d95-b850-40b9-9e5d-ecfd316f9d50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:17.092973 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a150d95-b850-40b9-9e5d-ecfd316f9d50 service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:17.104621 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1331/2676] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:36:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:36:17.514563 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78024a6e-dca4-446c-abad-4699b291554f admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:17.558509 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:36:17.593914 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78024a6e-dca4-446c-abad-4699b291554f admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:17.598779 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac226b8a-d880-4550-a155-89662cd324c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f537aabf3d1040ff840b02616f839975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:17.599697 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac226b8a-d880-4550-a155-89662cd324c8 service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:17.600322 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac226b8a-d880-4550-a155-89662cd324c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:17.601042 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac226b8a-d880-4550-a155-89662cd324c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:17.679421 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac226b8a-d880-4550-a155-89662cd324c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:17.681144 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac226b8a-d880-4550-a155-89662cd324c8 service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:17.705242 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1346/2677] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:36:17 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:36:21.673429 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63724450-5efe-4028-a717-66b2eb2c0f72 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:21.673862 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63724450-5efe-4028-a717-66b2eb2c0f72 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:21.673993 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63724450-5efe-4028-a717-66b2eb2c0f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:21.710306 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-63724450-5efe-4028-a717-66b2eb2c0f72 None None] MFA Rules not processed for user `f182e20d1a9141b7951d20e007412be4`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:36:21.711556 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-63724450-5efe-4028-a717-66b2eb2c0f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:21.731432 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:36:21.806456 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1332/2678] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:36:21 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:36:21.817816 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac226b8a-d880-4550-a155-89662cd324c8 service cinder] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:21.819878 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-ac226b8a-d880-4550-a155-89662cd324c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:21.907018 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63724450-5efe-4028-a717-66b2eb2c0f72 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:21.907374 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac226b8a-d880-4550-a155-89662cd324c8 service cinder] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:21.910008 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-63724450-5efe-4028-a717-66b2eb2c0f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:21.911519 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d0c311-27e1-4994-9bbc-1f81dc08093f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95be0e4e1c8641709e07b115047fb4e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:21.912138 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d0c311-27e1-4994-9bbc-1f81dc08093f service glance] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:21.912552 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d0c311-27e1-4994-9bbc-1f81dc08093f service glance] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:21.912895 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d0c311-27e1-4994-9bbc-1f81dc08093f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:22.016288 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d0c311-27e1-4994-9bbc-1f81dc08093f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:22.017828 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d0c311-27e1-4994-9bbc-1f81dc08093f service glance] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:22.028469 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63724450-5efe-4028-a717-66b2eb2c0f72 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:22.030882 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1347/2679] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:36:21 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:36:22.031713 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d0c311-27e1-4994-9bbc-1f81dc08093f service glance] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:22.033134 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-e7d0c311-27e1-4994-9bbc-1f81dc08093f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:22.034517 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b70b0ac-385d-4a32-9220-dfca0f97ed43 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94513f6cd19f495e842deb3c13c3e4d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:22.035209 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b70b0ac-385d-4a32-9220-dfca0f97ed43 service placement] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:22.035775 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b70b0ac-385d-4a32-9220-dfca0f97ed43 service placement] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:22.036551 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b70b0ac-385d-4a32-9220-dfca0f97ed43 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:22.038703 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-9b70b0ac-385d-4a32-9220-dfca0f97ed43 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:22.059426 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b70b0ac-385d-4a32-9220-dfca0f97ed43 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:22.062088 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b70b0ac-385d-4a32-9220-dfca0f97ed43 service placement] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:22.063065 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d0c311-27e1-4994-9bbc-1f81dc08093f service glance] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:22.073684 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5da8e6c-8346-4288-ab1b-e9c7105764b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:22.075172 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da8e6c-8346-4288-ab1b-e9c7105764b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:22.075695 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da8e6c-8346-4288-ab1b-e9c7105764b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:22.076186 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da8e6c-8346-4288-ab1b-e9c7105764b7 admin admin] PATH_INFO: `/v3/users/542b137fb8cd4d25867d95a13d2cb651` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:22.077464 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5da8e6c-8346-4288-ab1b-e9c7105764b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=542b137fb8cd4d25867d95a13d2cb651)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:22.080183 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5da8e6c-8346-4288-ab1b-e9c7105764b7 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:22.087160 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1333/2680] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:36:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 03:36:22.133810 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:36:22.164172 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-c5da8e6c-8346-4288-ab1b-e9c7105764b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '542b137fb8cd4d25867d95a13d2cb651'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:22.165047 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-c5da8e6c-8346-4288-ab1b-e9c7105764b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '542b137fb8cd4d25867d95a13d2cb651'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:22.187135 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-c5da8e6c-8346-4288-ab1b-e9c7105764b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '542b137fb8cd4d25867d95a13d2cb651'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:22.194945 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-c5da8e6c-8346-4288-ab1b-e9c7105764b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '542b137fb8cd4d25867d95a13d2cb651'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:22.209360 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-c5da8e6c-8346-4288-ab1b-e9c7105764b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '542b137fb8cd4d25867d95a13d2cb651'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:22.226167 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1348/2681] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:36:22 2022] DELETE /identity/v3/users/542b137fb8cd4d25867d95a13d2cb651 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:36:22.254529 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f462f5-fd53-4285-9ecb-879320812cdb None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:22.254825 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f462f5-fd53-4285-9ecb-879320812cdb None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:22.255106 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f462f5-fd53-4285-9ecb-879320812cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:22.280739 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-34f462f5-fd53-4285-9ecb-879320812cdb None None] MFA Rules not processed for user `bef61ef12079495ba72b7fcd2717aca2`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:36:22.282058 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-34f462f5-fd53-4285-9ecb-879320812cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:22.440687 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1334/2682] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Oct 4 03:36:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:36:22.472765 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5da8e6c-8346-4288-ab1b-e9c7105764b7 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:22.475079 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-c5da8e6c-8346-4288-ab1b-e9c7105764b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:22.513260 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f462f5-fd53-4285-9ecb-879320812cdb None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:22.514848 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-34f462f5-fd53-4285-9ecb-879320812cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:22.603353 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:36:22.625303 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5da8e6c-8346-4288-ab1b-e9c7105764b7 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:22.626537 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f462f5-fd53-4285-9ecb-879320812cdb None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:22.634684 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc1950-903d-4d3f-bca0-94ab9abb2766 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8da6bacc8f432e8f48bb99c7aede11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:22.634684 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc1950-903d-4d3f-bca0-94ab9abb2766 service swift] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:22.634684 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc1950-903d-4d3f-bca0-94ab9abb2766 service swift] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:22.634684 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc1950-903d-4d3f-bca0-94ab9abb2766 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:22.639763 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc5ac6d-151d-4fbf-ab12-afc7aeee671f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:22.640439 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc5ac6d-151d-4fbf-ab12-afc7aeee671f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:22.640728 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc5ac6d-151d-4fbf-ab12-afc7aeee671f admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:22.641111 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc5ac6d-151d-4fbf-ab12-afc7aeee671f admin admin] PATH_INFO: `/v3/projects/96643b79b7724c398b1df29f9ea0bbd4` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:22.643102 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc5ac6d-151d-4fbf-ab12-afc7aeee671f admin admin] RBAC: Authorizing `identity:delete_project(project_id=96643b79b7724c398b1df29f9ea0bbd4)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:22.645569 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bc1950-903d-4d3f-bca0-94ab9abb2766 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:22.646245 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc5ac6d-151d-4fbf-ab12-afc7aeee671f admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:22.647808 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bc1950-903d-4d3f-bca0-94ab9abb2766 service swift] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:22.660263 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1349/2683] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Oct 4 03:36:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 04 03:36:22.708953 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-5cc5ac6d-151d-4fbf-ab12-afc7aeee671f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96643b79b7724c398b1df29f9ea0bbd4', 'request_id': 'req-5cc5ac6d-151d-4fbf-ab12-afc7aeee671f'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:22.726517 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-5cc5ac6d-151d-4fbf-ab12-afc7aeee671f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96643b79b7724c398b1df29f9ea0bbd4', 'request_id': 'req-5cc5ac6d-151d-4fbf-ab12-afc7aeee671f'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:22.740979 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-5cc5ac6d-151d-4fbf-ab12-afc7aeee671f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96643b79b7724c398b1df29f9ea0bbd4', 'request_id': 'req-5cc5ac6d-151d-4fbf-ab12-afc7aeee671f'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:22.765019 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-5cc5ac6d-151d-4fbf-ab12-afc7aeee671f admin admin] The token cache is being invalidate because project 96643b79b7724c398b1df29f9ea0bbd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:36:22.765420 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-5cc5ac6d-151d-4fbf-ab12-afc7aeee671f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:22.767182 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-5cc5ac6d-151d-4fbf-ab12-afc7aeee671f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:22.769226 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1335/2684] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:36:22 2022] DELETE /identity/v3/projects/96643b79b7724c398b1df29f9ea0bbd4 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:36:22.773846 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24106c78-bde3-493e-9ef4-cf4e6abc3a72 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:22.774202 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24106c78-bde3-493e-9ef4-cf4e6abc3a72 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:22.774539 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24106c78-bde3-493e-9ef4-cf4e6abc3a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:22.797997 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-24106c78-bde3-493e-9ef4-cf4e6abc3a72 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:36:22.799341 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-24106c78-bde3-493e-9ef4-cf4e6abc3a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:22.881588 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1350/2685] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:36:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:36:22.890949 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aecefc7-399d-4c22-b082-157ebe407219 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:22.891245 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aecefc7-399d-4c22-b082-157ebe407219 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:22.891672 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aecefc7-399d-4c22-b082-157ebe407219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:22.916188 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-5aecefc7-399d-4c22-b082-157ebe407219 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:36:22.918130 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-5aecefc7-399d-4c22-b082-157ebe407219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:22.939009 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1336/2686] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:36:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:36:22.942428 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24106c78-bde3-493e-9ef4-cf4e6abc3a72 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:22.961012 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24106c78-bde3-493e-9ef4-cf4e6abc3a72 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:22.969381 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f85df-96fa-4309-977c-288f1cc60723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:22.970225 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f85df-96fa-4309-977c-288f1cc60723 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:22.970676 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f85df-96fa-4309-977c-288f1cc60723 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:22.970954 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f85df-96fa-4309-977c-288f1cc60723 admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:22.971659 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9f85df-96fa-4309-977c-288f1cc60723 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:36:22.971975 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9f85df-96fa-4309-977c-288f1cc60723 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:22.973694 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9f85df-96fa-4309-977c-288f1cc60723 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:22.990570 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1351/2687] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 03:36:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:36:22.994746 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aecefc7-399d-4c22-b082-157ebe407219 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:23.007255 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aecefc7-399d-4c22-b082-157ebe407219 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:23.015162 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e172de8e-157e-4544-b653-11b64e5138ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:23.015812 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e172de8e-157e-4544-b653-11b64e5138ac admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:23.016099 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e172de8e-157e-4544-b653-11b64e5138ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:23.016389 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e172de8e-157e-4544-b653-11b64e5138ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:23.017019 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e172de8e-157e-4544-b653-11b64e5138ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:23.018955 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e172de8e-157e-4544-b653-11b64e5138ac admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:23.071541 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1337/2688] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:36:22 2022] POST /identity/v3/projects => generated 375 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:36:23.076095 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f85df-96fa-4309-977c-288f1cc60723 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:23.088353 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f85df-96fa-4309-977c-288f1cc60723 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:23.127016 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:36:23.183198 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba47944e-5687-45cc-8ac7-c09d9006b853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:23.184037 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47944e-5687-45cc-8ac7-c09d9006b853 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:23.184425 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47944e-5687-45cc-8ac7-c09d9006b853 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:23.184789 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47944e-5687-45cc-8ac7-c09d9006b853 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:23.185524 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba47944e-5687-45cc-8ac7-c09d9006b853 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:23.187532 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba47944e-5687-45cc-8ac7-c09d9006b853 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:23.222212 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1352/2689] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:36:23 2022] POST /identity/v3/users => generated 288 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 03:36:23.225980 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e172de8e-157e-4544-b653-11b64e5138ac admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:23.237968 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e172de8e-157e-4544-b653-11b64e5138ac admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:23.243597 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271e6f2c-c5ad-46da-9352-ff47ee638941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:23.244450 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e6f2c-c5ad-46da-9352-ff47ee638941 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:23.244797 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e6f2c-c5ad-46da-9352-ff47ee638941 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:23.250342 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e6f2c-c5ad-46da-9352-ff47ee638941 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:23.251755 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271e6f2c-c5ad-46da-9352-ff47ee638941 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:23.253555 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271e6f2c-c5ad-46da-9352-ff47ee638941 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:23.265701 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1338/2690] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:36:23 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:36:23.269614 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba47944e-5687-45cc-8ac7-c09d9006b853 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:23.283050 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba47944e-5687-45cc-8ac7-c09d9006b853 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:23.288176 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b9922e-6ecb-4fb4-888e-109b932e90fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:23.288907 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9922e-6ecb-4fb4-888e-109b932e90fe admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:23.289290 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9922e-6ecb-4fb4-888e-109b932e90fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:23.289657 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9922e-6ecb-4fb4-888e-109b932e90fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:23.290428 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b9922e-6ecb-4fb4-888e-109b932e90fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:23.292249 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b9922e-6ecb-4fb4-888e-109b932e90fe admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:23.308732 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1353/2691] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:36:23 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:36:23.309527 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271e6f2c-c5ad-46da-9352-ff47ee638941 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:23.320625 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271e6f2c-c5ad-46da-9352-ff47ee638941 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:23.328349 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0162a8-571d-42ac-8f6d-8b0f2c407681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:23.329017 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0162a8-571d-42ac-8f6d-8b0f2c407681 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:23.329297 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0162a8-571d-42ac-8f6d-8b0f2c407681 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:23.329572 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0162a8-571d-42ac-8f6d-8b0f2c407681 admin admin] PATH_INFO: `/v3/projects/ffeec483916b4d378521c1552404e212/users/29e7285a0dea417da03ad999cee106ca/roles/04d0e4575a28440eb4349b4a6565e8b8` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:23.350816 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0162a8-571d-42ac-8f6d-8b0f2c407681 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffeec483916b4d378521c1552404e212, user_id=29e7285a0dea417da03ad999cee106ca, role_id=04d0e4575a28440eb4349b4a6565e8b8)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:23.355777 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0162a8-571d-42ac-8f6d-8b0f2c407681 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:23.375636 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1339/2692] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:36:23 2022] PUT /identity/v3/projects/ffeec483916b4d378521c1552404e212/users/29e7285a0dea417da03ad999cee106ca/roles/04d0e4575a28440eb4349b4a6565e8b8 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 03:36:23.387251 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c17b9-9bf0-4d68-9ec9-8ab1b1353a80 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:23.387671 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c17b9-9bf0-4d68-9ec9-8ab1b1353a80 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:23.387951 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c17b9-9bf0-4d68-9ec9-8ab1b1353a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:23.429801 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-438c17b9-9bf0-4d68-9ec9-8ab1b1353a80 None None] MFA Rules not processed for user `29e7285a0dea417da03ad999cee106ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:36:23.435028 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-438c17b9-9bf0-4d68-9ec9-8ab1b1353a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:23.526422 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1354/2693] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:36:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:36:23.531619 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0162a8-571d-42ac-8f6d-8b0f2c407681 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:23.618876 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438c17b9-9bf0-4d68-9ec9-8ab1b1353a80 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:23.621021 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-438c17b9-9bf0-4d68-9ec9-8ab1b1353a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:23.657333 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0162a8-571d-42ac-8f6d-8b0f2c407681 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:23.662295 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6782a23e-1430-40f1-a399-fd187ad53da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:23.662898 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6782a23e-1430-40f1-a399-fd187ad53da7 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:23.663399 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6782a23e-1430-40f1-a399-fd187ad53da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:23.663567 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6782a23e-1430-40f1-a399-fd187ad53da7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:23.664109 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6782a23e-1430-40f1-a399-fd187ad53da7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:23.669507 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6782a23e-1430-40f1-a399-fd187ad53da7 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:23.714748 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1340/2694] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:36:23 2022] POST /identity/v3/projects => generated 375 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:36:23.715812 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6782a23e-1430-40f1-a399-fd187ad53da7 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:23.720439 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:36:23.733632 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438c17b9-9bf0-4d68-9ec9-8ab1b1353a80 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:23.814140 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:36:23.835403 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6782a23e-1430-40f1-a399-fd187ad53da7 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:23.841277 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f57ca3e-1dd3-40a2-930d-c1832490250f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:23.841996 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f57ca3e-1dd3-40a2-930d-c1832490250f admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:23.842394 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f57ca3e-1dd3-40a2-930d-c1832490250f admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:23.842763 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f57ca3e-1dd3-40a2-930d-c1832490250f admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:23.843514 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f57ca3e-1dd3-40a2-930d-c1832490250f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:23.845771 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f57ca3e-1dd3-40a2-930d-c1832490250f admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:23.872270 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2be3428-5ec5-40f1-b138-32c19657e365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:23.873294 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be3428-5ec5-40f1-b138-32c19657e365 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:23.873656 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be3428-5ec5-40f1-b138-32c19657e365 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:23.874124 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be3428-5ec5-40f1-b138-32c19657e365 admin admin] PATH_INFO: `/v3/users/157cb3191dae45e184ce96ca71eb8682` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:23.875469 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2be3428-5ec5-40f1-b138-32c19657e365 admin admin] RBAC: Authorizing `identity:delete_user(user_id=157cb3191dae45e184ce96ca71eb8682)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:23.883069 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2be3428-5ec5-40f1-b138-32c19657e365 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:23.904577 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1341/2695] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:36:23 2022] POST /identity/v3/users => generated 294 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 03:36:23.905627 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f57ca3e-1dd3-40a2-930d-c1832490250f admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:23.929623 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f57ca3e-1dd3-40a2-930d-c1832490250f admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:23.935345 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b7ded8-2458-4be3-a2e9-15337387587d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:23.936015 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b7ded8-2458-4be3-a2e9-15337387587d admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:23.936299 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b7ded8-2458-4be3-a2e9-15337387587d admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:23.940658 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b7ded8-2458-4be3-a2e9-15337387587d admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:23.941869 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b7ded8-2458-4be3-a2e9-15337387587d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:23.943764 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b7ded8-2458-4be3-a2e9-15337387587d admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:23.968562 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1342/2696] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:36:23 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:36:23.970955 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b7ded8-2458-4be3-a2e9-15337387587d admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:23.986189 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b7ded8-2458-4be3-a2e9-15337387587d admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:23.987716 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-f2be3428-5ec5-40f1-b138-32c19657e365 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '157cb3191dae45e184ce96ca71eb8682'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:23.988736 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-f2be3428-5ec5-40f1-b138-32c19657e365 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '157cb3191dae45e184ce96ca71eb8682'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:24.000754 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cef6f36-b776-45e2-94f0-84d7d9de9a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:24.001629 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef6f36-b776-45e2-94f0-84d7d9de9a37 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:24.001919 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef6f36-b776-45e2-94f0-84d7d9de9a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:24.002260 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef6f36-b776-45e2-94f0-84d7d9de9a37 admin admin] PATH_INFO: `/v3/projects/ab2b2c433a294fc28e5438c008e607dc/users/b43b16ad2b20463bbf6d29f32af413f3/roles/fe9379cda35c4ff78576fe48b60bea3c` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:24.003117 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-f2be3428-5ec5-40f1-b138-32c19657e365 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '157cb3191dae45e184ce96ca71eb8682'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:24.004068 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-f2be3428-5ec5-40f1-b138-32c19657e365 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '157cb3191dae45e184ce96ca71eb8682'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:24.024291 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-f2be3428-5ec5-40f1-b138-32c19657e365 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '157cb3191dae45e184ce96ca71eb8682'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:24.025311 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cef6f36-b776-45e2-94f0-84d7d9de9a37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab2b2c433a294fc28e5438c008e607dc, user_id=b43b16ad2b20463bbf6d29f32af413f3, role_id=fe9379cda35c4ff78576fe48b60bea3c)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:24.031344 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cef6f36-b776-45e2-94f0-84d7d9de9a37 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:24.047644 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1355/2697] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:36:23 2022] DELETE /identity/v3/users/157cb3191dae45e184ce96ca71eb8682 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 03:36:24.054703 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb4bdc-bc5c-4819-a5a5-606a52bc7ff0 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:24.054994 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb4bdc-bc5c-4819-a5a5-606a52bc7ff0 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:24.055259 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb4bdc-bc5c-4819-a5a5-606a52bc7ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:24.062633 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1343/2698] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:36:23 2022] PUT /identity/v3/projects/ab2b2c433a294fc28e5438c008e607dc/users/b43b16ad2b20463bbf6d29f32af413f3/roles/fe9379cda35c4ff78576fe48b60bea3c => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:36:24.066395 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cef6f36-b776-45e2-94f0-84d7d9de9a37 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:24.071429 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-2cef6f36-b776-45e2-94f0-84d7d9de9a37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:24.083339 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-47bb4bdc-bc5c-4819-a5a5-606a52bc7ff0 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:36:24.084475 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-47bb4bdc-bc5c-4819-a5a5-606a52bc7ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:24.157738 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cef6f36-b776-45e2-94f0-84d7d9de9a37 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:24.163785 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824c5150-78fb-4632-a5d2-aa1b574772f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:24.164519 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824c5150-78fb-4632-a5d2-aa1b574772f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:24.164907 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824c5150-78fb-4632-a5d2-aa1b574772f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:24.165286 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824c5150-78fb-4632-a5d2-aa1b574772f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:24.166105 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824c5150-78fb-4632-a5d2-aa1b574772f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:24.169075 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824c5150-78fb-4632-a5d2-aa1b574772f3 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:24.180149 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1344/2699] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:36:24 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 03:36:24.185896 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824c5150-78fb-4632-a5d2-aa1b574772f3 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:24.188829 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1356/2700] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:36:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:36:24.199681 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824c5150-78fb-4632-a5d2-aa1b574772f3 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:24.202319 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bb4bdc-bc5c-4819-a5a5-606a52bc7ff0 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:24.203734 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-47bb4bdc-bc5c-4819-a5a5-606a52bc7ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:24.208103 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b01ceee-fdd1-4c1a-b3b4-5cfc64c7f35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:24.208899 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b01ceee-fdd1-4c1a-b3b4-5cfc64c7f35b admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:24.209256 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b01ceee-fdd1-4c1a-b3b4-5cfc64c7f35b admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:24.209775 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b01ceee-fdd1-4c1a-b3b4-5cfc64c7f35b admin admin] PATH_INFO: `/v3/projects/ab2b2c433a294fc28e5438c008e607dc/users/b43b16ad2b20463bbf6d29f32af413f3/roles/fe9379cda35c4ff78576fe48b60bea3c` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:24.212624 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b01ceee-fdd1-4c1a-b3b4-5cfc64c7f35b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab2b2c433a294fc28e5438c008e607dc, user_id=b43b16ad2b20463bbf6d29f32af413f3, role_id=fe9379cda35c4ff78576fe48b60bea3c)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:24.215655 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b01ceee-fdd1-4c1a-b3b4-5cfc64c7f35b admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:24.231664 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1345/2701] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:36:24 2022] PUT /identity/v3/projects/ab2b2c433a294fc28e5438c008e607dc/users/b43b16ad2b20463bbf6d29f32af413f3/roles/fe9379cda35c4ff78576fe48b60bea3c => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:36:24.239973 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd6d1e-389d-43d6-9f29-e9e6ab2e9a97 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:24.240488 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd6d1e-389d-43d6-9f29-e9e6ab2e9a97 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:24.240948 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd6d1e-389d-43d6-9f29-e9e6ab2e9a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:24.275802 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-63dd6d1e-389d-43d6-9f29-e9e6ab2e9a97 None None] MFA Rules not processed for user `b43b16ad2b20463bbf6d29f32af413f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:36:24.279506 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-63dd6d1e-389d-43d6-9f29-e9e6ab2e9a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:24.291005 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bb4bdc-bc5c-4819-a5a5-606a52bc7ff0 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:24.305442 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:36:24.323991 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:36:24.378593 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1346/2702] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:36:24 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:36:24.391202 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dd6d1e-389d-43d6-9f29-e9e6ab2e9a97 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:24.393098 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-63dd6d1e-389d-43d6-9f29-e9e6ab2e9a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:24.397897 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6574d4-d41e-4765-ae19-9d600c7e0058 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:24.398589 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6574d4-d41e-4765-ae19-9d600c7e0058 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:24.398940 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6574d4-d41e-4765-ae19-9d600c7e0058 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:24.399287 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6574d4-d41e-4765-ae19-9d600c7e0058 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:24.473881 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dd6d1e-389d-43d6-9f29-e9e6ab2e9a97 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:24.480778 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69fab1f-2ae7-4dcc-ba83-5ab33f21bc11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f537aabf3d1040ff840b02616f839975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:24.481735 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69fab1f-2ae7-4dcc-ba83-5ab33f21bc11 service cinder] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:24.482169 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69fab1f-2ae7-4dcc-ba83-5ab33f21bc11 service cinder] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:24.482594 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69fab1f-2ae7-4dcc-ba83-5ab33f21bc11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:24.484726 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-e69fab1f-2ae7-4dcc-ba83-5ab33f21bc11 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:24.485342 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6574d4-d41e-4765-ae19-9d600c7e0058 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:24.486854 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6574d4-d41e-4765-ae19-9d600c7e0058 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:24.500327 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1357/2703] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:36:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 03:36:24.562641 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69fab1f-2ae7-4dcc-ba83-5ab33f21bc11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:24.564133 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69fab1f-2ae7-4dcc-ba83-5ab33f21bc11 service cinder] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:24.577068 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1347/2704] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:36:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:36:24.945576 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6574d4-d41e-4765-ae19-9d600c7e0058 service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:24.948038 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-5a6574d4-d41e-4765-ae19-9d600c7e0058 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:25.006241 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6574d4-d41e-4765-ae19-9d600c7e0058 service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:25.012162 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7de1a7-5426-4b48-8ab6-fddf3971b65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:25.013504 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7de1a7-5426-4b48-8ab6-fddf3971b65a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:25.014044 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7de1a7-5426-4b48-8ab6-fddf3971b65a admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:25.014557 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7de1a7-5426-4b48-8ab6-fddf3971b65a admin admin] PATH_INFO: `/v3/projects/bfe1d27e6d7b481592076e7728368208` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:25.016141 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7de1a7-5426-4b48-8ab6-fddf3971b65a admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfe1d27e6d7b481592076e7728368208)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:25.020067 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7de1a7-5426-4b48-8ab6-fddf3971b65a admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:25.112202 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-ba7de1a7-5426-4b48-8ab6-fddf3971b65a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfe1d27e6d7b481592076e7728368208', 'request_id': 'req-ba7de1a7-5426-4b48-8ab6-fddf3971b65a'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:25.119009 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-ba7de1a7-5426-4b48-8ab6-fddf3971b65a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfe1d27e6d7b481592076e7728368208', 'request_id': 'req-ba7de1a7-5426-4b48-8ab6-fddf3971b65a'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:25.127363 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-ba7de1a7-5426-4b48-8ab6-fddf3971b65a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfe1d27e6d7b481592076e7728368208', 'request_id': 'req-ba7de1a7-5426-4b48-8ab6-fddf3971b65a'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:25.154728 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-ba7de1a7-5426-4b48-8ab6-fddf3971b65a admin admin] The token cache is being invalidate because project bfe1d27e6d7b481592076e7728368208 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:36:25.155134 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-ba7de1a7-5426-4b48-8ab6-fddf3971b65a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:25.156061 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-ba7de1a7-5426-4b48-8ab6-fddf3971b65a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:25.161022 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1358/2705] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:36:24 2022] DELETE /identity/v3/projects/bfe1d27e6d7b481592076e7728368208 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:36:25.163371 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69fab1f-2ae7-4dcc-ba83-5ab33f21bc11 service cinder] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:25.184752 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69fab1f-2ae7-4dcc-ba83-5ab33f21bc11 service cinder] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:25.297113 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741d54cf-3495-48c5-a685-30bb169d26f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:25.297808 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d54cf-3495-48c5-a685-30bb169d26f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:25.298159 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d54cf-3495-48c5-a685-30bb169d26f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:25.298503 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d54cf-3495-48c5-a685-30bb169d26f5 admin admin] PATH_INFO: `/v3/users/6ebfc21a3180402bb6474866a8cd6e31` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:25.300176 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741d54cf-3495-48c5-a685-30bb169d26f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ebfc21a3180402bb6474866a8cd6e31)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:25.303063 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741d54cf-3495-48c5-a685-30bb169d26f5 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:25.343770 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:36:25.389704 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-741d54cf-3495-48c5-a685-30bb169d26f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ebfc21a3180402bb6474866a8cd6e31'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:25.402152 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-741d54cf-3495-48c5-a685-30bb169d26f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ebfc21a3180402bb6474866a8cd6e31'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:25.419211 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-741d54cf-3495-48c5-a685-30bb169d26f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ebfc21a3180402bb6474866a8cd6e31'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:25.419963 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-741d54cf-3495-48c5-a685-30bb169d26f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ebfc21a3180402bb6474866a8cd6e31'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:25.437113 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-741d54cf-3495-48c5-a685-30bb169d26f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ebfc21a3180402bb6474866a8cd6e31'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:25.447410 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1348/2706] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:36:25 2022] DELETE /identity/v3/users/6ebfc21a3180402bb6474866a8cd6e31 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:36:25.861356 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7de1a7-5426-4b48-8ab6-fddf3971b65a admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:25.865054 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-ba7de1a7-5426-4b48-8ab6-fddf3971b65a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:25.902145 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7de1a7-5426-4b48-8ab6-fddf3971b65a admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:25.988095 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:36:26.025989 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c92291-0522-4427-8c14-463cae21aaa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:26.027739 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c92291-0522-4427-8c14-463cae21aaa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:26.028210 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c92291-0522-4427-8c14-463cae21aaa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:26.028561 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c92291-0522-4427-8c14-463cae21aaa9 admin admin] PATH_INFO: `/v3/projects/c3c365437dad4347b94f1ad5d38e7e9e` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:26.030424 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c92291-0522-4427-8c14-463cae21aaa9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3c365437dad4347b94f1ad5d38e7e9e)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:26.032473 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c92291-0522-4427-8c14-463cae21aaa9 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:26.147462 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-84c92291-0522-4427-8c14-463cae21aaa9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3c365437dad4347b94f1ad5d38e7e9e', 'request_id': 'req-84c92291-0522-4427-8c14-463cae21aaa9'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:26.157200 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-84c92291-0522-4427-8c14-463cae21aaa9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3c365437dad4347b94f1ad5d38e7e9e', 'request_id': 'req-84c92291-0522-4427-8c14-463cae21aaa9'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:26.172589 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-84c92291-0522-4427-8c14-463cae21aaa9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3c365437dad4347b94f1ad5d38e7e9e', 'request_id': 'req-84c92291-0522-4427-8c14-463cae21aaa9'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:26.251879 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-84c92291-0522-4427-8c14-463cae21aaa9 admin admin] The token cache is being invalidate because project c3c365437dad4347b94f1ad5d38e7e9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:36:26.253053 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-84c92291-0522-4427-8c14-463cae21aaa9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:26.254068 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-84c92291-0522-4427-8c14-463cae21aaa9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:26.255986 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1359/2707] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:36:25 2022] DELETE /identity/v3/projects/c3c365437dad4347b94f1ad5d38e7e9e => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:36:26.271762 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fb3c51-5a9b-43af-9a96-11cb98d7eda2 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:26.271762 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fb3c51-5a9b-43af-9a96-11cb98d7eda2 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:26.271762 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fb3c51-5a9b-43af-9a96-11cb98d7eda2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:26.309365 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-74fb3c51-5a9b-43af-9a96-11cb98d7eda2 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:36:26.310976 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-74fb3c51-5a9b-43af-9a96-11cb98d7eda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:26.488578 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1349/2708] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:36:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:36:26.492320 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab1c73b-58ce-44bd-825e-581d79421fc5 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:26.492989 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab1c73b-58ce-44bd-825e-581d79421fc5 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:26.493421 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab1c73b-58ce-44bd-825e-581d79421fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:26.556821 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-4ab1c73b-58ce-44bd-825e-581d79421fc5 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:36:26.561197 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-4ab1c73b-58ce-44bd-825e-581d79421fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:26.584829 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1360/2709] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:36:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:36:26.592066 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fb3c51-5a9b-43af-9a96-11cb98d7eda2 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:26.610384 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fb3c51-5a9b-43af-9a96-11cb98d7eda2 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:26.616573 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc472269-2b6d-429c-9de9-2d98241c5356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:26.617484 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc472269-2b6d-429c-9de9-2d98241c5356 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:26.618394 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc472269-2b6d-429c-9de9-2d98241c5356 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:26.618684 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc472269-2b6d-429c-9de9-2d98241c5356 admin admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:26.619353 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc472269-2b6d-429c-9de9-2d98241c5356 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:36:26.619980 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc472269-2b6d-429c-9de9-2d98241c5356 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:26.622968 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc472269-2b6d-429c-9de9-2d98241c5356 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:26.640197 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1350/2710] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 03:36:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:36:26.644281 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab1c73b-58ce-44bd-825e-581d79421fc5 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:26.655511 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab1c73b-58ce-44bd-825e-581d79421fc5 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:26.662878 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13db0a5-d94c-45ff-8765-d36d8f7e07e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:26.663954 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13db0a5-d94c-45ff-8765-d36d8f7e07e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:26.664461 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13db0a5-d94c-45ff-8765-d36d8f7e07e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:26.664940 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13db0a5-d94c-45ff-8765-d36d8f7e07e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:26.665880 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13db0a5-d94c-45ff-8765-d36d8f7e07e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:26.670916 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13db0a5-d94c-45ff-8765-d36d8f7e07e9 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:26.705906 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1361/2711] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:36:26 2022] POST /identity/v3/projects => generated 361 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 03:36:26.709762 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc472269-2b6d-429c-9de9-2d98241c5356 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:26.723278 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc472269-2b6d-429c-9de9-2d98241c5356 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:26.819817 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa7c3b-dbd7-498a-a41a-4de48ef8a4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:26.820811 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa7c3b-dbd7-498a-a41a-4de48ef8a4dd admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:26.821967 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa7c3b-dbd7-498a-a41a-4de48ef8a4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:26.822450 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa7c3b-dbd7-498a-a41a-4de48ef8a4dd admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:26.824082 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aa7c3b-dbd7-498a-a41a-4de48ef8a4dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:26.826609 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aa7c3b-dbd7-498a-a41a-4de48ef8a4dd admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:26.860331 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1351/2712] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:36:26 2022] POST /identity/v3/users => generated 281 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 03:36:26.864502 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13db0a5-d94c-45ff-8765-d36d8f7e07e9 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:26.876464 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13db0a5-d94c-45ff-8765-d36d8f7e07e9 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:26.882340 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd48a7-a810-46a2-b91d-9f3c143be78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:26.882762 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd48a7-a810-46a2-b91d-9f3c143be78e admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:26.883213 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd48a7-a810-46a2-b91d-9f3c143be78e admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:26.883511 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd48a7-a810-46a2-b91d-9f3c143be78e admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:26.884444 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fd48a7-a810-46a2-b91d-9f3c143be78e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:26.885787 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fd48a7-a810-46a2-b91d-9f3c143be78e admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:26.899187 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1362/2713] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:36:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:36:26.903620 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa7c3b-dbd7-498a-a41a-4de48ef8a4dd admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:26.914431 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa7c3b-dbd7-498a-a41a-4de48ef8a4dd admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:26.919976 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0253e4-3499-4cb1-8e87-89d42141ab10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:26.920525 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0253e4-3499-4cb1-8e87-89d42141ab10 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:26.920810 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0253e4-3499-4cb1-8e87-89d42141ab10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:26.921086 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0253e4-3499-4cb1-8e87-89d42141ab10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:26.921996 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0253e4-3499-4cb1-8e87-89d42141ab10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:26.923642 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0253e4-3499-4cb1-8e87-89d42141ab10 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:26.939917 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1352/2714] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:36:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:36:26.941419 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd48a7-a810-46a2-b91d-9f3c143be78e admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:26.955053 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd48a7-a810-46a2-b91d-9f3c143be78e admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:26.960585 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546c6128-fa5c-4580-a68b-f6f1e3f77655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:26.961319 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c6128-fa5c-4580-a68b-f6f1e3f77655 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:26.961606 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c6128-fa5c-4580-a68b-f6f1e3f77655 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:26.961882 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c6128-fa5c-4580-a68b-f6f1e3f77655 admin admin] PATH_INFO: `/v3/projects/09fcd233301f4c7a91639bbdb8f678b1/users/c6aa5fa4e8284336b98ca73e44415e83/roles/04d0e4575a28440eb4349b4a6565e8b8` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:26.983923 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546c6128-fa5c-4580-a68b-f6f1e3f77655 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09fcd233301f4c7a91639bbdb8f678b1, user_id=c6aa5fa4e8284336b98ca73e44415e83, role_id=04d0e4575a28440eb4349b4a6565e8b8)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:26.986697 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546c6128-fa5c-4580-a68b-f6f1e3f77655 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:27.019566 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1363/2715] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:36:26 2022] PUT /identity/v3/projects/09fcd233301f4c7a91639bbdb8f678b1/users/c6aa5fa4e8284336b98ca73e44415e83/roles/04d0e4575a28440eb4349b4a6565e8b8 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:36:27.023262 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feacc024-da86-415b-8f40-9f524b1913bd None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:27.024372 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feacc024-da86-415b-8f40-9f524b1913bd None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:27.024902 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feacc024-da86-415b-8f40-9f524b1913bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:27.041473 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:36:27.072994 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-feacc024-da86-415b-8f40-9f524b1913bd None None] MFA Rules not processed for user `c6aa5fa4e8284336b98ca73e44415e83`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:36:27.078250 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-feacc024-da86-415b-8f40-9f524b1913bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:27.165930 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1353/2716] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:36:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:36:27.212118 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546c6128-fa5c-4580-a68b-f6f1e3f77655 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:27.214442 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-546c6128-fa5c-4580-a68b-f6f1e3f77655 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:27.288553 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546c6128-fa5c-4580-a68b-f6f1e3f77655 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:27.293538 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49801cd-9503-4398-94f9-cf685c269429 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f537aabf3d1040ff840b02616f839975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:27.294064 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49801cd-9503-4398-94f9-cf685c269429 service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:27.294369 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49801cd-9503-4398-94f9-cf685c269429 service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:27.294642 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49801cd-9503-4398-94f9-cf685c269429 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:27.304468 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49801cd-9503-4398-94f9-cf685c269429 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:27.306102 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49801cd-9503-4398-94f9-cf685c269429 service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:27.315763 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1364/2717] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:36:27 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:36:27.333855 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feacc024-da86-415b-8f40-9f524b1913bd None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:27.420157 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feacc024-da86-415b-8f40-9f524b1913bd None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:27.425070 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80eb4d6-9f21-4e2e-b599-b110dfb29fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:27.425640 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80eb4d6-9f21-4e2e-b599-b110dfb29fe7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:27.425920 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80eb4d6-9f21-4e2e-b599-b110dfb29fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:27.426189 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80eb4d6-9f21-4e2e-b599-b110dfb29fe7 admin admin] PATH_INFO: `/v3/users/c6aa5fa4e8284336b98ca73e44415e83` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:27.427333 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80eb4d6-9f21-4e2e-b599-b110dfb29fe7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6aa5fa4e8284336b98ca73e44415e83)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:27.429297 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80eb4d6-9f21-4e2e-b599-b110dfb29fe7 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:27.501397 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-b80eb4d6-9f21-4e2e-b599-b110dfb29fe7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6aa5fa4e8284336b98ca73e44415e83'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:27.510986 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-b80eb4d6-9f21-4e2e-b599-b110dfb29fe7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6aa5fa4e8284336b98ca73e44415e83'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:27.524823 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-b80eb4d6-9f21-4e2e-b599-b110dfb29fe7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6aa5fa4e8284336b98ca73e44415e83'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:27.526287 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-b80eb4d6-9f21-4e2e-b599-b110dfb29fe7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6aa5fa4e8284336b98ca73e44415e83'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:27.543633 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-b80eb4d6-9f21-4e2e-b599-b110dfb29fe7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6aa5fa4e8284336b98ca73e44415e83'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:27.555947 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1354/2718] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:36:27 2022] DELETE /identity/v3/users/c6aa5fa4e8284336b98ca73e44415e83 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:36:27.561104 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cbb52d-e9ba-49a6-a9a0-8e2257456fb4 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:27.561398 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cbb52d-e9ba-49a6-a9a0-8e2257456fb4 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:27.561677 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cbb52d-e9ba-49a6-a9a0-8e2257456fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:27.596759 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-e8cbb52d-e9ba-49a6-a9a0-8e2257456fb4 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:36:27.598339 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-e8cbb52d-e9ba-49a6-a9a0-8e2257456fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:27.619846 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:36:27.665952 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80eb4d6-9f21-4e2e-b599-b110dfb29fe7 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:27.669973 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-b80eb4d6-9f21-4e2e-b599-b110dfb29fe7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:27.691014 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:36:27.707817 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1365/2719] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:36:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 03:36:27.718018 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cbb52d-e9ba-49a6-a9a0-8e2257456fb4 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:27.719684 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-e8cbb52d-e9ba-49a6-a9a0-8e2257456fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:27.785554 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80eb4d6-9f21-4e2e-b599-b110dfb29fe7 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:27.790993 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3461cee-090d-40e9-8803-ed9b3a8e5208 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f537aabf3d1040ff840b02616f839975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:27.791852 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3461cee-090d-40e9-8803-ed9b3a8e5208 service cinder] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:27.792757 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3461cee-090d-40e9-8803-ed9b3a8e5208 service cinder] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:27.793039 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3461cee-090d-40e9-8803-ed9b3a8e5208 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:27.795567 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-a3461cee-090d-40e9-8803-ed9b3a8e5208 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:27.879034 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cbb52d-e9ba-49a6-a9a0-8e2257456fb4 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:27.888793 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d013cf-4fc5-45a8-ba89-115d012c0de1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:27.889429 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d013cf-4fc5-45a8-ba89-115d012c0de1 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:27.889713 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d013cf-4fc5-45a8-ba89-115d012c0de1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:27.889992 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d013cf-4fc5-45a8-ba89-115d012c0de1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:27.911689 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d013cf-4fc5-45a8-ba89-115d012c0de1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:27.912428 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3461cee-090d-40e9-8803-ed9b3a8e5208 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:27.913251 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d013cf-4fc5-45a8-ba89-115d012c0de1 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:27.926563 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3461cee-090d-40e9-8803-ed9b3a8e5208 service cinder] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:27.927314 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1366/2720] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:36:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 03:36:27.947381 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1355/2721] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:36:27 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:36:28.496995 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d013cf-4fc5-45a8-ba89-115d012c0de1 service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:28.498999 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-d7d013cf-4fc5-45a8-ba89-115d012c0de1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:28.518467 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d013cf-4fc5-45a8-ba89-115d012c0de1 service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:28.526321 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ac612e-7ee6-43ff-9e75-e93e7bb5dd43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:28.528554 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac612e-7ee6-43ff-9e75-e93e7bb5dd43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:28.529254 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac612e-7ee6-43ff-9e75-e93e7bb5dd43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:28.529765 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac612e-7ee6-43ff-9e75-e93e7bb5dd43 admin admin] PATH_INFO: `/v3/projects/09fcd233301f4c7a91639bbdb8f678b1` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:28.552519 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ac612e-7ee6-43ff-9e75-e93e7bb5dd43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09fcd233301f4c7a91639bbdb8f678b1)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:28.556077 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ac612e-7ee6-43ff-9e75-e93e7bb5dd43 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:28.643346 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-86ac612e-7ee6-43ff-9e75-e93e7bb5dd43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09fcd233301f4c7a91639bbdb8f678b1', 'request_id': 'req-86ac612e-7ee6-43ff-9e75-e93e7bb5dd43'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:28.649954 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-86ac612e-7ee6-43ff-9e75-e93e7bb5dd43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09fcd233301f4c7a91639bbdb8f678b1', 'request_id': 'req-86ac612e-7ee6-43ff-9e75-e93e7bb5dd43'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:28.660076 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-86ac612e-7ee6-43ff-9e75-e93e7bb5dd43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09fcd233301f4c7a91639bbdb8f678b1', 'request_id': 'req-86ac612e-7ee6-43ff-9e75-e93e7bb5dd43'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:28.680598 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-86ac612e-7ee6-43ff-9e75-e93e7bb5dd43 admin admin] The token cache is being invalidate because project 09fcd233301f4c7a91639bbdb8f678b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:36:28.680988 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-86ac612e-7ee6-43ff-9e75-e93e7bb5dd43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:28.681695 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-86ac612e-7ee6-43ff-9e75-e93e7bb5dd43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:28.684514 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1367/2722] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:36:28 2022] DELETE /identity/v3/projects/09fcd233301f4c7a91639bbdb8f678b1 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:36:28.690463 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b22b64-c57e-48e8-85d3-0ed740abb175 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:28.690974 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b22b64-c57e-48e8-85d3-0ed740abb175 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:28.691126 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b22b64-c57e-48e8-85d3-0ed740abb175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:28.715784 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-31b22b64-c57e-48e8-85d3-0ed740abb175 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:36:28.717209 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-31b22b64-c57e-48e8-85d3-0ed740abb175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:28.790123 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1356/2723] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:36:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:36:28.802164 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9464ad-6809-4dd0-8d97-6ddb357536b2 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:28.802458 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9464ad-6809-4dd0-8d97-6ddb357536b2 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:28.802736 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9464ad-6809-4dd0-8d97-6ddb357536b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:28.828239 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-df9464ad-6809-4dd0-8d97-6ddb357536b2 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:36:28.829452 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-df9464ad-6809-4dd0-8d97-6ddb357536b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:28.843620 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1368/2724] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:36:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:36:28.844718 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b22b64-c57e-48e8-85d3-0ed740abb175 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:28.856261 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b22b64-c57e-48e8-85d3-0ed740abb175 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:28.861106 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46cba4d-3166-435c-8016-14cc93650c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:28.861778 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46cba4d-3166-435c-8016-14cc93650c7a admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:28.862130 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46cba4d-3166-435c-8016-14cc93650c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:28.862473 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46cba4d-3166-435c-8016-14cc93650c7a admin admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:28.863187 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46cba4d-3166-435c-8016-14cc93650c7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:36:28.863590 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46cba4d-3166-435c-8016-14cc93650c7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:28.865241 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46cba4d-3166-435c-8016-14cc93650c7a admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:28.884043 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1357/2725] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 03:36:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:36:28.885720 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9464ad-6809-4dd0-8d97-6ddb357536b2 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:28.902131 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9464ad-6809-4dd0-8d97-6ddb357536b2 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:28.906970 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb20982-11cd-41c8-a3d5-8f41061ddee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:28.907756 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb20982-11cd-41c8-a3d5-8f41061ddee2 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:28.908039 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb20982-11cd-41c8-a3d5-8f41061ddee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:28.908315 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb20982-11cd-41c8-a3d5-8f41061ddee2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:28.908941 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb20982-11cd-41c8-a3d5-8f41061ddee2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:28.910811 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb20982-11cd-41c8-a3d5-8f41061ddee2 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:28.943668 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1369/2726] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:36:28 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:36:28.945176 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46cba4d-3166-435c-8016-14cc93650c7a admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:28.956738 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46cba4d-3166-435c-8016-14cc93650c7a admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:29.020455 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:36:29.032390 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fbec8f-101b-406f-b335-c18c09243ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:29.033270 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fbec8f-101b-406f-b335-c18c09243ef3 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:29.033803 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fbec8f-101b-406f-b335-c18c09243ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:29.034170 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fbec8f-101b-406f-b335-c18c09243ef3 admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:29.034815 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fbec8f-101b-406f-b335-c18c09243ef3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:29.036831 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fbec8f-101b-406f-b335-c18c09243ef3 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:29.077280 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1358/2727] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:36:28 2022] POST /identity/v3/users => generated 293 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:36:29.081395 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb20982-11cd-41c8-a3d5-8f41061ddee2 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:29.094949 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb20982-11cd-41c8-a3d5-8f41061ddee2 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:29.100372 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a042474-359a-40bc-8621-ce4f0b6ef0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:29.101698 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a042474-359a-40bc-8621-ce4f0b6ef0de admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:29.102446 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a042474-359a-40bc-8621-ce4f0b6ef0de admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:29.102968 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a042474-359a-40bc-8621-ce4f0b6ef0de admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:29.104448 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a042474-359a-40bc-8621-ce4f0b6ef0de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:29.107051 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a042474-359a-40bc-8621-ce4f0b6ef0de admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:29.121585 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1370/2728] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:36:29 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 03:36:29.127808 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fbec8f-101b-406f-b335-c18c09243ef3 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:29.143012 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fbec8f-101b-406f-b335-c18c09243ef3 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:29.155033 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6906cc-0ca2-4247-aaeb-df0164271a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:29.155688 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6906cc-0ca2-4247-aaeb-df0164271a65 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:29.155976 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6906cc-0ca2-4247-aaeb-df0164271a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:29.156246 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6906cc-0ca2-4247-aaeb-df0164271a65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:29.157121 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6906cc-0ca2-4247-aaeb-df0164271a65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:29.158505 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6906cc-0ca2-4247-aaeb-df0164271a65 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:29.170217 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1359/2729] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:36:29 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:36:29.174466 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a042474-359a-40bc-8621-ce4f0b6ef0de admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:29.181633 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:36:29.190509 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a042474-359a-40bc-8621-ce4f0b6ef0de admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:29.197820 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842c7adb-e54a-4d9f-97a5-42eb8b24f27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:29.200484 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842c7adb-e54a-4d9f-97a5-42eb8b24f27e admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:29.200484 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842c7adb-e54a-4d9f-97a5-42eb8b24f27e admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:29.200722 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842c7adb-e54a-4d9f-97a5-42eb8b24f27e admin admin] PATH_INFO: `/v3/projects/edf38e69d1f1481ba65c8fcb1c005735/users/f65f55c515724c138a2bede5464fce1d/roles/04d0e4575a28440eb4349b4a6565e8b8` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:29.218451 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842c7adb-e54a-4d9f-97a5-42eb8b24f27e admin admin] RBAC: Authorizing `identity:create_grant(project_id=edf38e69d1f1481ba65c8fcb1c005735, user_id=f65f55c515724c138a2bede5464fce1d, role_id=04d0e4575a28440eb4349b4a6565e8b8)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:29.222062 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842c7adb-e54a-4d9f-97a5-42eb8b24f27e admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:29.239581 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1371/2730] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:36:29 2022] PUT /identity/v3/projects/edf38e69d1f1481ba65c8fcb1c005735/users/f65f55c515724c138a2bede5464fce1d/roles/04d0e4575a28440eb4349b4a6565e8b8 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:36:29.250041 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db26b89-f8b9-4c8e-8bbc-3b926d78f29a None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:29.250260 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db26b89-f8b9-4c8e-8bbc-3b926d78f29a None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:29.250545 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db26b89-f8b9-4c8e-8bbc-3b926d78f29a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:29.289867 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-7db26b89-f8b9-4c8e-8bbc-3b926d78f29a None None] MFA Rules not processed for user `f65f55c515724c138a2bede5464fce1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:36:29.291084 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-7db26b89-f8b9-4c8e-8bbc-3b926d78f29a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:29.367734 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1360/2731] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:36:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:36:29.373256 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842c7adb-e54a-4d9f-97a5-42eb8b24f27e admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:29.454753 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842c7adb-e54a-4d9f-97a5-42eb8b24f27e admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:29.459851 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b34fad-7a4d-48c3-950d-fb84c1eb7f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:29.460687 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b34fad-7a4d-48c3-950d-fb84c1eb7f17 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:29.461165 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b34fad-7a4d-48c3-950d-fb84c1eb7f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:29.461626 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b34fad-7a4d-48c3-950d-fb84c1eb7f17 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:29.462440 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b34fad-7a4d-48c3-950d-fb84c1eb7f17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:29.465392 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b34fad-7a4d-48c3-950d-fb84c1eb7f17 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:29.498830 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1372/2732] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:36:29 2022] POST /identity/v3/projects => generated 385 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:36:29.503158 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db26b89-f8b9-4c8e-8bbc-3b926d78f29a None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:29.515235 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db26b89-f8b9-4c8e-8bbc-3b926d78f29a None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:29.579776 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0c9380-6246-41b8-9257-749308335e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:29.580334 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c9380-6246-41b8-9257-749308335e4d admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:29.580905 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c9380-6246-41b8-9257-749308335e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:29.580905 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c9380-6246-41b8-9257-749308335e4d admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:29.581486 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0c9380-6246-41b8-9257-749308335e4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:29.583395 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0c9380-6246-41b8-9257-749308335e4d admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:29.619527 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1361/2733] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:36:29 2022] POST /identity/v3/users => generated 293 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 03:36:29.624662 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b34fad-7a4d-48c3-950d-fb84c1eb7f17 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:29.641805 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b34fad-7a4d-48c3-950d-fb84c1eb7f17 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:29.649798 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ff9c78-48da-4a5c-be6a-8b9dba686ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:29.650484 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff9c78-48da-4a5c-be6a-8b9dba686ed4 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:29.650924 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff9c78-48da-4a5c-be6a-8b9dba686ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:29.651188 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff9c78-48da-4a5c-be6a-8b9dba686ed4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:29.652837 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ff9c78-48da-4a5c-be6a-8b9dba686ed4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:29.654605 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ff9c78-48da-4a5c-be6a-8b9dba686ed4 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:29.668503 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1373/2734] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:36:29 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:36:29.673336 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0c9380-6246-41b8-9257-749308335e4d admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:29.686307 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0c9380-6246-41b8-9257-749308335e4d admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:29.697180 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502b4f7a-e4b4-4a87-b65d-46b201b4d90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:29.697816 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b4f7a-e4b4-4a87-b65d-46b201b4d90f admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:29.698080 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b4f7a-e4b4-4a87-b65d-46b201b4d90f admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:29.698922 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b4f7a-e4b4-4a87-b65d-46b201b4d90f admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:29.699837 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502b4f7a-e4b4-4a87-b65d-46b201b4d90f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:29.701434 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502b4f7a-e4b4-4a87-b65d-46b201b4d90f admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:29.716769 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1362/2735] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:36:29 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:36:29.718242 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ff9c78-48da-4a5c-be6a-8b9dba686ed4 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:29.734052 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ff9c78-48da-4a5c-be6a-8b9dba686ed4 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:29.738733 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3395974d-7652-4a1c-8207-a82c9129a4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:29.739382 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3395974d-7652-4a1c-8207-a82c9129a4db admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:29.739695 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3395974d-7652-4a1c-8207-a82c9129a4db admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:29.739968 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3395974d-7652-4a1c-8207-a82c9129a4db admin admin] PATH_INFO: `/v3/projects/f289d8456bad4f1491135f1bb7828adb/users/d1c644b29cfb4560b91df3977d1bac0e/roles/04d0e4575a28440eb4349b4a6565e8b8` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:29.770238 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3395974d-7652-4a1c-8207-a82c9129a4db admin admin] RBAC: Authorizing `identity:create_grant(project_id=f289d8456bad4f1491135f1bb7828adb, user_id=d1c644b29cfb4560b91df3977d1bac0e, role_id=04d0e4575a28440eb4349b4a6565e8b8)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:29.775629 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3395974d-7652-4a1c-8207-a82c9129a4db admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:29.804983 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1374/2736] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:36:29 2022] PUT /identity/v3/projects/f289d8456bad4f1491135f1bb7828adb/users/d1c644b29cfb4560b91df3977d1bac0e/roles/04d0e4575a28440eb4349b4a6565e8b8 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:36:29.806606 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a2700-c30c-49c9-965a-2fb6cbbd1297 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:29.806895 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a2700-c30c-49c9-965a-2fb6cbbd1297 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:29.807172 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a2700-c30c-49c9-965a-2fb6cbbd1297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:29.875668 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-696a2700-c30c-49c9-965a-2fb6cbbd1297 None None] MFA Rules not processed for user `d1c644b29cfb4560b91df3977d1bac0e`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:36:29.877243 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-696a2700-c30c-49c9-965a-2fb6cbbd1297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:29.913485 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:36:29.989170 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1363/2737] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:36:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 03:36:29.990521 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3395974d-7652-4a1c-8207-a82c9129a4db admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:30.083554 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3395974d-7652-4a1c-8207-a82c9129a4db admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:30.088516 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fe8ccc-cd02-45a5-9d47-7c37b00ea796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:30.089418 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe8ccc-cd02-45a5-9d47-7c37b00ea796 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:30.089934 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe8ccc-cd02-45a5-9d47-7c37b00ea796 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:30.090162 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe8ccc-cd02-45a5-9d47-7c37b00ea796 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:30.091555 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fe8ccc-cd02-45a5-9d47-7c37b00ea796 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:30.092846 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fe8ccc-cd02-45a5-9d47-7c37b00ea796 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:30.128581 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1375/2738] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:36:29 2022] POST /identity/v3/projects => generated 383 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:36:30.132847 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a2700-c30c-49c9-965a-2fb6cbbd1297 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:30.146066 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a2700-c30c-49c9-965a-2fb6cbbd1297 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:30.221079 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26379158-5a67-4371-bcec-00ea87c0d86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:30.221079 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26379158-5a67-4371-bcec-00ea87c0d86b admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:30.221079 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26379158-5a67-4371-bcec-00ea87c0d86b admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:30.221079 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26379158-5a67-4371-bcec-00ea87c0d86b admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:30.221609 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26379158-5a67-4371-bcec-00ea87c0d86b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:30.222569 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26379158-5a67-4371-bcec-00ea87c0d86b admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:30.277506 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1364/2739] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:36:30 2022] POST /identity/v3/users => generated 298 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 03:36:30.281733 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fe8ccc-cd02-45a5-9d47-7c37b00ea796 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:30.293401 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fe8ccc-cd02-45a5-9d47-7c37b00ea796 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:30.298195 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03273c63-89ae-4dc8-8c25-af0f24389e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:30.298878 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03273c63-89ae-4dc8-8c25-af0f24389e5f admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:30.299261 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03273c63-89ae-4dc8-8c25-af0f24389e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:30.299659 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03273c63-89ae-4dc8-8c25-af0f24389e5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:30.300525 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03273c63-89ae-4dc8-8c25-af0f24389e5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:30.302234 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03273c63-89ae-4dc8-8c25-af0f24389e5f admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:30.318840 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1376/2740] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:36:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:36:30.324250 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26379158-5a67-4371-bcec-00ea87c0d86b admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:30.337010 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26379158-5a67-4371-bcec-00ea87c0d86b admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:30.343059 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea2ee2d-f11d-4b37-a78e-bed7cd5e355f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:30.343758 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea2ee2d-f11d-4b37-a78e-bed7cd5e355f admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:30.344045 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea2ee2d-f11d-4b37-a78e-bed7cd5e355f admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:30.344327 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea2ee2d-f11d-4b37-a78e-bed7cd5e355f admin admin] PATH_INFO: `/v3/projects/f05b86c8b94a4b5d9ac9e6da23b9b98d/users/d1aa5e00c3324333b9ffeaa73df00dba/roles/fe9379cda35c4ff78576fe48b60bea3c` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:30.363727 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea2ee2d-f11d-4b37-a78e-bed7cd5e355f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f05b86c8b94a4b5d9ac9e6da23b9b98d, user_id=d1aa5e00c3324333b9ffeaa73df00dba, role_id=fe9379cda35c4ff78576fe48b60bea3c)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:30.366765 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea2ee2d-f11d-4b37-a78e-bed7cd5e355f admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:30.384497 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1365/2741] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:36:30 2022] PUT /identity/v3/projects/f05b86c8b94a4b5d9ac9e6da23b9b98d/users/d1aa5e00c3324333b9ffeaa73df00dba/roles/fe9379cda35c4ff78576fe48b60bea3c => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:36:30.389185 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03273c63-89ae-4dc8-8c25-af0f24389e5f admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:30.395601 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:36:30.404095 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03273c63-89ae-4dc8-8c25-af0f24389e5f admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:30.481099 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24001b73-284e-42dc-ae6d-ed0e7f74f3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:30.481798 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24001b73-284e-42dc-ae6d-ed0e7f74f3b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:30.482148 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24001b73-284e-42dc-ae6d-ed0e7f74f3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:30.482494 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24001b73-284e-42dc-ae6d-ed0e7f74f3b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:30.483250 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24001b73-284e-42dc-ae6d-ed0e7f74f3b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:30.485098 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24001b73-284e-42dc-ae6d-ed0e7f74f3b2 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:30.499527 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1377/2742] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:36:30 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:36:30.502389 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea2ee2d-f11d-4b37-a78e-bed7cd5e355f admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:30.514838 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea2ee2d-f11d-4b37-a78e-bed7cd5e355f admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:30.519427 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ef689-d297-4615-b8af-df1c0814b751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:30.520297 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ef689-d297-4615-b8af-df1c0814b751 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:30.521562 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ef689-d297-4615-b8af-df1c0814b751 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:30.521562 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ef689-d297-4615-b8af-df1c0814b751 admin admin] PATH_INFO: `/v3/projects/f05b86c8b94a4b5d9ac9e6da23b9b98d/users/d1aa5e00c3324333b9ffeaa73df00dba/roles/fe9379cda35c4ff78576fe48b60bea3c` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:30.523328 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5ef689-d297-4615-b8af-df1c0814b751 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f05b86c8b94a4b5d9ac9e6da23b9b98d, user_id=d1aa5e00c3324333b9ffeaa73df00dba, role_id=fe9379cda35c4ff78576fe48b60bea3c)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:30.525975 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5ef689-d297-4615-b8af-df1c0814b751 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:30.547806 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1366/2743] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:36:30 2022] PUT /identity/v3/projects/f05b86c8b94a4b5d9ac9e6da23b9b98d/users/d1aa5e00c3324333b9ffeaa73df00dba/roles/fe9379cda35c4ff78576fe48b60bea3c => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:36:30.549608 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033b85c-019f-4565-86ed-ef2936dc49e8 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:30.549965 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033b85c-019f-4565-86ed-ef2936dc49e8 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:30.550339 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033b85c-019f-4565-86ed-ef2936dc49e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:30.584955 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-d033b85c-019f-4565-86ed-ef2936dc49e8 None None] MFA Rules not processed for user `d1aa5e00c3324333b9ffeaa73df00dba`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:36:30.586385 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-d033b85c-019f-4565-86ed-ef2936dc49e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:30.664696 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1378/2744] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:36:30 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:36:30.678599 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ef689-d297-4615-b8af-df1c0814b751 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:30.680349 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-ff5ef689-d297-4615-b8af-df1c0814b751 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:30.752556 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ef689-d297-4615-b8af-df1c0814b751 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:30.756274 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd97328-e1ac-46e0-8253-127b0dbea87f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f537aabf3d1040ff840b02616f839975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:30.756877 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd97328-e1ac-46e0-8253-127b0dbea87f service cinder] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:30.757155 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd97328-e1ac-46e0-8253-127b0dbea87f service cinder] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:30.757430 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd97328-e1ac-46e0-8253-127b0dbea87f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:30.800966 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:36:30.832555 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd97328-e1ac-46e0-8253-127b0dbea87f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:30.834253 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd97328-e1ac-46e0-8253-127b0dbea87f service cinder] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:30.844425 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1367/2745] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:36:30 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:36:32.555057 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d033b85c-019f-4565-86ed-ef2936dc49e8 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:32.557219 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-d033b85c-019f-4565-86ed-ef2936dc49e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:32.581096 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d033b85c-019f-4565-86ed-ef2936dc49e8 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:32.585508 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69845901-1f95-4e27-bad3-fe41359a9b0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f537aabf3d1040ff840b02616f839975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:32.586423 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69845901-1f95-4e27-bad3-fe41359a9b0b service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:32.586703 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69845901-1f95-4e27-bad3-fe41359a9b0b service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:32.586977 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69845901-1f95-4e27-bad3-fe41359a9b0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:32.672519 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69845901-1f95-4e27-bad3-fe41359a9b0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:32.673939 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69845901-1f95-4e27-bad3-fe41359a9b0b service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:32.683589 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1379/2746] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:36:32 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:36:33.284295 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd97328-e1ac-46e0-8253-127b0dbea87f service cinder] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:33.293522 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd97328-e1ac-46e0-8253-127b0dbea87f service cinder] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:33.297616 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9c718d-0964-42d3-856f-0c61479898ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f537aabf3d1040ff840b02616f839975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:33.298218 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c718d-0964-42d3-856f-0c61479898ce service cinder] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:33.298503 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c718d-0964-42d3-856f-0c61479898ce service cinder] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:33.298776 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c718d-0964-42d3-856f-0c61479898ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:33.311300 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9c718d-0964-42d3-856f-0c61479898ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:33.312754 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9c718d-0964-42d3-856f-0c61479898ce service cinder] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:33.325606 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1368/2747] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:36:33 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:36:33.845899 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907bd213-3877-46a2-b1b8-7d4773cd07b5 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:33.846431 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907bd213-3877-46a2-b1b8-7d4773cd07b5 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:33.846431 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907bd213-3877-46a2-b1b8-7d4773cd07b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:33.866359 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-907bd213-3877-46a2-b1b8-7d4773cd07b5 None None] MFA Rules not processed for user `926111af89d943a597ec28264b1ef026`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:36:33.867586 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-907bd213-3877-46a2-b1b8-7d4773cd07b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:33.884495 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:36:33.924871 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1380/2748] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:36:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:36:34.188784 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9c718d-0964-42d3-856f-0c61479898ce service cinder] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:34.190146 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-de9c718d-0964-42d3-856f-0c61479898ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:34.248205 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9c718d-0964-42d3-856f-0c61479898ce service cinder] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:34.251851 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bc988f-433b-4f3f-a9dd-bc857d33ca0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:34.252453 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc988f-433b-4f3f-a9dd-bc857d33ca0f service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:34.252736 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc988f-433b-4f3f-a9dd-bc857d33ca0f service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:34.253015 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc988f-433b-4f3f-a9dd-bc857d33ca0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:34.254848 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-b3bc988f-433b-4f3f-a9dd-bc857d33ca0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:34.265115 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bc988f-433b-4f3f-a9dd-bc857d33ca0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:34.266525 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bc988f-433b-4f3f-a9dd-bc857d33ca0f service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:34.274436 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1369/2749] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:36:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:36:35.905311 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147235b3-b075-4e54-b004-99030c4a6b23 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:35.905845 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147235b3-b075-4e54-b004-99030c4a6b23 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:35.906052 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147235b3-b075-4e54-b004-99030c4a6b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:35.930924 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-147235b3-b075-4e54-b004-99030c4a6b23 None None] MFA Rules not processed for user `bef61ef12079495ba72b7fcd2717aca2`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:36:35.932615 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-147235b3-b075-4e54-b004-99030c4a6b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:36.001654 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1381/2750] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Oct 4 03:36:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:36:36.020373 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bc988f-433b-4f3f-a9dd-bc857d33ca0f service neutron] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:36.022402 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-b3bc988f-433b-4f3f-a9dd-bc857d33ca0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:36.154517 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bc988f-433b-4f3f-a9dd-bc857d33ca0f service neutron] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:36.162369 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1da11a-5df4-4fde-93f1-2829643e9094 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8da6bacc8f432e8f48bb99c7aede11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:36.163886 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1da11a-5df4-4fde-93f1-2829643e9094 service swift] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:36.164335 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1da11a-5df4-4fde-93f1-2829643e9094 service swift] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:36.164856 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1da11a-5df4-4fde-93f1-2829643e9094 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:36.179705 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1da11a-5df4-4fde-93f1-2829643e9094 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:36.181793 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1da11a-5df4-4fde-93f1-2829643e9094 service swift] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:36.216738 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1370/2751] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Oct 4 03:36:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 03:36:37.445575 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147235b3-b075-4e54-b004-99030c4a6b23 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:37.576134 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147235b3-b075-4e54-b004-99030c4a6b23 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:37.582141 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85237898-7044-417d-972b-c83417783c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:37.583128 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85237898-7044-417d-972b-c83417783c40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:37.583406 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85237898-7044-417d-972b-c83417783c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:37.583750 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85237898-7044-417d-972b-c83417783c40 admin admin] PATH_INFO: `/v3/users/f65f55c515724c138a2bede5464fce1d` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:37.585343 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85237898-7044-417d-972b-c83417783c40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f65f55c515724c138a2bede5464fce1d)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:37.587600 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85237898-7044-417d-972b-c83417783c40 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:37.676602 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-85237898-7044-417d-972b-c83417783c40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f65f55c515724c138a2bede5464fce1d'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:37.677832 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-85237898-7044-417d-972b-c83417783c40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f65f55c515724c138a2bede5464fce1d'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:37.692416 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-85237898-7044-417d-972b-c83417783c40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f65f55c515724c138a2bede5464fce1d'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:37.693454 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-85237898-7044-417d-972b-c83417783c40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f65f55c515724c138a2bede5464fce1d'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:37.712871 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-85237898-7044-417d-972b-c83417783c40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f65f55c515724c138a2bede5464fce1d'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:37.728519 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:36:37.754804 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1382/2752] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:36:37 2022] DELETE /identity/v3/users/f65f55c515724c138a2bede5464fce1d => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:36:37.754944 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e746e-53cb-4801-9cfc-9c9b5046dfdf None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:37.755371 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e746e-53cb-4801-9cfc-9c9b5046dfdf None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:37.755529 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e746e-53cb-4801-9cfc-9c9b5046dfdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:37.784341 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-058e746e-53cb-4801-9cfc-9c9b5046dfdf None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:36:37.785471 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-058e746e-53cb-4801-9cfc-9c9b5046dfdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:37.850005 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=100 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:36:37.865426 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1371/2753] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:36:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:36:37.877485 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85237898-7044-417d-972b-c83417783c40 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:37.879161 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-85237898-7044-417d-972b-c83417783c40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:37.954502 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85237898-7044-417d-972b-c83417783c40 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:37.963444 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71ec8f2-1d61-44d7-93cd-f5d5207b859f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:37.965088 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ec8f2-1d61-44d7-93cd-f5d5207b859f service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:37.965377 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ec8f2-1d61-44d7-93cd-f5d5207b859f service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:37.965653 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ec8f2-1d61-44d7-93cd-f5d5207b859f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:37.976064 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71ec8f2-1d61-44d7-93cd-f5d5207b859f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:37.977548 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71ec8f2-1d61-44d7-93cd-f5d5207b859f service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:37.990279 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1383/2754] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:36:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 03:36:38.361545 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058e746e-53cb-4801-9cfc-9c9b5046dfdf None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:38.364009 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-058e746e-53cb-4801-9cfc-9c9b5046dfdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:38.385994 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058e746e-53cb-4801-9cfc-9c9b5046dfdf None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:38.395551 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf49396-b109-4f11-9074-2f16909a8465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:38.396443 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf49396-b109-4f11-9074-2f16909a8465 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:38.396443 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf49396-b109-4f11-9074-2f16909a8465 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:38.396624 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf49396-b109-4f11-9074-2f16909a8465 admin admin] PATH_INFO: `/v3/projects/edf38e69d1f1481ba65c8fcb1c005735` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:38.404171 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf49396-b109-4f11-9074-2f16909a8465 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edf38e69d1f1481ba65c8fcb1c005735)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:38.409769 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf49396-b109-4f11-9074-2f16909a8465 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:38.471639 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-bbf49396-b109-4f11-9074-2f16909a8465 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edf38e69d1f1481ba65c8fcb1c005735', 'request_id': 'req-bbf49396-b109-4f11-9074-2f16909a8465'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:38.478187 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-bbf49396-b109-4f11-9074-2f16909a8465 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edf38e69d1f1481ba65c8fcb1c005735', 'request_id': 'req-bbf49396-b109-4f11-9074-2f16909a8465'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:38.486108 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-bbf49396-b109-4f11-9074-2f16909a8465 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edf38e69d1f1481ba65c8fcb1c005735', 'request_id': 'req-bbf49396-b109-4f11-9074-2f16909a8465'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:38.505590 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-bbf49396-b109-4f11-9074-2f16909a8465 admin admin] The token cache is being invalidate because project edf38e69d1f1481ba65c8fcb1c005735 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:36:38.506186 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-bbf49396-b109-4f11-9074-2f16909a8465 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:38.507155 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-bbf49396-b109-4f11-9074-2f16909a8465 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:38.509072 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1372/2755] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:36:38 2022] DELETE /identity/v3/projects/edf38e69d1f1481ba65c8fcb1c005735 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:36:38.513427 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71ec8f2-1d61-44d7-93cd-f5d5207b859f service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:38.524651 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71ec8f2-1d61-44d7-93cd-f5d5207b859f service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:38.599138 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d4c4e-db8c-42b5-8d70-91e878873af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:38.599807 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d4c4e-db8c-42b5-8d70-91e878873af3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:38.600090 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d4c4e-db8c-42b5-8d70-91e878873af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:38.600367 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d4c4e-db8c-42b5-8d70-91e878873af3 admin admin] PATH_INFO: `/v3/users/d1c644b29cfb4560b91df3977d1bac0e` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:38.601514 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1d4c4e-db8c-42b5-8d70-91e878873af3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1c644b29cfb4560b91df3977d1bac0e)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:38.603462 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1d4c4e-db8c-42b5-8d70-91e878873af3 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:38.669738 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-cf1d4c4e-db8c-42b5-8d70-91e878873af3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1c644b29cfb4560b91df3977d1bac0e'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:38.670506 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-cf1d4c4e-db8c-42b5-8d70-91e878873af3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1c644b29cfb4560b91df3977d1bac0e'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:38.679365 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-cf1d4c4e-db8c-42b5-8d70-91e878873af3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1c644b29cfb4560b91df3977d1bac0e'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:38.680047 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-cf1d4c4e-db8c-42b5-8d70-91e878873af3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1c644b29cfb4560b91df3977d1bac0e'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:38.693531 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-cf1d4c4e-db8c-42b5-8d70-91e878873af3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1c644b29cfb4560b91df3977d1bac0e'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:38.706748 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1384/2756] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:36:38 2022] DELETE /identity/v3/users/d1c644b29cfb4560b91df3977d1bac0e => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:36:39.079313 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf49396-b109-4f11-9074-2f16909a8465 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:39.080912 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-bbf49396-b109-4f11-9074-2f16909a8465 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:39.102787 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf49396-b109-4f11-9074-2f16909a8465 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:39.220020 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6ffc34-cff0-42bf-9fc4-4084edaebeab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:39.220798 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6ffc34-cff0-42bf-9fc4-4084edaebeab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:39.221149 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6ffc34-cff0-42bf-9fc4-4084edaebeab admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:39.221492 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6ffc34-cff0-42bf-9fc4-4084edaebeab admin admin] PATH_INFO: `/v3/projects/f289d8456bad4f1491135f1bb7828adb` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:39.222853 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6ffc34-cff0-42bf-9fc4-4084edaebeab admin admin] RBAC: Authorizing `identity:delete_project(project_id=f289d8456bad4f1491135f1bb7828adb)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:39.225377 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6ffc34-cff0-42bf-9fc4-4084edaebeab admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:39.321246 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-5e6ffc34-cff0-42bf-9fc4-4084edaebeab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f289d8456bad4f1491135f1bb7828adb', 'request_id': 'req-5e6ffc34-cff0-42bf-9fc4-4084edaebeab'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:39.328157 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-5e6ffc34-cff0-42bf-9fc4-4084edaebeab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f289d8456bad4f1491135f1bb7828adb', 'request_id': 'req-5e6ffc34-cff0-42bf-9fc4-4084edaebeab'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:39.336147 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-5e6ffc34-cff0-42bf-9fc4-4084edaebeab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f289d8456bad4f1491135f1bb7828adb', 'request_id': 'req-5e6ffc34-cff0-42bf-9fc4-4084edaebeab'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:39.364534 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-5e6ffc34-cff0-42bf-9fc4-4084edaebeab admin admin] The token cache is being invalidate because project f289d8456bad4f1491135f1bb7828adb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:36:39.364926 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-5e6ffc34-cff0-42bf-9fc4-4084edaebeab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:39.366586 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-5e6ffc34-cff0-42bf-9fc4-4084edaebeab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:39.368937 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1373/2757] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:36:39 2022] DELETE /identity/v3/projects/f289d8456bad4f1491135f1bb7828adb => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:36:39.373541 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d4c4e-db8c-42b5-8d70-91e878873af3 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:39.378179 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-cf1d4c4e-db8c-42b5-8d70-91e878873af3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:39.400940 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d4c4e-db8c-42b5-8d70-91e878873af3 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:39.429451 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:36:39.523439 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dcf2d1-5d06-47f3-b8b7-40f800e3d80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:39.525687 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dcf2d1-5d06-47f3-b8b7-40f800e3d80c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:39.526201 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dcf2d1-5d06-47f3-b8b7-40f800e3d80c admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:39.526651 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dcf2d1-5d06-47f3-b8b7-40f800e3d80c admin admin] PATH_INFO: `/v3/users/d1aa5e00c3324333b9ffeaa73df00dba` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:39.528037 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dcf2d1-5d06-47f3-b8b7-40f800e3d80c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1aa5e00c3324333b9ffeaa73df00dba)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:39.531274 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dcf2d1-5d06-47f3-b8b7-40f800e3d80c admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:39.600277 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-f9dcf2d1-5d06-47f3-b8b7-40f800e3d80c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1aa5e00c3324333b9ffeaa73df00dba'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:39.601230 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-f9dcf2d1-5d06-47f3-b8b7-40f800e3d80c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1aa5e00c3324333b9ffeaa73df00dba'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:39.612304 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-f9dcf2d1-5d06-47f3-b8b7-40f800e3d80c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1aa5e00c3324333b9ffeaa73df00dba'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:39.613063 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-f9dcf2d1-5d06-47f3-b8b7-40f800e3d80c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1aa5e00c3324333b9ffeaa73df00dba'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:39.646047 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-f9dcf2d1-5d06-47f3-b8b7-40f800e3d80c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1aa5e00c3324333b9ffeaa73df00dba'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:39.671085 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1385/2758] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:36:39 2022] DELETE /identity/v3/users/d1aa5e00c3324333b9ffeaa73df00dba => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:36:40.006417 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6ffc34-cff0-42bf-9fc4-4084edaebeab admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:40.008034 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-5e6ffc34-cff0-42bf-9fc4-4084edaebeab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:40.023377 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6ffc34-cff0-42bf-9fc4-4084edaebeab admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:40.029537 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:36:40.103818 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61371b04-4c5e-478c-932c-07a576fef100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:40.105299 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61371b04-4c5e-478c-932c-07a576fef100 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:40.105420 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61371b04-4c5e-478c-932c-07a576fef100 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:40.105828 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61371b04-4c5e-478c-932c-07a576fef100 admin admin] PATH_INFO: `/v3/projects/f05b86c8b94a4b5d9ac9e6da23b9b98d` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:40.108723 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61371b04-4c5e-478c-932c-07a576fef100 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f05b86c8b94a4b5d9ac9e6da23b9b98d)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:40.110643 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61371b04-4c5e-478c-932c-07a576fef100 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:40.163131 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-61371b04-4c5e-478c-932c-07a576fef100 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f05b86c8b94a4b5d9ac9e6da23b9b98d', 'request_id': 'req-61371b04-4c5e-478c-932c-07a576fef100'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:40.169340 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-61371b04-4c5e-478c-932c-07a576fef100 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f05b86c8b94a4b5d9ac9e6da23b9b98d', 'request_id': 'req-61371b04-4c5e-478c-932c-07a576fef100'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:40.176370 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-61371b04-4c5e-478c-932c-07a576fef100 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f05b86c8b94a4b5d9ac9e6da23b9b98d', 'request_id': 'req-61371b04-4c5e-478c-932c-07a576fef100'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:40.195227 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-61371b04-4c5e-478c-932c-07a576fef100 admin admin] The token cache is being invalidate because project f05b86c8b94a4b5d9ac9e6da23b9b98d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:36:40.195510 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-61371b04-4c5e-478c-932c-07a576fef100 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:40.196159 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-61371b04-4c5e-478c-932c-07a576fef100 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:40.197733 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1374/2759] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:36:40 2022] DELETE /identity/v3/projects/f05b86c8b94a4b5d9ac9e6da23b9b98d => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 03:36:41.774590 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dcf2d1-5d06-47f3-b8b7-40f800e3d80c admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:41.776043 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-f9dcf2d1-5d06-47f3-b8b7-40f800e3d80c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:41.790063 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dcf2d1-5d06-47f3-b8b7-40f800e3d80c admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:41.857848 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47503e5e-f75a-4dc1-968e-51a8540f808a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:41.858483 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47503e5e-f75a-4dc1-968e-51a8540f808a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:41.858769 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47503e5e-f75a-4dc1-968e-51a8540f808a admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:41.859046 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47503e5e-f75a-4dc1-968e-51a8540f808a admin admin] PATH_INFO: `/v3/users/29e7285a0dea417da03ad999cee106ca` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:41.860314 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47503e5e-f75a-4dc1-968e-51a8540f808a admin admin] RBAC: Authorizing `identity:delete_user(user_id=29e7285a0dea417da03ad999cee106ca)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:41.862276 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47503e5e-f75a-4dc1-968e-51a8540f808a admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:41.911533 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:36:41.928495 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-47503e5e-f75a-4dc1-968e-51a8540f808a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29e7285a0dea417da03ad999cee106ca'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:41.929309 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-47503e5e-f75a-4dc1-968e-51a8540f808a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29e7285a0dea417da03ad999cee106ca'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:41.967342 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-47503e5e-f75a-4dc1-968e-51a8540f808a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29e7285a0dea417da03ad999cee106ca'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:41.968594 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-47503e5e-f75a-4dc1-968e-51a8540f808a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29e7285a0dea417da03ad999cee106ca'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:41.999986 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-47503e5e-f75a-4dc1-968e-51a8540f808a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29e7285a0dea417da03ad999cee106ca'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:42.023179 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1386/2760] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:36:41 2022] DELETE /identity/v3/users/29e7285a0dea417da03ad999cee106ca => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:36:42.024983 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ef2b6-ab5f-4ed0-98fd-2f690d13e019 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:42.025478 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ef2b6-ab5f-4ed0-98fd-2f690d13e019 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:42.025585 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ef2b6-ab5f-4ed0-98fd-2f690d13e019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:42.065140 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-c00ef2b6-ab5f-4ed0-98fd-2f690d13e019 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:36:42.066182 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-c00ef2b6-ab5f-4ed0-98fd-2f690d13e019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:42.152105 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1375/2761] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:36:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:36:42.160025 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47503e5e-f75a-4dc1-968e-51a8540f808a admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:42.161515 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-47503e5e-f75a-4dc1-968e-51a8540f808a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:42.238138 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47503e5e-f75a-4dc1-968e-51a8540f808a admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:42.241928 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ded5c-fdc9-49d5-a18c-9c748f05b21e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:42.242625 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ded5c-fdc9-49d5-a18c-9c748f05b21e service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:42.242967 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ded5c-fdc9-49d5-a18c-9c748f05b21e service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:42.243301 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ded5c-fdc9-49d5-a18c-9c748f05b21e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:42.253692 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72ded5c-fdc9-49d5-a18c-9c748f05b21e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:42.255187 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72ded5c-fdc9-49d5-a18c-9c748f05b21e service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:42.267572 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1387/2762] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:36:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:36:42.574125 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ef2b6-ab5f-4ed0-98fd-2f690d13e019 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:42.575999 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-c00ef2b6-ab5f-4ed0-98fd-2f690d13e019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:42.590073 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ef2b6-ab5f-4ed0-98fd-2f690d13e019 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:42.603994 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a82511-753c-49c5-8ec8-8fc11f183456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:42.605784 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a82511-753c-49c5-8ec8-8fc11f183456 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:42.606204 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a82511-753c-49c5-8ec8-8fc11f183456 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:42.606650 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a82511-753c-49c5-8ec8-8fc11f183456 admin admin] PATH_INFO: `/v3/projects/ffeec483916b4d378521c1552404e212` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:42.608951 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a82511-753c-49c5-8ec8-8fc11f183456 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffeec483916b4d378521c1552404e212)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:42.611687 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a82511-753c-49c5-8ec8-8fc11f183456 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:42.664527 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:36:42.685899 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-90a82511-753c-49c5-8ec8-8fc11f183456 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffeec483916b4d378521c1552404e212', 'request_id': 'req-90a82511-753c-49c5-8ec8-8fc11f183456'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:42.692537 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-90a82511-753c-49c5-8ec8-8fc11f183456 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffeec483916b4d378521c1552404e212', 'request_id': 'req-90a82511-753c-49c5-8ec8-8fc11f183456'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:42.700817 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-90a82511-753c-49c5-8ec8-8fc11f183456 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffeec483916b4d378521c1552404e212', 'request_id': 'req-90a82511-753c-49c5-8ec8-8fc11f183456'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:42.720634 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-90a82511-753c-49c5-8ec8-8fc11f183456 admin admin] The token cache is being invalidate because project ffeec483916b4d378521c1552404e212 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:36:42.720929 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-90a82511-753c-49c5-8ec8-8fc11f183456 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:42.721579 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-90a82511-753c-49c5-8ec8-8fc11f183456 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:42.723253 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1376/2763] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:36:42 2022] DELETE /identity/v3/projects/ffeec483916b4d378521c1552404e212 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:36:42.728034 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ded5c-fdc9-49d5-a18c-9c748f05b21e service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:42.738338 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ded5c-fdc9-49d5-a18c-9c748f05b21e service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:42.807119 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee498cf0-3e93-41fe-b336-91ee0af14d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:42.809207 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee498cf0-3e93-41fe-b336-91ee0af14d11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:42.809207 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee498cf0-3e93-41fe-b336-91ee0af14d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:42.809431 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee498cf0-3e93-41fe-b336-91ee0af14d11 admin admin] PATH_INFO: `/v3/users/b43b16ad2b20463bbf6d29f32af413f3` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:42.810715 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee498cf0-3e93-41fe-b336-91ee0af14d11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b43b16ad2b20463bbf6d29f32af413f3)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:42.812718 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee498cf0-3e93-41fe-b336-91ee0af14d11 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:42.871006 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-ee498cf0-3e93-41fe-b336-91ee0af14d11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b43b16ad2b20463bbf6d29f32af413f3'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:42.880057 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-ee498cf0-3e93-41fe-b336-91ee0af14d11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b43b16ad2b20463bbf6d29f32af413f3'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:42.893046 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-ee498cf0-3e93-41fe-b336-91ee0af14d11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b43b16ad2b20463bbf6d29f32af413f3'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:42.893693 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-ee498cf0-3e93-41fe-b336-91ee0af14d11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b43b16ad2b20463bbf6d29f32af413f3'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:42.895934 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:36:42.910307 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-ee498cf0-3e93-41fe-b336-91ee0af14d11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b43b16ad2b20463bbf6d29f32af413f3'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:42.924071 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1388/2764] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:36:42 2022] DELETE /identity/v3/users/b43b16ad2b20463bbf6d29f32af413f3 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:36:43.237618 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a82511-753c-49c5-8ec8-8fc11f183456 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:43.240319 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-90a82511-753c-49c5-8ec8-8fc11f183456 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:43.263309 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a82511-753c-49c5-8ec8-8fc11f183456 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:43.381583 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec20ae6-91f9-4eb5-9b40-c9080d1c231d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:43.382303 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec20ae6-91f9-4eb5-9b40-c9080d1c231d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:43.382664 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec20ae6-91f9-4eb5-9b40-c9080d1c231d admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:43.382936 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec20ae6-91f9-4eb5-9b40-c9080d1c231d admin admin] PATH_INFO: `/v3/projects/ab2b2c433a294fc28e5438c008e607dc` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:43.384325 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec20ae6-91f9-4eb5-9b40-c9080d1c231d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab2b2c433a294fc28e5438c008e607dc)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:43.387440 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec20ae6-91f9-4eb5-9b40-c9080d1c231d admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:43.454574 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-fec20ae6-91f9-4eb5-9b40-c9080d1c231d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab2b2c433a294fc28e5438c008e607dc', 'request_id': 'req-fec20ae6-91f9-4eb5-9b40-c9080d1c231d'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:43.460573 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-fec20ae6-91f9-4eb5-9b40-c9080d1c231d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab2b2c433a294fc28e5438c008e607dc', 'request_id': 'req-fec20ae6-91f9-4eb5-9b40-c9080d1c231d'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:43.467938 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-fec20ae6-91f9-4eb5-9b40-c9080d1c231d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab2b2c433a294fc28e5438c008e607dc', 'request_id': 'req-fec20ae6-91f9-4eb5-9b40-c9080d1c231d'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:43.483970 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-fec20ae6-91f9-4eb5-9b40-c9080d1c231d admin admin] The token cache is being invalidate because project ab2b2c433a294fc28e5438c008e607dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:36:43.484695 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-fec20ae6-91f9-4eb5-9b40-c9080d1c231d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:43.485882 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-fec20ae6-91f9-4eb5-9b40-c9080d1c231d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:43.487504 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1377/2765] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:36:43 2022] DELETE /identity/v3/projects/ab2b2c433a294fc28e5438c008e607dc => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:36:43.493529 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac5b3e-eb5e-485a-85a3-50835f2f625f None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:43.494025 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac5b3e-eb5e-485a-85a3-50835f2f625f None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:43.494312 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac5b3e-eb5e-485a-85a3-50835f2f625f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:43.518680 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-87ac5b3e-eb5e-485a-85a3-50835f2f625f None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:36:43.519934 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-87ac5b3e-eb5e-485a-85a3-50835f2f625f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:43.591257 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1389/2766] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:36:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:36:43.594948 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db8bbae-659f-463c-9948-eedbcedb4ad4 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:43.595232 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db8bbae-659f-463c-9948-eedbcedb4ad4 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:43.595525 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db8bbae-659f-463c-9948-eedbcedb4ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:43.616472 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-2db8bbae-659f-463c-9948-eedbcedb4ad4 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:36:43.617658 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-2db8bbae-659f-463c-9948-eedbcedb4ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:43.627135 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1378/2767] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:36:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:36:43.631467 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac5b3e-eb5e-485a-85a3-50835f2f625f None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:43.642349 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac5b3e-eb5e-485a-85a3-50835f2f625f None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:43.647065 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e5d25a-f9a7-4094-8f22-5ba9ad47d362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:43.647700 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e5d25a-f9a7-4094-8f22-5ba9ad47d362 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:43.647986 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e5d25a-f9a7-4094-8f22-5ba9ad47d362 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:43.648261 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e5d25a-f9a7-4094-8f22-5ba9ad47d362 admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:43.648909 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e5d25a-f9a7-4094-8f22-5ba9ad47d362 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:36:43.649218 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e5d25a-f9a7-4094-8f22-5ba9ad47d362 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:43.650853 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e5d25a-f9a7-4094-8f22-5ba9ad47d362 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:43.663133 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1390/2768] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 03:36:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:36:43.667710 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db8bbae-659f-463c-9948-eedbcedb4ad4 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:43.677439 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db8bbae-659f-463c-9948-eedbcedb4ad4 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:43.682101 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb41ffbb-d109-410f-84c2-0e2705e6c8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:43.683201 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb41ffbb-d109-410f-84c2-0e2705e6c8b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:43.683472 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb41ffbb-d109-410f-84c2-0e2705e6c8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:43.683784 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb41ffbb-d109-410f-84c2-0e2705e6c8b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:43.684405 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb41ffbb-d109-410f-84c2-0e2705e6c8b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:43.686279 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb41ffbb-d109-410f-84c2-0e2705e6c8b4 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:43.713877 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1379/2769] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:36:43 2022] POST /identity/v3/projects => generated 387 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 03:36:43.717856 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e5d25a-f9a7-4094-8f22-5ba9ad47d362 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:43.727956 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e5d25a-f9a7-4094-8f22-5ba9ad47d362 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:43.785395 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae14123d-5f12-41fa-92b7-a4c96806b71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:43.786027 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae14123d-5f12-41fa-92b7-a4c96806b71e admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:43.786311 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae14123d-5f12-41fa-92b7-a4c96806b71e admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:43.786590 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae14123d-5f12-41fa-92b7-a4c96806b71e admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:43.787231 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae14123d-5f12-41fa-92b7-a4c96806b71e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:43.789171 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae14123d-5f12-41fa-92b7-a4c96806b71e admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:43.811104 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1391/2770] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:36:43 2022] POST /identity/v3/users => generated 294 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:36:43.815178 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb41ffbb-d109-410f-84c2-0e2705e6c8b4 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:43.826413 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb41ffbb-d109-410f-84c2-0e2705e6c8b4 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:43.831088 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90c9882-765e-4609-a9e0-a459e983eaa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:43.831717 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c9882-765e-4609-a9e0-a459e983eaa1 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:43.832001 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c9882-765e-4609-a9e0-a459e983eaa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:43.832277 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c9882-765e-4609-a9e0-a459e983eaa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:43.832921 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90c9882-765e-4609-a9e0-a459e983eaa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:43.834502 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90c9882-765e-4609-a9e0-a459e983eaa1 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:43.845844 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1380/2771] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:36:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:36:43.850042 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae14123d-5f12-41fa-92b7-a4c96806b71e admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:43.860193 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae14123d-5f12-41fa-92b7-a4c96806b71e admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:43.864665 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a423abc-7f2f-4246-bca6-aa703e2dd196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:43.865273 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a423abc-7f2f-4246-bca6-aa703e2dd196 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:43.865552 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a423abc-7f2f-4246-bca6-aa703e2dd196 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:43.865820 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a423abc-7f2f-4246-bca6-aa703e2dd196 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:43.866447 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a423abc-7f2f-4246-bca6-aa703e2dd196 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:43.868051 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a423abc-7f2f-4246-bca6-aa703e2dd196 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:43.878519 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1392/2772] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:36:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:36:43.882716 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90c9882-765e-4609-a9e0-a459e983eaa1 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:43.893299 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90c9882-765e-4609-a9e0-a459e983eaa1 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:43.897891 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e50598-13de-4df9-97c1-d529728e871c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:43.898526 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e50598-13de-4df9-97c1-d529728e871c admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:43.898809 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e50598-13de-4df9-97c1-d529728e871c admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:43.899089 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e50598-13de-4df9-97c1-d529728e871c admin admin] PATH_INFO: `/v3/projects/dcd056e1413542f28fe74fa2520989c9/users/d3b341089036420f94cbaa4cdd4287da/roles/04d0e4575a28440eb4349b4a6565e8b8` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:43.907791 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:36:43.915354 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e50598-13de-4df9-97c1-d529728e871c admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcd056e1413542f28fe74fa2520989c9, user_id=d3b341089036420f94cbaa4cdd4287da, role_id=04d0e4575a28440eb4349b4a6565e8b8)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:43.918829 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e50598-13de-4df9-97c1-d529728e871c admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:43.931846 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1381/2773] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:36:43 2022] PUT /identity/v3/projects/dcd056e1413542f28fe74fa2520989c9/users/d3b341089036420f94cbaa4cdd4287da/roles/04d0e4575a28440eb4349b4a6565e8b8 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:36:43.942463 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ae784-d990-4d1d-9bf9-552f4b7c25b2 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:43.942749 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ae784-d990-4d1d-9bf9-552f4b7c25b2 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:43.943028 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ae784-d990-4d1d-9bf9-552f4b7c25b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:43.971804 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-cf7ae784-d990-4d1d-9bf9-552f4b7c25b2 None None] MFA Rules not processed for user `d3b341089036420f94cbaa4cdd4287da`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:36:43.973007 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-cf7ae784-d990-4d1d-9bf9-552f4b7c25b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:44.008616 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:36:44.055679 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1393/2774] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:36:43 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:36:44.060269 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e50598-13de-4df9-97c1-d529728e871c admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:44.129281 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e50598-13de-4df9-97c1-d529728e871c admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:44.134044 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8cf38a-b5cb-4f1d-b5ed-ea28221e65bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:44.134645 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8cf38a-b5cb-4f1d-b5ed-ea28221e65bd admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:44.134930 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8cf38a-b5cb-4f1d-b5ed-ea28221e65bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:44.135212 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8cf38a-b5cb-4f1d-b5ed-ea28221e65bd admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:44.136389 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8cf38a-b5cb-4f1d-b5ed-ea28221e65bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:44.138294 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8cf38a-b5cb-4f1d-b5ed-ea28221e65bd admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:44.166069 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1382/2775] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:36:44 2022] POST /identity/v3/projects => generated 385 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:36:44.170207 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7ae784-d990-4d1d-9bf9-552f4b7c25b2 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:44.180923 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7ae784-d990-4d1d-9bf9-552f4b7c25b2 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:44.237190 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d142d-27db-4dde-8d1c-f2f396f9a966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:44.237711 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d142d-27db-4dde-8d1c-f2f396f9a966 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:44.237997 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d142d-27db-4dde-8d1c-f2f396f9a966 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:44.238274 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d142d-27db-4dde-8d1c-f2f396f9a966 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:44.238912 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607d142d-27db-4dde-8d1c-f2f396f9a966 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:44.240853 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607d142d-27db-4dde-8d1c-f2f396f9a966 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:44.262691 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1394/2776] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:36:44 2022] POST /identity/v3/users => generated 299 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:36:44.266670 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8cf38a-b5cb-4f1d-b5ed-ea28221e65bd admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:44.277335 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8cf38a-b5cb-4f1d-b5ed-ea28221e65bd admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:44.281928 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8d2c6-58a8-42c2-af77-c0d023b8850e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:44.282524 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8d2c6-58a8-42c2-af77-c0d023b8850e admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:44.282804 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8d2c6-58a8-42c2-af77-c0d023b8850e admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:44.283079 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8d2c6-58a8-42c2-af77-c0d023b8850e admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:44.283748 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d8d2c6-58a8-42c2-af77-c0d023b8850e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:44.285323 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d8d2c6-58a8-42c2-af77-c0d023b8850e admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:44.296062 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1383/2777] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:36:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:36:44.300127 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d142d-27db-4dde-8d1c-f2f396f9a966 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:44.310807 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d142d-27db-4dde-8d1c-f2f396f9a966 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:44.315505 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff96054f-ef5d-4084-bc0c-fbcea62d36be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:44.316157 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96054f-ef5d-4084-bc0c-fbcea62d36be admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:44.316442 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96054f-ef5d-4084-bc0c-fbcea62d36be admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:44.316839 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96054f-ef5d-4084-bc0c-fbcea62d36be admin admin] PATH_INFO: `/v3/projects/07677299ff2b4fc98715b55618b392b1/users/70cee77dbe744d93b99996a50e6666bc/roles/fe9379cda35c4ff78576fe48b60bea3c` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:44.332893 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff96054f-ef5d-4084-bc0c-fbcea62d36be admin admin] RBAC: Authorizing `identity:create_grant(project_id=07677299ff2b4fc98715b55618b392b1, user_id=70cee77dbe744d93b99996a50e6666bc, role_id=fe9379cda35c4ff78576fe48b60bea3c)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:44.335816 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff96054f-ef5d-4084-bc0c-fbcea62d36be admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:44.354763 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1395/2778] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:36:44 2022] PUT /identity/v3/projects/07677299ff2b4fc98715b55618b392b1/users/70cee77dbe744d93b99996a50e6666bc/roles/fe9379cda35c4ff78576fe48b60bea3c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:36:44.355652 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8d2c6-58a8-42c2-af77-c0d023b8850e admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:44.366154 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8d2c6-58a8-42c2-af77-c0d023b8850e admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:44.431267 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c9db1c-d49a-4754-9a84-1d2397eaf3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:44.432038 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c9db1c-d49a-4754-9a84-1d2397eaf3fc admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:44.432898 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c9db1c-d49a-4754-9a84-1d2397eaf3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:44.433702 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c9db1c-d49a-4754-9a84-1d2397eaf3fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:44.433968 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c9db1c-d49a-4754-9a84-1d2397eaf3fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:44.435710 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c9db1c-d49a-4754-9a84-1d2397eaf3fc admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:44.449537 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1384/2779] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:36:44 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 03:36:44.454347 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff96054f-ef5d-4084-bc0c-fbcea62d36be admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:44.466992 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff96054f-ef5d-4084-bc0c-fbcea62d36be admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:44.472291 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40ba436-0338-4d04-b73d-0efa4ac335e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:44.473149 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ba436-0338-4d04-b73d-0efa4ac335e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:44.473495 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ba436-0338-4d04-b73d-0efa4ac335e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:44.473838 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ba436-0338-4d04-b73d-0efa4ac335e3 admin admin] PATH_INFO: `/v3/projects/07677299ff2b4fc98715b55618b392b1/users/70cee77dbe744d93b99996a50e6666bc/roles/fe9379cda35c4ff78576fe48b60bea3c` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:44.476055 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40ba436-0338-4d04-b73d-0efa4ac335e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07677299ff2b4fc98715b55618b392b1, user_id=70cee77dbe744d93b99996a50e6666bc, role_id=fe9379cda35c4ff78576fe48b60bea3c)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:44.478959 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40ba436-0338-4d04-b73d-0efa4ac335e3 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:44.492353 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1396/2780] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:36:44 2022] PUT /identity/v3/projects/07677299ff2b4fc98715b55618b392b1/users/70cee77dbe744d93b99996a50e6666bc/roles/fe9379cda35c4ff78576fe48b60bea3c => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:36:44.504840 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b95aff-bae4-4314-80a3-3061807104b5 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:44.505127 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b95aff-bae4-4314-80a3-3061807104b5 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:44.505405 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b95aff-bae4-4314-80a3-3061807104b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:44.538934 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-49b95aff-bae4-4314-80a3-3061807104b5 None None] MFA Rules not processed for user `70cee77dbe744d93b99996a50e6666bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:36:44.540295 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-49b95aff-bae4-4314-80a3-3061807104b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:44.589685 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:36:44.618686 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1385/2781] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:36:44 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 03:36:44.627273 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40ba436-0338-4d04-b73d-0efa4ac335e3 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:44.629183 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-f40ba436-0338-4d04-b73d-0efa4ac335e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:44.694724 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40ba436-0338-4d04-b73d-0efa4ac335e3 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:44.699108 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98747f4-bd74-4f40-a43c-a81d30d9f764 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f537aabf3d1040ff840b02616f839975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:44.699740 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98747f4-bd74-4f40-a43c-a81d30d9f764 service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:44.700019 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98747f4-bd74-4f40-a43c-a81d30d9f764 service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:44.700293 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98747f4-bd74-4f40-a43c-a81d30d9f764 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:44.709145 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98747f4-bd74-4f40-a43c-a81d30d9f764 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:44.710560 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98747f4-bd74-4f40-a43c-a81d30d9f764 service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:44.720747 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1397/2782] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:36:44 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:36:44.751376 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b95aff-bae4-4314-80a3-3061807104b5 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:44.814351 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b95aff-bae4-4314-80a3-3061807104b5 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:44.819425 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb03d61f-4e62-4649-889f-010376283742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:44.820092 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03d61f-4e62-4649-889f-010376283742 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:44.820363 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03d61f-4e62-4649-889f-010376283742 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:44.820671 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03d61f-4e62-4649-889f-010376283742 admin admin] PATH_INFO: `/v3/users/d3b341089036420f94cbaa4cdd4287da` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:44.821822 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb03d61f-4e62-4649-889f-010376283742 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3b341089036420f94cbaa4cdd4287da)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:44.824458 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb03d61f-4e62-4649-889f-010376283742 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:44.874131 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-bb03d61f-4e62-4649-889f-010376283742 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3b341089036420f94cbaa4cdd4287da'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:44.881333 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-bb03d61f-4e62-4649-889f-010376283742 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3b341089036420f94cbaa4cdd4287da'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:44.891956 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-bb03d61f-4e62-4649-889f-010376283742 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3b341089036420f94cbaa4cdd4287da'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:44.892614 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-bb03d61f-4e62-4649-889f-010376283742 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3b341089036420f94cbaa4cdd4287da'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:44.905656 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-bb03d61f-4e62-4649-889f-010376283742 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3b341089036420f94cbaa4cdd4287da'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:44.911597 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1386/2783] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:36:44 2022] DELETE /identity/v3/users/d3b341089036420f94cbaa4cdd4287da => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:36:44.916176 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b627c-1b13-401a-886b-122b88987451 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:44.917290 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b627c-1b13-401a-886b-122b88987451 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:44.917435 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b627c-1b13-401a-886b-122b88987451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:44.937308 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-4d8b627c-1b13-401a-886b-122b88987451 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:36:44.938613 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-4d8b627c-1b13-401a-886b-122b88987451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:44.959138 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:36:45.004821 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1398/2784] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:36:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 03:36:45.014692 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb03d61f-4e62-4649-889f-010376283742 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:45.016353 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-bb03d61f-4e62-4649-889f-010376283742 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:45.076917 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb03d61f-4e62-4649-889f-010376283742 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:45.080663 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96bb4ec-584d-4cf3-95d2-f4b25fa98d17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:45.081320 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96bb4ec-584d-4cf3-95d2-f4b25fa98d17 service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:45.081606 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96bb4ec-584d-4cf3-95d2-f4b25fa98d17 service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:45.082033 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96bb4ec-584d-4cf3-95d2-f4b25fa98d17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:45.092828 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96bb4ec-584d-4cf3-95d2-f4b25fa98d17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:45.094291 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96bb4ec-584d-4cf3-95d2-f4b25fa98d17 service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:45.104688 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1387/2785] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:36:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:36:45.367855 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8b627c-1b13-401a-886b-122b88987451 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:45.369298 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-4d8b627c-1b13-401a-886b-122b88987451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:45.381512 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8b627c-1b13-401a-886b-122b88987451 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:45.386789 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc54e4-e273-4481-9540-89b065a94e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:45.387411 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc54e4-e273-4481-9540-89b065a94e14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:45.387850 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc54e4-e273-4481-9540-89b065a94e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:45.388058 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc54e4-e273-4481-9540-89b065a94e14 admin admin] PATH_INFO: `/v3/projects/dcd056e1413542f28fe74fa2520989c9` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:45.389239 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bc54e4-e273-4481-9540-89b065a94e14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcd056e1413542f28fe74fa2520989c9)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:45.391606 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bc54e4-e273-4481-9540-89b065a94e14 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:45.438874 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-60bc54e4-e273-4481-9540-89b065a94e14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcd056e1413542f28fe74fa2520989c9', 'request_id': 'req-60bc54e4-e273-4481-9540-89b065a94e14'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:45.444456 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-60bc54e4-e273-4481-9540-89b065a94e14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcd056e1413542f28fe74fa2520989c9', 'request_id': 'req-60bc54e4-e273-4481-9540-89b065a94e14'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:45.451255 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-60bc54e4-e273-4481-9540-89b065a94e14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcd056e1413542f28fe74fa2520989c9', 'request_id': 'req-60bc54e4-e273-4481-9540-89b065a94e14'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:45.463198 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-60bc54e4-e273-4481-9540-89b065a94e14 admin admin] The token cache is being invalidate because project dcd056e1413542f28fe74fa2520989c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:36:45.464147 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-60bc54e4-e273-4481-9540-89b065a94e14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:45.464858 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-60bc54e4-e273-4481-9540-89b065a94e14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:45.466323 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1399/2786] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:36:45 2022] DELETE /identity/v3/projects/dcd056e1413542f28fe74fa2520989c9 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:36:45.470266 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96bb4ec-584d-4cf3-95d2-f4b25fa98d17 service neutron] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:45.476248 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:36:45.480899 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96bb4ec-584d-4cf3-95d2-f4b25fa98d17 service neutron] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:45.540988 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b65d00-b41b-4bb9-895a-e778f86bf06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:45.541520 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b65d00-b41b-4bb9-895a-e778f86bf06e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:45.541805 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b65d00-b41b-4bb9-895a-e778f86bf06e admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:45.542084 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b65d00-b41b-4bb9-895a-e778f86bf06e admin admin] PATH_INFO: `/v3/users/70cee77dbe744d93b99996a50e6666bc` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:45.543194 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b65d00-b41b-4bb9-895a-e778f86bf06e admin admin] RBAC: Authorizing `identity:delete_user(user_id=70cee77dbe744d93b99996a50e6666bc)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:45.545134 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b65d00-b41b-4bb9-895a-e778f86bf06e admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:45.593499 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-48b65d00-b41b-4bb9-895a-e778f86bf06e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70cee77dbe744d93b99996a50e6666bc'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:45.600342 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-48b65d00-b41b-4bb9-895a-e778f86bf06e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70cee77dbe744d93b99996a50e6666bc'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:45.608104 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-48b65d00-b41b-4bb9-895a-e778f86bf06e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70cee77dbe744d93b99996a50e6666bc'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:45.608733 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-48b65d00-b41b-4bb9-895a-e778f86bf06e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70cee77dbe744d93b99996a50e6666bc'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:45.621415 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-48b65d00-b41b-4bb9-895a-e778f86bf06e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70cee77dbe744d93b99996a50e6666bc'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:45.627370 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1388/2787] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:36:45 2022] DELETE /identity/v3/users/70cee77dbe744d93b99996a50e6666bc => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:36:45.948859 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc54e4-e273-4481-9540-89b065a94e14 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:45.950387 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-60bc54e4-e273-4481-9540-89b065a94e14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:45.963141 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc54e4-e273-4481-9540-89b065a94e14 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:46.020795 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5d8f4f-8a7c-4e27-8e20-e7e60f5dfff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:46.021422 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d8f4f-8a7c-4e27-8e20-e7e60f5dfff0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:46.021707 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d8f4f-8a7c-4e27-8e20-e7e60f5dfff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:46.021984 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d8f4f-8a7c-4e27-8e20-e7e60f5dfff0 admin admin] PATH_INFO: `/v3/projects/07677299ff2b4fc98715b55618b392b1` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:46.023110 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5d8f4f-8a7c-4e27-8e20-e7e60f5dfff0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07677299ff2b4fc98715b55618b392b1)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:46.025021 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5d8f4f-8a7c-4e27-8e20-e7e60f5dfff0 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:46.070884 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-7a5d8f4f-8a7c-4e27-8e20-e7e60f5dfff0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07677299ff2b4fc98715b55618b392b1', 'request_id': 'req-7a5d8f4f-8a7c-4e27-8e20-e7e60f5dfff0'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:46.071998 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:36:46.078317 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-7a5d8f4f-8a7c-4e27-8e20-e7e60f5dfff0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07677299ff2b4fc98715b55618b392b1', 'request_id': 'req-7a5d8f4f-8a7c-4e27-8e20-e7e60f5dfff0'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:46.085660 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-7a5d8f4f-8a7c-4e27-8e20-e7e60f5dfff0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07677299ff2b4fc98715b55618b392b1', 'request_id': 'req-7a5d8f4f-8a7c-4e27-8e20-e7e60f5dfff0'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:46.097588 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-7a5d8f4f-8a7c-4e27-8e20-e7e60f5dfff0 admin admin] The token cache is being invalidate because project 07677299ff2b4fc98715b55618b392b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:36:46.097883 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-7a5d8f4f-8a7c-4e27-8e20-e7e60f5dfff0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:46.098509 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-7a5d8f4f-8a7c-4e27-8e20-e7e60f5dfff0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:36:46.100073 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1400/2788] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:36:45 2022] DELETE /identity/v3/projects/07677299ff2b4fc98715b55618b392b1 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 03:36:46.105621 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfacdcc-13a5-4fdc-b359-c649b228673a None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:46.105911 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfacdcc-13a5-4fdc-b359-c649b228673a None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:46.106183 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfacdcc-13a5-4fdc-b359-c649b228673a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:46.125461 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-7dfacdcc-13a5-4fdc-b359-c649b228673a None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:36:46.126654 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-7dfacdcc-13a5-4fdc-b359-c649b228673a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:46.185427 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1389/2789] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:36:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:36:46.193207 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b178e6-3991-4622-8610-8861c9d3b39c None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:46.193489 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b178e6-3991-4622-8610-8861c9d3b39c None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:46.193764 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b178e6-3991-4622-8610-8861c9d3b39c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:46.213320 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-f7b178e6-3991-4622-8610-8861c9d3b39c None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:36:46.214539 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-f7b178e6-3991-4622-8610-8861c9d3b39c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:46.226999 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1401/2790] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:36:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 03:36:46.232184 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfacdcc-13a5-4fdc-b359-c649b228673a None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:46.241922 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfacdcc-13a5-4fdc-b359-c649b228673a None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:46.247388 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66f21fc-a07e-45c3-b832-6d98bd07ff88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:46.248014 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f21fc-a07e-45c3-b832-6d98bd07ff88 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:46.248294 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f21fc-a07e-45c3-b832-6d98bd07ff88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:46.248567 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f21fc-a07e-45c3-b832-6d98bd07ff88 admin admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:46.249205 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66f21fc-a07e-45c3-b832-6d98bd07ff88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:36:46.249509 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66f21fc-a07e-45c3-b832-6d98bd07ff88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:46.251078 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66f21fc-a07e-45c3-b832-6d98bd07ff88 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:46.262435 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1390/2791] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 03:36:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:36:46.266666 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b178e6-3991-4622-8610-8861c9d3b39c None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:46.275935 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b178e6-3991-4622-8610-8861c9d3b39c None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:46.281882 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc9962-481e-4109-bc12-1b5af46537e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:46.282474 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc9962-481e-4109-bc12-1b5af46537e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:46.282751 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc9962-481e-4109-bc12-1b5af46537e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:46.283089 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc9962-481e-4109-bc12-1b5af46537e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:46.283757 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fc9962-481e-4109-bc12-1b5af46537e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:46.285655 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fc9962-481e-4109-bc12-1b5af46537e9 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:46.313297 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1402/2792] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:36:46 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:36:46.317627 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66f21fc-a07e-45c3-b832-6d98bd07ff88 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:46.327900 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66f21fc-a07e-45c3-b832-6d98bd07ff88 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:46.335355 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:36:46.386591 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021b496a-48e2-422f-acf3-3db4bd216b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:46.387240 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b496a-48e2-422f-acf3-3db4bd216b10 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:46.387540 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b496a-48e2-422f-acf3-3db4bd216b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:46.388045 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b496a-48e2-422f-acf3-3db4bd216b10 admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:46.388773 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021b496a-48e2-422f-acf3-3db4bd216b10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:46.391188 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021b496a-48e2-422f-acf3-3db4bd216b10 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:46.413969 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1391/2793] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:36:46 2022] POST /identity/v3/users => generated 286 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:36:46.418350 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc9962-481e-4109-bc12-1b5af46537e9 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:46.428695 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc9962-481e-4109-bc12-1b5af46537e9 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:46.433425 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79533c85-13b0-4421-95b9-a03260b44388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:46.434017 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79533c85-13b0-4421-95b9-a03260b44388 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:46.434297 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79533c85-13b0-4421-95b9-a03260b44388 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:46.434568 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79533c85-13b0-4421-95b9-a03260b44388 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:46.435210 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79533c85-13b0-4421-95b9-a03260b44388 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:46.436828 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79533c85-13b0-4421-95b9-a03260b44388 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:46.446759 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1403/2794] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:36:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:36:46.451049 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021b496a-48e2-422f-acf3-3db4bd216b10 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:46.460769 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021b496a-48e2-422f-acf3-3db4bd216b10 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:46.465462 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f163c6c-0604-43b4-ab46-2e5034bc5566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:46.466041 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f163c6c-0604-43b4-ab46-2e5034bc5566 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:46.466319 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f163c6c-0604-43b4-ab46-2e5034bc5566 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:46.466591 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f163c6c-0604-43b4-ab46-2e5034bc5566 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:46.467224 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f163c6c-0604-43b4-ab46-2e5034bc5566 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:46.468814 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f163c6c-0604-43b4-ab46-2e5034bc5566 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:46.479126 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1392/2795] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:36:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:36:46.483147 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79533c85-13b0-4421-95b9-a03260b44388 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:46.493281 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79533c85-13b0-4421-95b9-a03260b44388 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:46.499156 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931d32a3-cc12-44ba-ab90-dafadea05053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:46.499835 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d32a3-cc12-44ba-ab90-dafadea05053 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:46.500118 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d32a3-cc12-44ba-ab90-dafadea05053 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:46.500393 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d32a3-cc12-44ba-ab90-dafadea05053 admin admin] PATH_INFO: `/v3/projects/4221623fae494002a2377210978fc02c/users/85100804dda14dd4a086dff05a081431/roles/04d0e4575a28440eb4349b4a6565e8b8` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:46.515475 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931d32a3-cc12-44ba-ab90-dafadea05053 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4221623fae494002a2377210978fc02c, user_id=85100804dda14dd4a086dff05a081431, role_id=04d0e4575a28440eb4349b4a6565e8b8)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:46.518120 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931d32a3-cc12-44ba-ab90-dafadea05053 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:46.531226 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1404/2796] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:36:46 2022] PUT /identity/v3/projects/4221623fae494002a2377210978fc02c/users/85100804dda14dd4a086dff05a081431/roles/04d0e4575a28440eb4349b4a6565e8b8 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:36:46.536341 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a65f5-c0b0-462b-99cc-d789bf07985a None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:46.536627 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a65f5-c0b0-462b-99cc-d789bf07985a None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:46.536919 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a65f5-c0b0-462b-99cc-d789bf07985a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:46.555335 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-fa9a65f5-c0b0-462b-99cc-d789bf07985a None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:36:46.556543 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-fa9a65f5-c0b0-462b-99cc-d789bf07985a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:46.615364 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1393/2797] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:36:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:36:46.625384 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931d32a3-cc12-44ba-ab90-dafadea05053 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:46.627107 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-931d32a3-cc12-44ba-ab90-dafadea05053 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:46.684131 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931d32a3-cc12-44ba-ab90-dafadea05053 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:46.687770 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cffe4d4-683c-46a8-bb30-8610ea2f6d96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:46.688372 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cffe4d4-683c-46a8-bb30-8610ea2f6d96 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:46.688653 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cffe4d4-683c-46a8-bb30-8610ea2f6d96 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:46.688929 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cffe4d4-683c-46a8-bb30-8610ea2f6d96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:46.698567 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cffe4d4-683c-46a8-bb30-8610ea2f6d96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:46.700019 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cffe4d4-683c-46a8-bb30-8610ea2f6d96 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:46.709274 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1405/2798] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:36:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:36:47.438192 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f80ce-387c-402d-9d0b-2a96d9502c15 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:47.438488 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f80ce-387c-402d-9d0b-2a96d9502c15 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:47.438771 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f80ce-387c-402d-9d0b-2a96d9502c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:47.467754 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-c54f80ce-387c-402d-9d0b-2a96d9502c15 None None] MFA Rules not processed for user `85100804dda14dd4a086dff05a081431`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:36:47.469030 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-c54f80ce-387c-402d-9d0b-2a96d9502c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:47.550086 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1394/2799] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:36:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:36:47.558998 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cffe4d4-683c-46a8-bb30-8610ea2f6d96 service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:47.569618 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cffe4d4-683c-46a8-bb30-8610ea2f6d96 service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:47.575804 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35a23a1-7d9e-4d5c-92ff-e229f5f50490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:47.576426 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a23a1-7d9e-4d5c-92ff-e229f5f50490 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:47.576736 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a23a1-7d9e-4d5c-92ff-e229f5f50490 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:47.577010 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a23a1-7d9e-4d5c-92ff-e229f5f50490 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:47.577661 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35a23a1-7d9e-4d5c-92ff-e229f5f50490 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:47.579602 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35a23a1-7d9e-4d5c-92ff-e229f5f50490 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:47.609853 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1406/2800] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:36:47 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:36:47.613945 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54f80ce-387c-402d-9d0b-2a96d9502c15 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:47.627156 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54f80ce-387c-402d-9d0b-2a96d9502c15 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:47.652174 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:36:47.696640 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8baf007-0651-4d53-a597-bcfaf5c248ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:47.697310 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8baf007-0651-4d53-a597-bcfaf5c248ff admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:47.697659 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8baf007-0651-4d53-a597-bcfaf5c248ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:47.698644 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8baf007-0651-4d53-a597-bcfaf5c248ff admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:47.699283 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8baf007-0651-4d53-a597-bcfaf5c248ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:47.701267 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8baf007-0651-4d53-a597-bcfaf5c248ff admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:47.725986 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1395/2801] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:36:47 2022] POST /identity/v3/users => generated 292 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:36:47.727210 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35a23a1-7d9e-4d5c-92ff-e229f5f50490 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:47.738021 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35a23a1-7d9e-4d5c-92ff-e229f5f50490 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:47.743127 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7253d7-0d2a-4f6d-a8a3-edae34673c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:47.743767 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7253d7-0d2a-4f6d-a8a3-edae34673c75 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:47.744048 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7253d7-0d2a-4f6d-a8a3-edae34673c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:47.744319 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7253d7-0d2a-4f6d-a8a3-edae34673c75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:47.745263 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7253d7-0d2a-4f6d-a8a3-edae34673c75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:47.747344 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7253d7-0d2a-4f6d-a8a3-edae34673c75 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:47.761985 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1407/2802] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:36:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:36:47.763559 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8baf007-0651-4d53-a597-bcfaf5c248ff admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:47.774407 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8baf007-0651-4d53-a597-bcfaf5c248ff admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:47.779615 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cecbd84-4474-4116-a1e5-b28fcc407cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:47.780266 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cecbd84-4474-4116-a1e5-b28fcc407cbb admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:47.780543 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cecbd84-4474-4116-a1e5-b28fcc407cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:47.780817 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cecbd84-4474-4116-a1e5-b28fcc407cbb admin admin] PATH_INFO: `/v3/projects/aea6db07da9b4b67a77f2d6475e88b05/users/63a9572eae2f4fe8acf64ee9d619dd0f/roles/fe9379cda35c4ff78576fe48b60bea3c` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:47.797799 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cecbd84-4474-4116-a1e5-b28fcc407cbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=aea6db07da9b4b67a77f2d6475e88b05, user_id=63a9572eae2f4fe8acf64ee9d619dd0f, role_id=fe9379cda35c4ff78576fe48b60bea3c)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:47.799099 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cecbd84-4474-4116-a1e5-b28fcc407cbb admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:47.811892 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1396/2803] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:36:47 2022] PUT /identity/v3/projects/aea6db07da9b4b67a77f2d6475e88b05/users/63a9572eae2f4fe8acf64ee9d619dd0f/roles/fe9379cda35c4ff78576fe48b60bea3c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 03:36:47.815805 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7253d7-0d2a-4f6d-a8a3-edae34673c75 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:47.827070 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7253d7-0d2a-4f6d-a8a3-edae34673c75 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:47.868503 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:36:47.884923 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf1bef0-83d7-4fc8-8b6a-407597494135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:47.886095 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf1bef0-83d7-4fc8-8b6a-407597494135 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:47.886371 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf1bef0-83d7-4fc8-8b6a-407597494135 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:47.886637 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf1bef0-83d7-4fc8-8b6a-407597494135 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:47.887269 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf1bef0-83d7-4fc8-8b6a-407597494135 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:47.888879 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf1bef0-83d7-4fc8-8b6a-407597494135 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:47.898986 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1408/2804] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:36:47 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:36:47.903865 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cecbd84-4474-4116-a1e5-b28fcc407cbb admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:47.913888 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cecbd84-4474-4116-a1e5-b28fcc407cbb admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:47.918959 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc88025-db4e-46f4-b0fd-11e35b9cd9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:47.919628 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc88025-db4e-46f4-b0fd-11e35b9cd9d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:47.919906 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc88025-db4e-46f4-b0fd-11e35b9cd9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:47.920179 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc88025-db4e-46f4-b0fd-11e35b9cd9d4 admin admin] PATH_INFO: `/v3/projects/aea6db07da9b4b67a77f2d6475e88b05/users/63a9572eae2f4fe8acf64ee9d619dd0f/roles/fe9379cda35c4ff78576fe48b60bea3c` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:47.922071 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc88025-db4e-46f4-b0fd-11e35b9cd9d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aea6db07da9b4b67a77f2d6475e88b05, user_id=63a9572eae2f4fe8acf64ee9d619dd0f, role_id=fe9379cda35c4ff78576fe48b60bea3c)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:47.924715 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc88025-db4e-46f4-b0fd-11e35b9cd9d4 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:47.935261 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1397/2805] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:36:47 2022] PUT /identity/v3/projects/aea6db07da9b4b67a77f2d6475e88b05/users/63a9572eae2f4fe8acf64ee9d619dd0f/roles/fe9379cda35c4ff78576fe48b60bea3c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:36:48.580338 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97781375-d643-4dbb-9360-c61f94333bc9 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:48.580891 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97781375-d643-4dbb-9360-c61f94333bc9 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:48.580891 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97781375-d643-4dbb-9360-c61f94333bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:48.609264 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-97781375-d643-4dbb-9360-c61f94333bc9 None None] MFA Rules not processed for user `63a9572eae2f4fe8acf64ee9d619dd0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:36:48.610486 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-97781375-d643-4dbb-9360-c61f94333bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:48.689029 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1409/2806] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:36:48 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 03:36:48.700068 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42873d3-2e69-44fb-a48a-4959a35a8bf6 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:48.700566 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42873d3-2e69-44fb-a48a-4959a35a8bf6 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:48.700684 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42873d3-2e69-44fb-a48a-4959a35a8bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:48.719455 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-f42873d3-2e69-44fb-a48a-4959a35a8bf6 None None] MFA Rules not processed for user `85100804dda14dd4a086dff05a081431`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:36:48.720894 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-f42873d3-2e69-44fb-a48a-4959a35a8bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:48.778682 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1398/2807] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:36:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:36:48.789463 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97781375-d643-4dbb-9360-c61f94333bc9 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:48.790835 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-97781375-d643-4dbb-9360-c61f94333bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:48.863822 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97781375-d643-4dbb-9360-c61f94333bc9 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:48.869276 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b1d0b-13d1-4875-b6bf-d9bd74878312 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1f412befb9418fa66a2aabf475aa90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:48.870586 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b1d0b-13d1-4875-b6bf-d9bd74878312 service nova] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:48.870866 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b1d0b-13d1-4875-b6bf-d9bd74878312 service nova] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:48.871133 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b1d0b-13d1-4875-b6bf-d9bd74878312 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:48.878649 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6b1d0b-13d1-4875-b6bf-d9bd74878312 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:48.880239 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6b1d0b-13d1-4875-b6bf-d9bd74878312 service nova] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:48.889509 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1410/2808] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:36:48 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:36:56.121729 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42873d3-2e69-44fb-a48a-4959a35a8bf6 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:56.123195 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-f42873d3-2e69-44fb-a48a-4959a35a8bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:56.180060 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42873d3-2e69-44fb-a48a-4959a35a8bf6 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:56.183694 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ded3a2-9763-48df-9a29-61ec6fc39d18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:56.184292 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ded3a2-9763-48df-9a29-61ec6fc39d18 service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:56.184576 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ded3a2-9763-48df-9a29-61ec6fc39d18 service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:56.184854 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ded3a2-9763-48df-9a29-61ec6fc39d18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:56.186606 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-62ded3a2-9763-48df-9a29-61ec6fc39d18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:56.217794 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:36:56.251058 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ded3a2-9763-48df-9a29-61ec6fc39d18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:56.252528 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ded3a2-9763-48df-9a29-61ec6fc39d18 service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:56.262901 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1399/2809] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:36:56 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:36:58.127661 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b1d0b-13d1-4875-b6bf-d9bd74878312 service nova] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:36:58.130681 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-2b6b1d0b-13d1-4875-b6bf-d9bd74878312 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:58.155302 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b1d0b-13d1-4875-b6bf-d9bd74878312 service nova] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:36:58.161797 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c82aee-5384-4252-89b8-2d782f6bb3df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1f412befb9418fa66a2aabf475aa90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:36:58.163050 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c82aee-5384-4252-89b8-2d782f6bb3df service nova] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:36:58.163428 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c82aee-5384-4252-89b8-2d782f6bb3df service nova] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:36:58.163845 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c82aee-5384-4252-89b8-2d782f6bb3df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:36:58.165702 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-80c82aee-5384-4252-89b8-2d782f6bb3df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:36:58.180442 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c82aee-5384-4252-89b8-2d782f6bb3df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:36:58.183045 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c82aee-5384-4252-89b8-2d782f6bb3df service nova] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:36:58.196132 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1411/2810] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:36:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:37:01.068479 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ded3a2-9763-48df-9a29-61ec6fc39d18 service neutron] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:37:01.070172 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-62ded3a2-9763-48df-9a29-61ec6fc39d18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:37:01.125680 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ded3a2-9763-48df-9a29-61ec6fc39d18 service neutron] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:37:01.129211 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38398bf9-438a-4849-a85f-383775c558e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f537aabf3d1040ff840b02616f839975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:37:01.129797 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38398bf9-438a-4849-a85f-383775c558e0 service cinder] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:01.130072 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38398bf9-438a-4849-a85f-383775c558e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:01.130342 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38398bf9-438a-4849-a85f-383775c558e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:01.139595 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38398bf9-438a-4849-a85f-383775c558e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:37:01.141020 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38398bf9-438a-4849-a85f-383775c558e0 service cinder] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:37:01.150215 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1400/2811] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:37:01 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:37:08.190481 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=83 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:37:11.146130 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=41 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:37:21.001026 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c82aee-5384-4252-89b8-2d782f6bb3df service nova] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:37:21.067578 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c82aee-5384-4252-89b8-2d782f6bb3df service nova] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:37:21.072288 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d83fb-2355-4887-9451-646e1925c182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:37:21.073559 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d83fb-2355-4887-9451-646e1925c182 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:21.073832 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d83fb-2355-4887-9451-646e1925c182 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:21.074104 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d83fb-2355-4887-9451-646e1925c182 admin admin] PATH_INFO: `/v3/users/85100804dda14dd4a086dff05a081431` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:21.075212 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854d83fb-2355-4887-9451-646e1925c182 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85100804dda14dd4a086dff05a081431)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:37:21.077122 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854d83fb-2355-4887-9451-646e1925c182 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:37:21.122201 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-854d83fb-2355-4887-9451-646e1925c182 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85100804dda14dd4a086dff05a081431'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:37:21.122856 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-854d83fb-2355-4887-9451-646e1925c182 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85100804dda14dd4a086dff05a081431'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:37:21.130057 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-854d83fb-2355-4887-9451-646e1925c182 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85100804dda14dd4a086dff05a081431'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:37:21.130777 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-854d83fb-2355-4887-9451-646e1925c182 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85100804dda14dd4a086dff05a081431'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:37:21.143281 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-854d83fb-2355-4887-9451-646e1925c182 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85100804dda14dd4a086dff05a081431'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:37:21.155888 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1412/2812] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:37:20 2022] DELETE /identity/v3/users/85100804dda14dd4a086dff05a081431 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:37:21.328129 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38398bf9-438a-4849-a85f-383775c558e0 service cinder] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:37:21.339266 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38398bf9-438a-4849-a85f-383775c558e0 service cinder] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:37:21.396605 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e703a629-5679-459e-bfaa-e7a9456a737a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:37:21.397226 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e703a629-5679-459e-bfaa-e7a9456a737a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:21.397503 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e703a629-5679-459e-bfaa-e7a9456a737a admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:21.397772 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e703a629-5679-459e-bfaa-e7a9456a737a admin admin] PATH_INFO: `/v3/projects/4221623fae494002a2377210978fc02c` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:21.398877 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e703a629-5679-459e-bfaa-e7a9456a737a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4221623fae494002a2377210978fc02c)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:37:21.400895 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e703a629-5679-459e-bfaa-e7a9456a737a admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:37:21.446876 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-e703a629-5679-459e-bfaa-e7a9456a737a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4221623fae494002a2377210978fc02c', 'request_id': 'req-e703a629-5679-459e-bfaa-e7a9456a737a'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:37:21.452530 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-e703a629-5679-459e-bfaa-e7a9456a737a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4221623fae494002a2377210978fc02c', 'request_id': 'req-e703a629-5679-459e-bfaa-e7a9456a737a'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:37:21.458535 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-e703a629-5679-459e-bfaa-e7a9456a737a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4221623fae494002a2377210978fc02c', 'request_id': 'req-e703a629-5679-459e-bfaa-e7a9456a737a'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:37:21.470582 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-e703a629-5679-459e-bfaa-e7a9456a737a admin admin] The token cache is being invalidate because project 4221623fae494002a2377210978fc02c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:37:21.470879 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-e703a629-5679-459e-bfaa-e7a9456a737a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:37:21.471514 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-e703a629-5679-459e-bfaa-e7a9456a737a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:37:21.472977 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1401/2813] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:37:21 2022] DELETE /identity/v3/projects/4221623fae494002a2377210978fc02c => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:37:21.477144 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d83fb-2355-4887-9451-646e1925c182 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:37:21.479270 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-854d83fb-2355-4887-9451-646e1925c182 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:37:21.492214 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d83fb-2355-4887-9451-646e1925c182 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:37:21.549242 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb3daab-92d0-4984-b92e-001159a98207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:37:21.549869 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb3daab-92d0-4984-b92e-001159a98207 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:21.550154 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb3daab-92d0-4984-b92e-001159a98207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:21.550431 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb3daab-92d0-4984-b92e-001159a98207 admin admin] PATH_INFO: `/v3/users/63a9572eae2f4fe8acf64ee9d619dd0f` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:21.551591 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb3daab-92d0-4984-b92e-001159a98207 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63a9572eae2f4fe8acf64ee9d619dd0f)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:37:21.553505 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb3daab-92d0-4984-b92e-001159a98207 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:37:21.575576 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:37:21.601820 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-4eb3daab-92d0-4984-b92e-001159a98207 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63a9572eae2f4fe8acf64ee9d619dd0f'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:37:21.602478 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-4eb3daab-92d0-4984-b92e-001159a98207 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63a9572eae2f4fe8acf64ee9d619dd0f'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:37:21.609523 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-4eb3daab-92d0-4984-b92e-001159a98207 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63a9572eae2f4fe8acf64ee9d619dd0f'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:37:21.610152 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-4eb3daab-92d0-4984-b92e-001159a98207 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63a9572eae2f4fe8acf64ee9d619dd0f'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:37:21.623152 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-4eb3daab-92d0-4984-b92e-001159a98207 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63a9572eae2f4fe8acf64ee9d619dd0f'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:37:21.637118 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1413/2814] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:37:21 2022] DELETE /identity/v3/users/63a9572eae2f4fe8acf64ee9d619dd0f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:37:21.812834 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e703a629-5679-459e-bfaa-e7a9456a737a admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:37:21.814266 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-e703a629-5679-459e-bfaa-e7a9456a737a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:37:21.828625 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e703a629-5679-459e-bfaa-e7a9456a737a admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:37:21.884443 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588f0c59-caf3-4d33-8f9e-acb36ede657e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:37:21.885148 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588f0c59-caf3-4d33-8f9e-acb36ede657e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:21.885435 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588f0c59-caf3-4d33-8f9e-acb36ede657e admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:21.885706 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588f0c59-caf3-4d33-8f9e-acb36ede657e admin admin] PATH_INFO: `/v3/projects/aea6db07da9b4b67a77f2d6475e88b05` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:21.886839 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588f0c59-caf3-4d33-8f9e-acb36ede657e admin admin] RBAC: Authorizing `identity:delete_project(project_id=aea6db07da9b4b67a77f2d6475e88b05)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:37:21.888755 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588f0c59-caf3-4d33-8f9e-acb36ede657e admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:37:21.923352 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:37:21.936538 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-588f0c59-caf3-4d33-8f9e-acb36ede657e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aea6db07da9b4b67a77f2d6475e88b05', 'request_id': 'req-588f0c59-caf3-4d33-8f9e-acb36ede657e'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:37:21.942388 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-588f0c59-caf3-4d33-8f9e-acb36ede657e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aea6db07da9b4b67a77f2d6475e88b05', 'request_id': 'req-588f0c59-caf3-4d33-8f9e-acb36ede657e'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:37:21.948788 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-588f0c59-caf3-4d33-8f9e-acb36ede657e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aea6db07da9b4b67a77f2d6475e88b05', 'request_id': 'req-588f0c59-caf3-4d33-8f9e-acb36ede657e'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:37:21.960877 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-588f0c59-caf3-4d33-8f9e-acb36ede657e admin admin] The token cache is being invalidate because project aea6db07da9b4b67a77f2d6475e88b05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:37:21.961172 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-588f0c59-caf3-4d33-8f9e-acb36ede657e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:37:21.961791 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-588f0c59-caf3-4d33-8f9e-acb36ede657e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:37:21.963842 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1402/2815] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:37:21 2022] DELETE /identity/v3/projects/aea6db07da9b4b67a77f2d6475e88b05 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:37:21.968822 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5dc4a1-6b18-4c10-8db6-862c40b71bff None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:21.969115 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5dc4a1-6b18-4c10-8db6-862c40b71bff None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:21.969395 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5dc4a1-6b18-4c10-8db6-862c40b71bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:21.988631 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-1a5dc4a1-6b18-4c10-8db6-862c40b71bff None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:37:21.989832 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-1a5dc4a1-6b18-4c10-8db6-862c40b71bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:37:22.047674 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1414/2816] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:37:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:37:22.055280 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9116ae82-ca5d-4a62-87c7-490901be6feb None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:22.055599 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9116ae82-ca5d-4a62-87c7-490901be6feb None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:22.055876 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9116ae82-ca5d-4a62-87c7-490901be6feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:22.077116 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-9116ae82-ca5d-4a62-87c7-490901be6feb None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:37:22.078332 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-9116ae82-ca5d-4a62-87c7-490901be6feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:37:22.086440 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1403/2817] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:37:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:37:22.090734 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5dc4a1-6b18-4c10-8db6-862c40b71bff None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:37:22.100296 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5dc4a1-6b18-4c10-8db6-862c40b71bff None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:37:22.105458 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed94ddf-da8d-444c-84c9-0b1c82ada3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:37:22.106048 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed94ddf-da8d-444c-84c9-0b1c82ada3e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:22.106330 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed94ddf-da8d-444c-84c9-0b1c82ada3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:22.106606 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed94ddf-da8d-444c-84c9-0b1c82ada3e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:22.107251 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed94ddf-da8d-444c-84c9-0b1c82ada3e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:37:22.107587 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed94ddf-da8d-444c-84c9-0b1c82ada3e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:37:22.109163 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed94ddf-da8d-444c-84c9-0b1c82ada3e1 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:37:22.120930 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1415/2818] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 03:37:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:37:22.125201 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9116ae82-ca5d-4a62-87c7-490901be6feb None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:37:22.134318 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9116ae82-ca5d-4a62-87c7-490901be6feb None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:37:22.139398 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9fbe36-a078-4f0d-ae1f-b69bfd917150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:37:22.140014 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9fbe36-a078-4f0d-ae1f-b69bfd917150 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:22.140301 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9fbe36-a078-4f0d-ae1f-b69bfd917150 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:22.140578 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9fbe36-a078-4f0d-ae1f-b69bfd917150 admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:22.141204 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9fbe36-a078-4f0d-ae1f-b69bfd917150 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:37:22.143078 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9fbe36-a078-4f0d-ae1f-b69bfd917150 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:37:22.170551 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1404/2819] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:37:22 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:37:22.174644 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed94ddf-da8d-444c-84c9-0b1c82ada3e1 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:37:22.184691 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed94ddf-da8d-444c-84c9-0b1c82ada3e1 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:37:22.242096 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f82799-bca2-44d4-8e24-9d9ce62bb4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:37:22.242699 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f82799-bca2-44d4-8e24-9d9ce62bb4a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:22.242983 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f82799-bca2-44d4-8e24-9d9ce62bb4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:22.243257 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f82799-bca2-44d4-8e24-9d9ce62bb4a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:22.243931 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f82799-bca2-44d4-8e24-9d9ce62bb4a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:37:22.245955 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f82799-bca2-44d4-8e24-9d9ce62bb4a0 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:37:22.270986 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1416/2820] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:37:22 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:37:22.273153 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9fbe36-a078-4f0d-ae1f-b69bfd917150 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:37:22.284095 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9fbe36-a078-4f0d-ae1f-b69bfd917150 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:37:22.288631 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4ab90d-e10c-47d2-a0a9-a37501f36a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:37:22.289213 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ab90d-e10c-47d2-a0a9-a37501f36a34 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:22.289492 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ab90d-e10c-47d2-a0a9-a37501f36a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:22.289765 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ab90d-e10c-47d2-a0a9-a37501f36a34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:22.290400 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4ab90d-e10c-47d2-a0a9-a37501f36a34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:37:22.292120 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4ab90d-e10c-47d2-a0a9-a37501f36a34 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:37:22.302072 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1405/2821] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:37:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:37:22.305754 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f82799-bca2-44d4-8e24-9d9ce62bb4a0 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:37:22.315989 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f82799-bca2-44d4-8e24-9d9ce62bb4a0 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:37:22.320904 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12729327-237b-4c2a-9c68-cca0b31d9f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:37:22.321493 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12729327-237b-4c2a-9c68-cca0b31d9f60 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:22.321778 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12729327-237b-4c2a-9c68-cca0b31d9f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:22.322052 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12729327-237b-4c2a-9c68-cca0b31d9f60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:22.323370 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12729327-237b-4c2a-9c68-cca0b31d9f60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:37:22.325306 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12729327-237b-4c2a-9c68-cca0b31d9f60 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:37:22.335913 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1417/2822] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:37:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:37:22.340750 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4ab90d-e10c-47d2-a0a9-a37501f36a34 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:37:22.350848 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4ab90d-e10c-47d2-a0a9-a37501f36a34 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:37:22.355666 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8da4a02-d9d2-46aa-bca4-148c9d794278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:37:22.356310 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da4a02-d9d2-46aa-bca4-148c9d794278 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:22.356604 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da4a02-d9d2-46aa-bca4-148c9d794278 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:22.356884 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da4a02-d9d2-46aa-bca4-148c9d794278 admin admin] PATH_INFO: `/v3/projects/86930f52160d4bc9953e51aeffdfa5c3/users/a8d7a669906443ce85eff9a2ec92f388/roles/04d0e4575a28440eb4349b4a6565e8b8` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:22.372134 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8da4a02-d9d2-46aa-bca4-148c9d794278 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86930f52160d4bc9953e51aeffdfa5c3, user_id=a8d7a669906443ce85eff9a2ec92f388, role_id=04d0e4575a28440eb4349b4a6565e8b8)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:37:22.374767 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8da4a02-d9d2-46aa-bca4-148c9d794278 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:37:22.387766 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1406/2823] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:37:22 2022] PUT /identity/v3/projects/86930f52160d4bc9953e51aeffdfa5c3/users/a8d7a669906443ce85eff9a2ec92f388/roles/04d0e4575a28440eb4349b4a6565e8b8 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:37:22.399095 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fec050a-7a19-4a0e-b497-02a3c4a891e0 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:22.399380 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fec050a-7a19-4a0e-b497-02a3c4a891e0 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:22.399687 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fec050a-7a19-4a0e-b497-02a3c4a891e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:22.408545 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:37:22.429556 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-5fec050a-7a19-4a0e-b497-02a3c4a891e0 None None] MFA Rules not processed for user `a8d7a669906443ce85eff9a2ec92f388`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:37:22.430853 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-5fec050a-7a19-4a0e-b497-02a3c4a891e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:37:22.492777 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1418/2824] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:37:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 03:37:22.504307 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8da4a02-d9d2-46aa-bca4-148c9d794278 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:37:22.505985 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-a8da4a02-d9d2-46aa-bca4-148c9d794278 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:37:22.563971 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8da4a02-d9d2-46aa-bca4-148c9d794278 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:37:22.567480 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e9f2a-944e-4d48-973b-09cdafdc8f43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f537aabf3d1040ff840b02616f839975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:37:22.568104 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e9f2a-944e-4d48-973b-09cdafdc8f43 service cinder] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:22.568381 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e9f2a-944e-4d48-973b-09cdafdc8f43 service cinder] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:22.568653 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e9f2a-944e-4d48-973b-09cdafdc8f43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:22.577834 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480e9f2a-944e-4d48-973b-09cdafdc8f43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:37:22.579229 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480e9f2a-944e-4d48-973b-09cdafdc8f43 service cinder] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:37:22.587903 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1407/2825] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:37:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:37:22.609464 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fec050a-7a19-4a0e-b497-02a3c4a891e0 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:37:22.672905 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fec050a-7a19-4a0e-b497-02a3c4a891e0 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:37:22.677477 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b5be2f-1a89-46c3-b0fa-a10a3097431a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:37:22.678094 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5be2f-1a89-46c3-b0fa-a10a3097431a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:22.678376 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5be2f-1a89-46c3-b0fa-a10a3097431a admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:22.678652 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5be2f-1a89-46c3-b0fa-a10a3097431a admin admin] PATH_INFO: `/v3/users/a8d7a669906443ce85eff9a2ec92f388` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:22.679835 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b5be2f-1a89-46c3-b0fa-a10a3097431a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8d7a669906443ce85eff9a2ec92f388)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:37:22.681738 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b5be2f-1a89-46c3-b0fa-a10a3097431a admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:37:22.731260 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-c2b5be2f-1a89-46c3-b0fa-a10a3097431a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8d7a669906443ce85eff9a2ec92f388'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:37:22.731957 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-c2b5be2f-1a89-46c3-b0fa-a10a3097431a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8d7a669906443ce85eff9a2ec92f388'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:37:22.738861 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-c2b5be2f-1a89-46c3-b0fa-a10a3097431a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8d7a669906443ce85eff9a2ec92f388'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:37:22.739524 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-c2b5be2f-1a89-46c3-b0fa-a10a3097431a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8d7a669906443ce85eff9a2ec92f388'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:37:22.751848 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-c2b5be2f-1a89-46c3-b0fa-a10a3097431a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8d7a669906443ce85eff9a2ec92f388'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:37:22.764649 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1419/2826] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:37:22 2022] DELETE /identity/v3/users/a8d7a669906443ce85eff9a2ec92f388 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:37:22.769075 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc68e64-dd74-424b-aa90-ae7c578dadab None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:22.769356 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc68e64-dd74-424b-aa90-ae7c578dadab None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:22.769628 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc68e64-dd74-424b-aa90-ae7c578dadab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:22.788487 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-ecc68e64-dd74-424b-aa90-ae7c578dadab None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:37:22.789662 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-ecc68e64-dd74-424b-aa90-ae7c578dadab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:37:22.839725 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:37:22.849912 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1408/2827] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:37:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:37:22.859942 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b5be2f-1a89-46c3-b0fa-a10a3097431a admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:37:22.861352 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-c2b5be2f-1a89-46c3-b0fa-a10a3097431a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:37:22.876675 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:37:22.923682 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b5be2f-1a89-46c3-b0fa-a10a3097431a admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:37:22.927233 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d54a15a-8a45-4092-8f52-d4e27c8430d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:37:22.927859 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d54a15a-8a45-4092-8f52-d4e27c8430d7 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:22.928137 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d54a15a-8a45-4092-8f52-d4e27c8430d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:22.928407 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d54a15a-8a45-4092-8f52-d4e27c8430d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:22.937717 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d54a15a-8a45-4092-8f52-d4e27c8430d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:37:22.939119 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d54a15a-8a45-4092-8f52-d4e27c8430d7 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:37:22.949440 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1420/2828] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:37:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:37:23.208522 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc68e64-dd74-424b-aa90-ae7c578dadab None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:37:23.210083 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-ecc68e64-dd74-424b-aa90-ae7c578dadab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:37:23.223847 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc68e64-dd74-424b-aa90-ae7c578dadab None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:37:23.228477 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9dc436-8c83-4f09-9d1c-7a0158e8fa8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:37:23.229852 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9dc436-8c83-4f09-9d1c-7a0158e8fa8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:23.230134 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9dc436-8c83-4f09-9d1c-7a0158e8fa8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:23.230400 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9dc436-8c83-4f09-9d1c-7a0158e8fa8f admin admin] PATH_INFO: `/v3/projects/86930f52160d4bc9953e51aeffdfa5c3` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:23.231561 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9dc436-8c83-4f09-9d1c-7a0158e8fa8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=86930f52160d4bc9953e51aeffdfa5c3)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:37:23.233441 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9dc436-8c83-4f09-9d1c-7a0158e8fa8f admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:37:23.279330 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-ab9dc436-8c83-4f09-9d1c-7a0158e8fa8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86930f52160d4bc9953e51aeffdfa5c3', 'request_id': 'req-ab9dc436-8c83-4f09-9d1c-7a0158e8fa8f'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:37:23.284648 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-ab9dc436-8c83-4f09-9d1c-7a0158e8fa8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86930f52160d4bc9953e51aeffdfa5c3', 'request_id': 'req-ab9dc436-8c83-4f09-9d1c-7a0158e8fa8f'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:37:23.290566 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-ab9dc436-8c83-4f09-9d1c-7a0158e8fa8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86930f52160d4bc9953e51aeffdfa5c3', 'request_id': 'req-ab9dc436-8c83-4f09-9d1c-7a0158e8fa8f'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:37:23.303261 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-ab9dc436-8c83-4f09-9d1c-7a0158e8fa8f admin admin] The token cache is being invalidate because project 86930f52160d4bc9953e51aeffdfa5c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:37:23.303627 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-ab9dc436-8c83-4f09-9d1c-7a0158e8fa8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:37:23.304220 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-ab9dc436-8c83-4f09-9d1c-7a0158e8fa8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:37:23.305688 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1409/2829] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:37:23 2022] DELETE /identity/v3/projects/86930f52160d4bc9953e51aeffdfa5c3 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:37:23.310624 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c9ff1-220b-45e7-b86e-bbac115ea801 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:23.311107 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c9ff1-220b-45e7-b86e-bbac115ea801 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:23.311206 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c9ff1-220b-45e7-b86e-bbac115ea801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:23.331102 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-b66c9ff1-220b-45e7-b86e-bbac115ea801 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:37:23.332337 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-b66c9ff1-220b-45e7-b86e-bbac115ea801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:37:23.391931 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1421/2830] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:37:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:37:23.401552 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa8621-e179-44d2-b78b-04414a698944 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:23.402030 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa8621-e179-44d2-b78b-04414a698944 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:23.402131 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa8621-e179-44d2-b78b-04414a698944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:23.424202 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-dbfa8621-e179-44d2-b78b-04414a698944 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:37:23.425486 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-dbfa8621-e179-44d2-b78b-04414a698944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:37:23.434497 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1410/2831] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:37:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:37:23.438706 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66c9ff1-220b-45e7-b86e-bbac115ea801 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:37:23.449364 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66c9ff1-220b-45e7-b86e-bbac115ea801 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:37:23.453874 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91215ebf-9d9d-4889-85e9-e17c1cca6763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:37:23.454461 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91215ebf-9d9d-4889-85e9-e17c1cca6763 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:23.454741 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91215ebf-9d9d-4889-85e9-e17c1cca6763 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:23.455009 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91215ebf-9d9d-4889-85e9-e17c1cca6763 admin admin] PATH_INFO: `/v3/domains` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:23.455684 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91215ebf-9d9d-4889-85e9-e17c1cca6763 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81379) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:37:23.455990 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91215ebf-9d9d-4889-85e9-e17c1cca6763 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:37:23.457546 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91215ebf-9d9d-4889-85e9-e17c1cca6763 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:37:23.468806 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1422/2832] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 03:37:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:37:23.473126 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfa8621-e179-44d2-b78b-04414a698944 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:37:23.482350 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfa8621-e179-44d2-b78b-04414a698944 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:37:23.487074 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4f4913-b3ed-4547-9425-4b1461fce67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:37:23.487695 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f4913-b3ed-4547-9425-4b1461fce67b admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:23.487975 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f4913-b3ed-4547-9425-4b1461fce67b admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:23.488246 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f4913-b3ed-4547-9425-4b1461fce67b admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:23.488875 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4f4913-b3ed-4547-9425-4b1461fce67b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:37:23.490857 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4f4913-b3ed-4547-9425-4b1461fce67b admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:37:23.524190 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1411/2833] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:37:23 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:37:23.528462 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91215ebf-9d9d-4889-85e9-e17c1cca6763 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:37:23.538663 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91215ebf-9d9d-4889-85e9-e17c1cca6763 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:37:23.594561 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f05b41-d628-4148-80e8-79ba5fa876a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:37:23.595152 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f05b41-d628-4148-80e8-79ba5fa876a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:23.595432 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f05b41-d628-4148-80e8-79ba5fa876a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:23.595754 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f05b41-d628-4148-80e8-79ba5fa876a6 admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:23.596388 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f05b41-d628-4148-80e8-79ba5fa876a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:37:23.598265 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f05b41-d628-4148-80e8-79ba5fa876a6 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:37:23.620193 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1423/2834] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:37:23 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:37:23.624645 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4f4913-b3ed-4547-9425-4b1461fce67b admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:37:23.635473 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4f4913-b3ed-4547-9425-4b1461fce67b admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:37:23.641990 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14ac973-abd8-42c2-8c5a-30b751485a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:37:23.641990 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ac973-abd8-42c2-8c5a-30b751485a6f admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:23.641990 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ac973-abd8-42c2-8c5a-30b751485a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:23.641990 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ac973-abd8-42c2-8c5a-30b751485a6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:23.642609 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14ac973-abd8-42c2-8c5a-30b751485a6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:37:23.644249 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14ac973-abd8-42c2-8c5a-30b751485a6f admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:37:23.654727 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1412/2835] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:37:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:37:23.658707 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f05b41-d628-4148-80e8-79ba5fa876a6 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:37:23.669108 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f05b41-d628-4148-80e8-79ba5fa876a6 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:37:23.673698 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81c577b-feef-43b8-80d3-9c67642c5018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:37:23.674292 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c577b-feef-43b8-80d3-9c67642c5018 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:23.674576 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c577b-feef-43b8-80d3-9c67642c5018 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:23.674849 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c577b-feef-43b8-80d3-9c67642c5018 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:23.675540 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81c577b-feef-43b8-80d3-9c67642c5018 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:37:23.677108 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81c577b-feef-43b8-80d3-9c67642c5018 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:37:23.688325 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1424/2836] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:37:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:37:23.692209 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14ac973-abd8-42c2-8c5a-30b751485a6f admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:37:23.702618 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14ac973-abd8-42c2-8c5a-30b751485a6f admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:37:23.707516 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c5c557-1b82-46dd-ba51-34e546c169a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:37:23.708152 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5c557-1b82-46dd-ba51-34e546c169a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:23.708431 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5c557-1b82-46dd-ba51-34e546c169a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:23.708705 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5c557-1b82-46dd-ba51-34e546c169a3 admin admin] PATH_INFO: `/v3/projects/5da72ae832704bf981696b27a03afa75/users/67fdf34c5fdf43e88b23ba146e7440ea/roles/04d0e4575a28440eb4349b4a6565e8b8` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:23.722846 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c5c557-1b82-46dd-ba51-34e546c169a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5da72ae832704bf981696b27a03afa75, user_id=67fdf34c5fdf43e88b23ba146e7440ea, role_id=04d0e4575a28440eb4349b4a6565e8b8)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:37:23.725481 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c5c557-1b82-46dd-ba51-34e546c169a3 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:37:23.739473 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1413/2837] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:37:23 2022] PUT /identity/v3/projects/5da72ae832704bf981696b27a03afa75/users/67fdf34c5fdf43e88b23ba146e7440ea/roles/04d0e4575a28440eb4349b4a6565e8b8 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 03:37:23.750328 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c31dd51-4dfe-4e1d-a553-c14eedf28650 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:23.750616 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c31dd51-4dfe-4e1d-a553-c14eedf28650 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:23.750891 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c31dd51-4dfe-4e1d-a553-c14eedf28650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:23.778213 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-1c31dd51-4dfe-4e1d-a553-c14eedf28650 None None] MFA Rules not processed for user `67fdf34c5fdf43e88b23ba146e7440ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:37:23.779439 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-1c31dd51-4dfe-4e1d-a553-c14eedf28650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:37:23.788539 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:37:23.843981 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1425/2838] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:37:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:37:23.848410 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c5c557-1b82-46dd-ba51-34e546c169a3 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:37:23.909776 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c5c557-1b82-46dd-ba51-34e546c169a3 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:37:23.914256 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4103aad-73e0-48e7-9c5c-190f01c65daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:37:23.914845 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4103aad-73e0-48e7-9c5c-190f01c65daa admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:23.915129 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4103aad-73e0-48e7-9c5c-190f01c65daa admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:23.915399 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4103aad-73e0-48e7-9c5c-190f01c65daa admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:23.916056 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4103aad-73e0-48e7-9c5c-190f01c65daa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:37:23.918598 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4103aad-73e0-48e7-9c5c-190f01c65daa admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:37:23.944580 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1414/2839] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:37:23 2022] POST /identity/v3/projects => generated 375 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 03:37:23.948921 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c31dd51-4dfe-4e1d-a553-c14eedf28650 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:37:23.959432 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c31dd51-4dfe-4e1d-a553-c14eedf28650 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:37:24.014484 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c4f543-541d-4014-b0ba-2f9d781137ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:37:24.015076 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c4f543-541d-4014-b0ba-2f9d781137ff admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:24.015354 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c4f543-541d-4014-b0ba-2f9d781137ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:24.015653 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c4f543-541d-4014-b0ba-2f9d781137ff admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:24.016273 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c4f543-541d-4014-b0ba-2f9d781137ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:37:24.018179 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c4f543-541d-4014-b0ba-2f9d781137ff admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:37:24.039209 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1426/2840] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:37:23 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:37:24.043661 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4103aad-73e0-48e7-9c5c-190f01c65daa admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:37:24.050282 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:37:24.054329 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4103aad-73e0-48e7-9c5c-190f01c65daa admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:37:24.060160 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf57bdb-f2e1-43e6-a5ff-c01c4d276acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:37:24.060896 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf57bdb-f2e1-43e6-a5ff-c01c4d276acb admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:24.061384 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf57bdb-f2e1-43e6-a5ff-c01c4d276acb admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:24.061833 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf57bdb-f2e1-43e6-a5ff-c01c4d276acb admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:24.062579 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf57bdb-f2e1-43e6-a5ff-c01c4d276acb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:37:24.064534 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf57bdb-f2e1-43e6-a5ff-c01c4d276acb admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:37:24.075665 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1415/2841] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:37:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:37:24.079751 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c4f543-541d-4014-b0ba-2f9d781137ff admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:37:24.090005 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c4f543-541d-4014-b0ba-2f9d781137ff admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:37:24.094550 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e33f1f-9c47-41c5-8133-6af6e32db32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:37:24.095129 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e33f1f-9c47-41c5-8133-6af6e32db32b admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:24.095408 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e33f1f-9c47-41c5-8133-6af6e32db32b admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:24.095728 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e33f1f-9c47-41c5-8133-6af6e32db32b admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:24.096368 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e33f1f-9c47-41c5-8133-6af6e32db32b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:37:24.097926 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e33f1f-9c47-41c5-8133-6af6e32db32b admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:37:24.108131 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1427/2842] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:37:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:37:24.112207 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf57bdb-f2e1-43e6-a5ff-c01c4d276acb admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:37:24.122483 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf57bdb-f2e1-43e6-a5ff-c01c4d276acb admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:37:24.127237 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b8ba7c-5d4d-4429-8176-ebb9dbe17cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:37:24.127901 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b8ba7c-5d4d-4429-8176-ebb9dbe17cb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:24.128193 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b8ba7c-5d4d-4429-8176-ebb9dbe17cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:24.128485 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b8ba7c-5d4d-4429-8176-ebb9dbe17cb5 admin admin] PATH_INFO: `/v3/projects/80d7f9bac9184b619d2f032b59c0dcae/users/e78d74f798be49bcbe87941617238ee0/roles/04d0e4575a28440eb4349b4a6565e8b8` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:24.142896 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b8ba7c-5d4d-4429-8176-ebb9dbe17cb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80d7f9bac9184b619d2f032b59c0dcae, user_id=e78d74f798be49bcbe87941617238ee0, role_id=04d0e4575a28440eb4349b4a6565e8b8)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:37:24.145514 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b8ba7c-5d4d-4429-8176-ebb9dbe17cb5 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:37:24.158740 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1416/2843] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:37:24 2022] PUT /identity/v3/projects/80d7f9bac9184b619d2f032b59c0dcae/users/e78d74f798be49bcbe87941617238ee0/roles/04d0e4575a28440eb4349b4a6565e8b8 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:37:24.169613 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e794a1d-6174-4446-aeb3-2ed9c13e3fe7 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:24.169846 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e794a1d-6174-4446-aeb3-2ed9c13e3fe7 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:24.170132 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e794a1d-6174-4446-aeb3-2ed9c13e3fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:24.198541 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-0e794a1d-6174-4446-aeb3-2ed9c13e3fe7 None None] MFA Rules not processed for user `e78d74f798be49bcbe87941617238ee0`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:37:24.199794 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-0e794a1d-6174-4446-aeb3-2ed9c13e3fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:37:24.264323 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1428/2844] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:37:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:37:24.268829 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b8ba7c-5d4d-4429-8176-ebb9dbe17cb5 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:37:24.329672 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b8ba7c-5d4d-4429-8176-ebb9dbe17cb5 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:37:24.334289 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810706cf-5ad3-4512-a1de-373b5e9163bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:37:24.334880 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810706cf-5ad3-4512-a1de-373b5e9163bc admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:24.335159 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810706cf-5ad3-4512-a1de-373b5e9163bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:24.335432 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810706cf-5ad3-4512-a1de-373b5e9163bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:24.336084 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810706cf-5ad3-4512-a1de-373b5e9163bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:37:24.337947 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810706cf-5ad3-4512-a1de-373b5e9163bc admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:37:24.363969 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1417/2845] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:37:24 2022] POST /identity/v3/projects => generated 377 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 03:37:24.368083 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e794a1d-6174-4446-aeb3-2ed9c13e3fe7 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:37:24.379138 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e794a1d-6174-4446-aeb3-2ed9c13e3fe7 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:37:24.396869 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:37:24.438355 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f383bf0-79e7-4821-802c-2a6f91b3f7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:37:24.438885 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f383bf0-79e7-4821-802c-2a6f91b3f7ad admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:24.439169 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f383bf0-79e7-4821-802c-2a6f91b3f7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:24.439445 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f383bf0-79e7-4821-802c-2a6f91b3f7ad admin admin] PATH_INFO: `/v3/users` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:24.440100 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f383bf0-79e7-4821-802c-2a6f91b3f7ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:37:24.441996 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f383bf0-79e7-4821-802c-2a6f91b3f7ad admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:37:24.464853 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1429/2846] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:37:24 2022] POST /identity/v3/users => generated 295 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:37:24.468848 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810706cf-5ad3-4512-a1de-373b5e9163bc admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:37:24.480425 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810706cf-5ad3-4512-a1de-373b5e9163bc admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:37:24.485051 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d73ea3a-1a4f-40eb-8114-3c76d658621c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:37:24.485640 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73ea3a-1a4f-40eb-8114-3c76d658621c admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:24.485925 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73ea3a-1a4f-40eb-8114-3c76d658621c admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:24.486202 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73ea3a-1a4f-40eb-8114-3c76d658621c admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:24.486845 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d73ea3a-1a4f-40eb-8114-3c76d658621c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:37:24.488453 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d73ea3a-1a4f-40eb-8114-3c76d658621c admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:37:24.499027 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1418/2847] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:37:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:37:24.503240 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f383bf0-79e7-4821-802c-2a6f91b3f7ad admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:37:24.514085 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f383bf0-79e7-4821-802c-2a6f91b3f7ad admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:37:24.518870 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44565acd-f2fe-48b7-a64b-f0bdd8a32691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:37:24.519552 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44565acd-f2fe-48b7-a64b-f0bdd8a32691 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:24.519837 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44565acd-f2fe-48b7-a64b-f0bdd8a32691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:24.520111 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44565acd-f2fe-48b7-a64b-f0bdd8a32691 admin admin] PATH_INFO: `/v3/projects/8d87fad087a94984b329444e570b8d4c/users/e68d569390a44a74a79cfe867fa230a4/roles/fe9379cda35c4ff78576fe48b60bea3c` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:24.536553 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44565acd-f2fe-48b7-a64b-f0bdd8a32691 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d87fad087a94984b329444e570b8d4c, user_id=e68d569390a44a74a79cfe867fa230a4, role_id=fe9379cda35c4ff78576fe48b60bea3c)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:37:24.539203 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44565acd-f2fe-48b7-a64b-f0bdd8a32691 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:37:24.551944 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1430/2848] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:37:24 2022] PUT /identity/v3/projects/8d87fad087a94984b329444e570b8d4c/users/e68d569390a44a74a79cfe867fa230a4/roles/fe9379cda35c4ff78576fe48b60bea3c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:37:24.556003 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d73ea3a-1a4f-40eb-8114-3c76d658621c admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:37:24.566208 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d73ea3a-1a4f-40eb-8114-3c76d658621c admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:37:24.623736 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cfa494-332f-4d5d-94b4-2affa7d9828d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:37:24.624330 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cfa494-332f-4d5d-94b4-2affa7d9828d admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:24.624605 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cfa494-332f-4d5d-94b4-2affa7d9828d admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:24.624878 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cfa494-332f-4d5d-94b4-2affa7d9828d admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:24.625520 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cfa494-332f-4d5d-94b4-2affa7d9828d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:37:24.627073 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cfa494-332f-4d5d-94b4-2affa7d9828d admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:37:24.637785 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1419/2849] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:37:24 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:37:24.642125 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44565acd-f2fe-48b7-a64b-f0bdd8a32691 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:37:24.654073 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44565acd-f2fe-48b7-a64b-f0bdd8a32691 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:37:24.658632 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2605fd-de1f-4556-a714-2e9af45f76f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:37:24.659280 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2605fd-de1f-4556-a714-2e9af45f76f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:24.659656 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2605fd-de1f-4556-a714-2e9af45f76f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:24.659935 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2605fd-de1f-4556-a714-2e9af45f76f6 admin admin] PATH_INFO: `/v3/projects/8d87fad087a94984b329444e570b8d4c/users/e68d569390a44a74a79cfe867fa230a4/roles/fe9379cda35c4ff78576fe48b60bea3c` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:24.661841 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2605fd-de1f-4556-a714-2e9af45f76f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d87fad087a94984b329444e570b8d4c, user_id=e68d569390a44a74a79cfe867fa230a4, role_id=fe9379cda35c4ff78576fe48b60bea3c)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:37:24.664468 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2605fd-de1f-4556-a714-2e9af45f76f6 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:37:24.674636 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1431/2850] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:37:24 2022] PUT /identity/v3/projects/8d87fad087a94984b329444e570b8d4c/users/e68d569390a44a74a79cfe867fa230a4/roles/fe9379cda35c4ff78576fe48b60bea3c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:37:24.741021 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eebad8b-2a19-4a11-8098-012cc6048e9e None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:24.741306 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eebad8b-2a19-4a11-8098-012cc6048e9e None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:24.741611 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eebad8b-2a19-4a11-8098-012cc6048e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:24.770290 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-0eebad8b-2a19-4a11-8098-012cc6048e9e None None] MFA Rules not processed for user `e68d569390a44a74a79cfe867fa230a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:37:24.771512 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-0eebad8b-2a19-4a11-8098-012cc6048e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:37:24.799468 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:37:24.839950 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1420/2851] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:37:24 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:37:24.850854 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2605fd-de1f-4556-a714-2e9af45f76f6 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:37:24.852546 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-0b2605fd-de1f-4556-a714-2e9af45f76f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:37:24.908380 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2605fd-de1f-4556-a714-2e9af45f76f6 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:37:24.912006 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a247987-08cf-4964-b4c9-77e3ab165a97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f537aabf3d1040ff840b02616f839975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:37:24.912589 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a247987-08cf-4964-b4c9-77e3ab165a97 service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:24.912866 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a247987-08cf-4964-b4c9-77e3ab165a97 service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:24.913135 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a247987-08cf-4964-b4c9-77e3ab165a97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:24.972838 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a247987-08cf-4964-b4c9-77e3ab165a97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:37:24.974262 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a247987-08cf-4964-b4c9-77e3ab165a97 service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:37:24.982970 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1432/2852] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:37:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:37:26.543028 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eebad8b-2a19-4a11-8098-012cc6048e9e None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:37:26.544547 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-0eebad8b-2a19-4a11-8098-012cc6048e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:37:26.558058 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eebad8b-2a19-4a11-8098-012cc6048e9e None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:37:26.561681 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e9f840-a5ac-4230-859a-0b7d8b3ee5d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f537aabf3d1040ff840b02616f839975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:37:26.562307 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e9f840-a5ac-4230-859a-0b7d8b3ee5d9 service cinder] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:26.562591 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e9f840-a5ac-4230-859a-0b7d8b3ee5d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:26.562872 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e9f840-a5ac-4230-859a-0b7d8b3ee5d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:26.625760 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e9f840-a5ac-4230-859a-0b7d8b3ee5d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:37:26.627195 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e9f840-a5ac-4230-859a-0b7d8b3ee5d9 service cinder] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:37:26.637251 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1421/2853] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:37:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:37:27.175761 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a247987-08cf-4964-b4c9-77e3ab165a97 service cinder] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:37:27.185080 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a247987-08cf-4964-b4c9-77e3ab165a97 service cinder] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:37:27.188802 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb86819e-130f-46fe-80a4-26bf2c2b5a97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f537aabf3d1040ff840b02616f839975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:37:27.189394 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb86819e-130f-46fe-80a4-26bf2c2b5a97 service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:27.189812 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb86819e-130f-46fe-80a4-26bf2c2b5a97 service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:27.190094 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb86819e-130f-46fe-80a4-26bf2c2b5a97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:27.200003 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb86819e-130f-46fe-80a4-26bf2c2b5a97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:37:27.201397 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb86819e-130f-46fe-80a4-26bf2c2b5a97 service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:37:27.210610 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1433/2854] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:37:27 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:37:31.105382 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e9f840-a5ac-4230-859a-0b7d8b3ee5d9 service cinder] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:37:31.206149 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e9f840-a5ac-4230-859a-0b7d8b3ee5d9 service cinder] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:37:31.210678 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d420bbb2-533e-4fac-bf54-d259b754a142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:37:31.211302 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420bbb2-533e-4fac-bf54-d259b754a142 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:31.211606 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420bbb2-533e-4fac-bf54-d259b754a142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:31.211882 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420bbb2-533e-4fac-bf54-d259b754a142 admin admin] PATH_INFO: `/v3/users/67fdf34c5fdf43e88b23ba146e7440ea` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:31.212999 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d420bbb2-533e-4fac-bf54-d259b754a142 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67fdf34c5fdf43e88b23ba146e7440ea)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:37:31.214934 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d420bbb2-533e-4fac-bf54-d259b754a142 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:37:31.237577 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:37:31.263600 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-d420bbb2-533e-4fac-bf54-d259b754a142 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67fdf34c5fdf43e88b23ba146e7440ea'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:37:31.270331 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-d420bbb2-533e-4fac-bf54-d259b754a142 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67fdf34c5fdf43e88b23ba146e7440ea'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:37:31.277547 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-d420bbb2-533e-4fac-bf54-d259b754a142 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67fdf34c5fdf43e88b23ba146e7440ea'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:37:31.278176 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-d420bbb2-533e-4fac-bf54-d259b754a142 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67fdf34c5fdf43e88b23ba146e7440ea'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:37:31.290112 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-d420bbb2-533e-4fac-bf54-d259b754a142 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67fdf34c5fdf43e88b23ba146e7440ea'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:37:31.296639 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1422/2855] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:37:31 2022] DELETE /identity/v3/users/67fdf34c5fdf43e88b23ba146e7440ea => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:37:31.301124 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0cce91-87f3-4309-96f0-c682e5525c8c None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:31.301612 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0cce91-87f3-4309-96f0-c682e5525c8c None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:31.301722 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0cce91-87f3-4309-96f0-c682e5525c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:31.318288 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:37:31.352781 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-1e0cce91-87f3-4309-96f0-c682e5525c8c None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:37:31.354531 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-1e0cce91-87f3-4309-96f0-c682e5525c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:37:31.412627 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1434/2856] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:37:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:37:31.422674 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d420bbb2-533e-4fac-bf54-d259b754a142 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:37:31.424200 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-d420bbb2-533e-4fac-bf54-d259b754a142 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:37:31.497614 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d420bbb2-533e-4fac-bf54-d259b754a142 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:37:31.500611 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd944233-cb3f-4737-85dc-dfb724f3e061 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:37:31.501245 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd944233-cb3f-4737-85dc-dfb724f3e061 service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:31.501544 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd944233-cb3f-4737-85dc-dfb724f3e061 service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:31.501817 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd944233-cb3f-4737-85dc-dfb724f3e061 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:31.511585 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd944233-cb3f-4737-85dc-dfb724f3e061 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:37:31.513024 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd944233-cb3f-4737-85dc-dfb724f3e061 service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:37:31.522491 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1423/2857] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:37:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:37:31.856924 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0cce91-87f3-4309-96f0-c682e5525c8c None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:37:31.858399 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-1e0cce91-87f3-4309-96f0-c682e5525c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:37:31.870960 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0cce91-87f3-4309-96f0-c682e5525c8c None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:37:31.875867 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5c57c1-28ae-4fc6-9d69-3f41b8768a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:37:31.876634 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c57c1-28ae-4fc6-9d69-3f41b8768a95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:31.876985 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c57c1-28ae-4fc6-9d69-3f41b8768a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:31.877329 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c57c1-28ae-4fc6-9d69-3f41b8768a95 admin admin] PATH_INFO: `/v3/projects/5da72ae832704bf981696b27a03afa75` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:31.878613 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5c57c1-28ae-4fc6-9d69-3f41b8768a95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5da72ae832704bf981696b27a03afa75)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:37:31.880762 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5c57c1-28ae-4fc6-9d69-3f41b8768a95 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:37:31.941045 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-2d5c57c1-28ae-4fc6-9d69-3f41b8768a95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5da72ae832704bf981696b27a03afa75', 'request_id': 'req-2d5c57c1-28ae-4fc6-9d69-3f41b8768a95'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:37:31.946767 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-2d5c57c1-28ae-4fc6-9d69-3f41b8768a95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5da72ae832704bf981696b27a03afa75', 'request_id': 'req-2d5c57c1-28ae-4fc6-9d69-3f41b8768a95'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:37:31.953056 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-2d5c57c1-28ae-4fc6-9d69-3f41b8768a95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5da72ae832704bf981696b27a03afa75', 'request_id': 'req-2d5c57c1-28ae-4fc6-9d69-3f41b8768a95'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:37:31.964574 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-2d5c57c1-28ae-4fc6-9d69-3f41b8768a95 admin admin] The token cache is being invalidate because project 5da72ae832704bf981696b27a03afa75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:37:31.964873 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-2d5c57c1-28ae-4fc6-9d69-3f41b8768a95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:37:31.965529 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-2d5c57c1-28ae-4fc6-9d69-3f41b8768a95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:37:31.967046 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1435/2858] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:37:31 2022] DELETE /identity/v3/projects/5da72ae832704bf981696b27a03afa75 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:37:31.971084 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd944233-cb3f-4737-85dc-dfb724f3e061 service neutron] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:37:31.981278 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd944233-cb3f-4737-85dc-dfb724f3e061 service neutron] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:37:32.035402 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd57688a-39ac-4c55-b75f-211949e7d31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:37:32.035973 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd57688a-39ac-4c55-b75f-211949e7d31b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:32.036306 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd57688a-39ac-4c55-b75f-211949e7d31b admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:32.036611 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd57688a-39ac-4c55-b75f-211949e7d31b admin admin] PATH_INFO: `/v3/users/e78d74f798be49bcbe87941617238ee0` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:32.037860 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd57688a-39ac-4c55-b75f-211949e7d31b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e78d74f798be49bcbe87941617238ee0)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:37:32.039781 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd57688a-39ac-4c55-b75f-211949e7d31b admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:37:32.073475 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:37:32.087849 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-cd57688a-39ac-4c55-b75f-211949e7d31b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e78d74f798be49bcbe87941617238ee0'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:37:32.094807 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-cd57688a-39ac-4c55-b75f-211949e7d31b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e78d74f798be49bcbe87941617238ee0'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:37:32.102031 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-cd57688a-39ac-4c55-b75f-211949e7d31b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e78d74f798be49bcbe87941617238ee0'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:37:32.102703 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-cd57688a-39ac-4c55-b75f-211949e7d31b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e78d74f798be49bcbe87941617238ee0'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:37:32.118258 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-cd57688a-39ac-4c55-b75f-211949e7d31b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e78d74f798be49bcbe87941617238ee0'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:37:32.123715 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1424/2859] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:37:31 2022] DELETE /identity/v3/users/e78d74f798be49bcbe87941617238ee0 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:37:32.396837 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5c57c1-28ae-4fc6-9d69-3f41b8768a95 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:37:32.398313 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-2d5c57c1-28ae-4fc6-9d69-3f41b8768a95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:37:32.414222 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5c57c1-28ae-4fc6-9d69-3f41b8768a95 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:37:32.473271 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9547faa5-79a4-432c-8e68-0402559084e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:37:32.473894 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9547faa5-79a4-432c-8e68-0402559084e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:32.474196 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9547faa5-79a4-432c-8e68-0402559084e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:32.474473 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9547faa5-79a4-432c-8e68-0402559084e9 admin admin] PATH_INFO: `/v3/projects/80d7f9bac9184b619d2f032b59c0dcae` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:32.475614 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9547faa5-79a4-432c-8e68-0402559084e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80d7f9bac9184b619d2f032b59c0dcae)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:37:32.477499 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9547faa5-79a4-432c-8e68-0402559084e9 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:37:32.489052 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:37:32.524024 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-9547faa5-79a4-432c-8e68-0402559084e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80d7f9bac9184b619d2f032b59c0dcae', 'request_id': 'req-9547faa5-79a4-432c-8e68-0402559084e9'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:37:32.530237 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-9547faa5-79a4-432c-8e68-0402559084e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80d7f9bac9184b619d2f032b59c0dcae', 'request_id': 'req-9547faa5-79a4-432c-8e68-0402559084e9'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:37:32.536335 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-9547faa5-79a4-432c-8e68-0402559084e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80d7f9bac9184b619d2f032b59c0dcae', 'request_id': 'req-9547faa5-79a4-432c-8e68-0402559084e9'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:37:32.548495 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-9547faa5-79a4-432c-8e68-0402559084e9 admin admin] The token cache is being invalidate because project 80d7f9bac9184b619d2f032b59c0dcae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:37:32.548787 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-9547faa5-79a4-432c-8e68-0402559084e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:37:32.549413 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-9547faa5-79a4-432c-8e68-0402559084e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:37:32.550876 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1436/2860] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:37:32 2022] DELETE /identity/v3/projects/80d7f9bac9184b619d2f032b59c0dcae => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:37:32.554939 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd57688a-39ac-4c55-b75f-211949e7d31b admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:37:32.556445 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-cd57688a-39ac-4c55-b75f-211949e7d31b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:37:32.568984 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd57688a-39ac-4c55-b75f-211949e7d31b admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:37:32.626519 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e25e97d-48e9-4795-acf1-89e39594e05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:37:32.627071 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25e97d-48e9-4795-acf1-89e39594e05d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:32.627358 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25e97d-48e9-4795-acf1-89e39594e05d admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:32.627749 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25e97d-48e9-4795-acf1-89e39594e05d admin admin] PATH_INFO: `/v3/users/e68d569390a44a74a79cfe867fa230a4` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:32.628880 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e25e97d-48e9-4795-acf1-89e39594e05d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e68d569390a44a74a79cfe867fa230a4)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:37:32.630801 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e25e97d-48e9-4795-acf1-89e39594e05d admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:37:32.682341 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-0e25e97d-48e9-4795-acf1-89e39594e05d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e68d569390a44a74a79cfe867fa230a4'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:37:32.689563 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-0e25e97d-48e9-4795-acf1-89e39594e05d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e68d569390a44a74a79cfe867fa230a4'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:37:32.697152 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-0e25e97d-48e9-4795-acf1-89e39594e05d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e68d569390a44a74a79cfe867fa230a4'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:37:32.698549 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-0e25e97d-48e9-4795-acf1-89e39594e05d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e68d569390a44a74a79cfe867fa230a4'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:37:32.711812 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-0e25e97d-48e9-4795-acf1-89e39594e05d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e68d569390a44a74a79cfe867fa230a4'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:37:32.721474 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1425/2861] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:37:32 2022] DELETE /identity/v3/users/e68d569390a44a74a79cfe867fa230a4 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:37:32.995864 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9547faa5-79a4-432c-8e68-0402559084e9 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:37:32.997596 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-9547faa5-79a4-432c-8e68-0402559084e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:37:33.011837 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9547faa5-79a4-432c-8e68-0402559084e9 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:37:33.071120 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcfa938-0cb2-4e35-80c1-e5d269c1f0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:37:33.071796 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcfa938-0cb2-4e35-80c1-e5d269c1f0b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:33.072074 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcfa938-0cb2-4e35-80c1-e5d269c1f0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:33.072344 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcfa938-0cb2-4e35-80c1-e5d269c1f0b2 admin admin] PATH_INFO: `/v3/projects/8d87fad087a94984b329444e570b8d4c` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:33.074553 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcfa938-0cb2-4e35-80c1-e5d269c1f0b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d87fad087a94984b329444e570b8d4c)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:37:33.076731 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcfa938-0cb2-4e35-80c1-e5d269c1f0b2 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:37:33.123411 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-efcfa938-0cb2-4e35-80c1-e5d269c1f0b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d87fad087a94984b329444e570b8d4c', 'request_id': 'req-efcfa938-0cb2-4e35-80c1-e5d269c1f0b2'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:37:33.128768 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-efcfa938-0cb2-4e35-80c1-e5d269c1f0b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d87fad087a94984b329444e570b8d4c', 'request_id': 'req-efcfa938-0cb2-4e35-80c1-e5d269c1f0b2'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:37:33.135004 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-efcfa938-0cb2-4e35-80c1-e5d269c1f0b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d87fad087a94984b329444e570b8d4c', 'request_id': 'req-efcfa938-0cb2-4e35-80c1-e5d269c1f0b2'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:37:33.147304 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-efcfa938-0cb2-4e35-80c1-e5d269c1f0b2 admin admin] The token cache is being invalidate because project 8d87fad087a94984b329444e570b8d4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:37:33.147619 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-efcfa938-0cb2-4e35-80c1-e5d269c1f0b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:37:33.148251 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-efcfa938-0cb2-4e35-80c1-e5d269c1f0b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:37:33.149685 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1437/2862] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:37:32 2022] DELETE /identity/v3/projects/8d87fad087a94984b329444e570b8d4c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:37:33.154614 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9a9a98-d932-4596-bd1e-16270e3c55c5 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:33.155090 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9a9a98-d932-4596-bd1e-16270e3c55c5 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:33.155090 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9a9a98-d932-4596-bd1e-16270e3c55c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:33.192094 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:37:33.206755 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-ff9a9a98-d932-4596-bd1e-16270e3c55c5 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:37:33.207988 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-ff9a9a98-d932-4596-bd1e-16270e3c55c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:37:33.266633 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1426/2863] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:37:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:37:33.275236 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527881fb-e2a4-40e9-8643-8d9523f37ba8 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:33.275592 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527881fb-e2a4-40e9-8643-8d9523f37ba8 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:33.275901 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527881fb-e2a4-40e9-8643-8d9523f37ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:33.296290 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-527881fb-e2a4-40e9-8643-8d9523f37ba8 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:37:33.297480 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-527881fb-e2a4-40e9-8643-8d9523f37ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:37:33.305420 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1438/2864] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:37:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:37:33.310198 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9a9a98-d932-4596-bd1e-16270e3c55c5 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:37:33.320094 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9a9a98-d932-4596-bd1e-16270e3c55c5 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:37:33.324674 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a2292-0a88-4c46-b0fe-0c5e423a6b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:37:33.325256 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a2292-0a88-4c46-b0fe-0c5e423a6b8d admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:33.325538 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a2292-0a88-4c46-b0fe-0c5e423a6b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:33.325811 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a2292-0a88-4c46-b0fe-0c5e423a6b8d admin admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:33.326446 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2a2292-0a88-4c46-b0fe-0c5e423a6b8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:37:33.326776 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2a2292-0a88-4c46-b0fe-0c5e423a6b8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:37:33.328393 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2a2292-0a88-4c46-b0fe-0c5e423a6b8d admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:37:33.340001 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1427/2865] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 03:37:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 03:37:33.344031 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527881fb-e2a4-40e9-8643-8d9523f37ba8 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:37:33.353475 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527881fb-e2a4-40e9-8643-8d9523f37ba8 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:37:33.358813 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e61584a-7971-401c-a268-0f937d7ba2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:37:33.359406 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e61584a-7971-401c-a268-0f937d7ba2ad admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:33.359717 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e61584a-7971-401c-a268-0f937d7ba2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:33.359994 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e61584a-7971-401c-a268-0f937d7ba2ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:33.360692 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e61584a-7971-401c-a268-0f937d7ba2ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:37:33.362566 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e61584a-7971-401c-a268-0f937d7ba2ad admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:37:33.393837 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1439/2866] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:37:33 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 03:37:33.395080 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a2292-0a88-4c46-b0fe-0c5e423a6b8d admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:37:33.405577 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a2292-0a88-4c46-b0fe-0c5e423a6b8d admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:37:33.466170 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5fa098-899e-40f5-ad78-96387b5e9bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:37:33.466769 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5fa098-899e-40f5-ad78-96387b5e9bd3 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:33.467054 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5fa098-899e-40f5-ad78-96387b5e9bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:33.467365 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5fa098-899e-40f5-ad78-96387b5e9bd3 admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:33.467979 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5fa098-899e-40f5-ad78-96387b5e9bd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:37:33.469898 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5fa098-899e-40f5-ad78-96387b5e9bd3 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:37:33.492285 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1428/2867] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:37:33 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:37:33.497043 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e61584a-7971-401c-a268-0f937d7ba2ad admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:37:33.502359 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:37:33.509108 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e61584a-7971-401c-a268-0f937d7ba2ad admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:37:33.515736 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40467230-8cde-444d-9bf5-806a21b74e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:37:33.516331 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40467230-8cde-444d-9bf5-806a21b74e5d admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:33.516610 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40467230-8cde-444d-9bf5-806a21b74e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:33.516879 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40467230-8cde-444d-9bf5-806a21b74e5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:33.517520 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40467230-8cde-444d-9bf5-806a21b74e5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:37:33.519133 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40467230-8cde-444d-9bf5-806a21b74e5d admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:37:33.529879 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1440/2868] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:37:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 03:37:33.533848 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5fa098-899e-40f5-ad78-96387b5e9bd3 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:37:33.545599 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5fa098-899e-40f5-ad78-96387b5e9bd3 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:37:33.550503 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299484ca-53d3-4958-b347-34ce6742288a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:37:33.551088 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299484ca-53d3-4958-b347-34ce6742288a admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:33.551371 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299484ca-53d3-4958-b347-34ce6742288a admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:33.551681 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299484ca-53d3-4958-b347-34ce6742288a admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:33.552324 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299484ca-53d3-4958-b347-34ce6742288a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:37:33.553926 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299484ca-53d3-4958-b347-34ce6742288a admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:37:33.565585 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1429/2869] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:37:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:37:33.570005 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40467230-8cde-444d-9bf5-806a21b74e5d admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:37:33.580446 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40467230-8cde-444d-9bf5-806a21b74e5d admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:37:33.585052 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e017f605-28b0-44b6-8211-be6878abeecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:37:33.585689 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e017f605-28b0-44b6-8211-be6878abeecf admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:33.585971 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e017f605-28b0-44b6-8211-be6878abeecf admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:33.586243 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e017f605-28b0-44b6-8211-be6878abeecf admin admin] PATH_INFO: `/v3/projects/eb41b9a5d0b44280a80b3a75c9ea80e9/users/6cec265ee51f488f9d6c6b2bbc7637f6/roles/04d0e4575a28440eb4349b4a6565e8b8` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:33.601506 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e017f605-28b0-44b6-8211-be6878abeecf admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb41b9a5d0b44280a80b3a75c9ea80e9, user_id=6cec265ee51f488f9d6c6b2bbc7637f6, role_id=04d0e4575a28440eb4349b4a6565e8b8)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:37:33.604740 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e017f605-28b0-44b6-8211-be6878abeecf admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:37:33.617498 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1441/2870] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:37:33 2022] PUT /identity/v3/projects/eb41b9a5d0b44280a80b3a75c9ea80e9/users/6cec265ee51f488f9d6c6b2bbc7637f6/roles/04d0e4575a28440eb4349b4a6565e8b8 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:37:33.629726 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a7137-fe25-40d1-9a14-b7f395288c68 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:33.630015 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a7137-fe25-40d1-9a14-b7f395288c68 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:33.630298 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a7137-fe25-40d1-9a14-b7f395288c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:33.661312 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-189a7137-fe25-40d1-9a14-b7f395288c68 None None] MFA Rules not processed for user `6cec265ee51f488f9d6c6b2bbc7637f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:37:33.662485 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-189a7137-fe25-40d1-9a14-b7f395288c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:37:33.720768 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:37:33.725908 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1430/2871] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:37:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:37:33.737129 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e017f605-28b0-44b6-8211-be6878abeecf admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:37:33.738891 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-e017f605-28b0-44b6-8211-be6878abeecf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:37:33.799978 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e017f605-28b0-44b6-8211-be6878abeecf admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:37:33.803629 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a5c435-9274-4bf4-98ed-311e18cd8a3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f537aabf3d1040ff840b02616f839975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:37:33.804233 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a5c435-9274-4bf4-98ed-311e18cd8a3d service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:33.804519 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a5c435-9274-4bf4-98ed-311e18cd8a3d service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:33.804796 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a5c435-9274-4bf4-98ed-311e18cd8a3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:33.813616 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a5c435-9274-4bf4-98ed-311e18cd8a3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:37:33.815020 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a5c435-9274-4bf4-98ed-311e18cd8a3d service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:37:33.825007 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1442/2872] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:37:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:37:35.185624 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13746422-3b6c-4d69-8287-74b4da00a240 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:35.186185 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13746422-3b6c-4d69-8287-74b4da00a240 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:35.186185 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13746422-3b6c-4d69-8287-74b4da00a240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:35.205694 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-13746422-3b6c-4d69-8287-74b4da00a240 None None] MFA Rules not processed for user `6cec265ee51f488f9d6c6b2bbc7637f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:37:35.206915 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-13746422-3b6c-4d69-8287-74b4da00a240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:37:35.214417 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1431/2873] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:37:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:37:43.820103 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=40,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:37:45.200805 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=4 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:37:47.675218 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a5c435-9274-4bf4-98ed-311e18cd8a3d service cinder] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:37:47.676678 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-e8a5c435-9274-4bf4-98ed-311e18cd8a3d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:37:47.770589 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a5c435-9274-4bf4-98ed-311e18cd8a3d service cinder] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:37:47.775517 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c556ddef-0f77-47f9-a826-03fba00044a2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94513f6cd19f495e842deb3c13c3e4d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:37:47.776839 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c556ddef-0f77-47f9-a826-03fba00044a2 service placement] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:47.777124 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c556ddef-0f77-47f9-a826-03fba00044a2 service placement] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:47.777402 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c556ddef-0f77-47f9-a826-03fba00044a2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:47.779112 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-c556ddef-0f77-47f9-a826-03fba00044a2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:37:47.790445 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c556ddef-0f77-47f9-a826-03fba00044a2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:37:47.792170 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c556ddef-0f77-47f9-a826-03fba00044a2 service placement] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:37:47.802142 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1443/2874] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:37:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:37:49.537520 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754610a-ffed-42f7-99fd-75f2c4a4cc87 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:49.537994 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754610a-ffed-42f7-99fd-75f2c4a4cc87 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:49.538112 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754610a-ffed-42f7-99fd-75f2c4a4cc87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:49.567050 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-8754610a-ffed-42f7-99fd-75f2c4a4cc87 None None] MFA Rules not processed for user `bef61ef12079495ba72b7fcd2717aca2`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:37:49.568282 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-8754610a-ffed-42f7-99fd-75f2c4a4cc87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:37:49.631397 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1432/2875] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Oct 4 03:37:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 03:37:49.670817 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c556ddef-0f77-47f9-a826-03fba00044a2 service placement] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:37:49.672285 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-c556ddef-0f77-47f9-a826-03fba00044a2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:37:49.742704 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c556ddef-0f77-47f9-a826-03fba00044a2 service placement] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:37:49.748529 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e6138d-f062-447d-8266-a87711f829ce service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8da6bacc8f432e8f48bb99c7aede11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:37:49.749148 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e6138d-f062-447d-8266-a87711f829ce service swift] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:49.749432 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e6138d-f062-447d-8266-a87711f829ce service swift] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:49.749706 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e6138d-f062-447d-8266-a87711f829ce service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:49.757580 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e6138d-f062-447d-8266-a87711f829ce service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:37:49.759137 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e6138d-f062-447d-8266-a87711f829ce service swift] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:37:49.768197 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1444/2876] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Oct 4 03:37:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 03:37:50.266094 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b0cfc-8f40-4e86-be44-4a00486f497a None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:50.266389 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b0cfc-8f40-4e86-be44-4a00486f497a None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:50.266667 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b0cfc-8f40-4e86-be44-4a00486f497a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:50.285753 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-c18b0cfc-8f40-4e86-be44-4a00486f497a None None] MFA Rules not processed for user `bef61ef12079495ba72b7fcd2717aca2`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:37:50.286952 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-c18b0cfc-8f40-4e86-be44-4a00486f497a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:37:50.294187 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1433/2877] 10.222.0.25 () {58 vars in 967 bytes} [Tue Oct 4 03:37:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 03:37:50.306323 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e6138d-f062-447d-8266-a87711f829ce service swift] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:37:50.317358 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e6138d-f062-447d-8266-a87711f829ce service swift] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:37:50.322596 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b084be7a-ae25-4d97-ba6b-be232a1d3340 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8da6bacc8f432e8f48bb99c7aede11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:37:50.323321 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b084be7a-ae25-4d97-ba6b-be232a1d3340 service swift] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:50.323653 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b084be7a-ae25-4d97-ba6b-be232a1d3340 service swift] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:50.323928 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b084be7a-ae25-4d97-ba6b-be232a1d3340 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:50.331759 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b084be7a-ae25-4d97-ba6b-be232a1d3340 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:37:50.333298 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b084be7a-ae25-4d97-ba6b-be232a1d3340 service swift] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:37:50.341752 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1445/2878] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Oct 4 03:37:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 03:37:50.566581 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b5f5b-f0d6-4fde-9c9f-389af214c01a None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:50.567076 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b5f5b-f0d6-4fde-9c9f-389af214c01a None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:50.567186 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b5f5b-f0d6-4fde-9c9f-389af214c01a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:50.587151 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-bf4b5f5b-f0d6-4fde-9c9f-389af214c01a None None] MFA Rules not processed for user `bef61ef12079495ba72b7fcd2717aca2`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:37:50.588382 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-bf4b5f5b-f0d6-4fde-9c9f-389af214c01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:37:50.595532 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1434/2879] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Oct 4 03:37:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:37:50.607929 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b084be7a-ae25-4d97-ba6b-be232a1d3340 service swift] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:37:50.618352 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b084be7a-ae25-4d97-ba6b-be232a1d3340 service swift] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:37:50.624035 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42287958-df2c-407c-bd6b-a61e36640516 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8da6bacc8f432e8f48bb99c7aede11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:37:50.624619 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42287958-df2c-407c-bd6b-a61e36640516 service swift] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:50.624899 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42287958-df2c-407c-bd6b-a61e36640516 service swift] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:50.625176 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42287958-df2c-407c-bd6b-a61e36640516 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:50.633161 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42287958-df2c-407c-bd6b-a61e36640516 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:37:50.634726 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42287958-df2c-407c-bd6b-a61e36640516 service swift] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:37:50.643254 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1446/2880] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Oct 4 03:37:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 03:37:50.974594 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88ed5b-cf01-4150-8492-3e2a66e59cc2 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:50.974878 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88ed5b-cf01-4150-8492-3e2a66e59cc2 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:50.975148 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88ed5b-cf01-4150-8492-3e2a66e59cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:50.996118 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-2e88ed5b-cf01-4150-8492-3e2a66e59cc2 None None] MFA Rules not processed for user `bef61ef12079495ba72b7fcd2717aca2`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:37:50.997888 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-2e88ed5b-cf01-4150-8492-3e2a66e59cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:37:51.008439 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1435/2881] 10.222.0.25 () {58 vars in 967 bytes} [Tue Oct 4 03:37:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:37:51.021091 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42287958-df2c-407c-bd6b-a61e36640516 service swift] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:37:51.032147 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42287958-df2c-407c-bd6b-a61e36640516 service swift] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:37:51.037221 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c3bdd3-1375-4055-9d25-c28078b23fd3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8da6bacc8f432e8f48bb99c7aede11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:37:51.037836 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c3bdd3-1375-4055-9d25-c28078b23fd3 service swift] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:51.038119 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c3bdd3-1375-4055-9d25-c28078b23fd3 service swift] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:51.038395 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c3bdd3-1375-4055-9d25-c28078b23fd3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:51.047103 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c3bdd3-1375-4055-9d25-c28078b23fd3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:37:51.048701 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c3bdd3-1375-4055-9d25-c28078b23fd3 service swift] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:37:51.056613 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1447/2882] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Oct 4 03:37:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 03:37:53.153890 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e88ed5b-cf01-4150-8492-3e2a66e59cc2 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:37:53.215838 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e88ed5b-cf01-4150-8492-3e2a66e59cc2 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:37:53.220322 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb13022-5787-4f82-85b8-78a647eb351d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:37:53.220937 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb13022-5787-4f82-85b8-78a647eb351d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:53.221217 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb13022-5787-4f82-85b8-78a647eb351d admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:53.221489 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb13022-5787-4f82-85b8-78a647eb351d admin admin] PATH_INFO: `/v3/users/6cec265ee51f488f9d6c6b2bbc7637f6` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:53.222613 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb13022-5787-4f82-85b8-78a647eb351d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cec265ee51f488f9d6c6b2bbc7637f6)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:37:53.224588 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb13022-5787-4f82-85b8-78a647eb351d admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:37:53.271154 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-5fb13022-5787-4f82-85b8-78a647eb351d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cec265ee51f488f9d6c6b2bbc7637f6'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:37:53.278053 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-5fb13022-5787-4f82-85b8-78a647eb351d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cec265ee51f488f9d6c6b2bbc7637f6'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:37:53.284510 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-5fb13022-5787-4f82-85b8-78a647eb351d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cec265ee51f488f9d6c6b2bbc7637f6'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:37:53.285146 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-5fb13022-5787-4f82-85b8-78a647eb351d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cec265ee51f488f9d6c6b2bbc7637f6'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:37:53.292042 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:37:53.298239 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-5fb13022-5787-4f82-85b8-78a647eb351d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cec265ee51f488f9d6c6b2bbc7637f6'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:37:53.304758 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1436/2883] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:37:53 2022] DELETE /identity/v3/users/6cec265ee51f488f9d6c6b2bbc7637f6 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:37:53.309789 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a6f167-83d1-4ce9-a574-b5ed61191590 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:53.310259 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a6f167-83d1-4ce9-a574-b5ed61191590 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:53.310359 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a6f167-83d1-4ce9-a574-b5ed61191590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:53.329947 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-51a6f167-83d1-4ce9-a574-b5ed61191590 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:37:53.331150 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-51a6f167-83d1-4ce9-a574-b5ed61191590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:37:53.343356 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=100 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:37:53.389548 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1448/2884] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:37:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:37:53.399509 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb13022-5787-4f82-85b8-78a647eb351d admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:37:53.400910 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-5fb13022-5787-4f82-85b8-78a647eb351d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:37:53.481356 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb13022-5787-4f82-85b8-78a647eb351d admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:37:53.484998 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedfbe09-7a3d-4597-abbb-143c577fec54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:37:53.485595 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedfbe09-7a3d-4597-abbb-143c577fec54 service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:53.485878 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedfbe09-7a3d-4597-abbb-143c577fec54 service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:53.486150 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedfbe09-7a3d-4597-abbb-143c577fec54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:53.495685 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedfbe09-7a3d-4597-abbb-143c577fec54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:37:53.497182 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedfbe09-7a3d-4597-abbb-143c577fec54 service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:37:53.506390 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1437/2885] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:37:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:37:53.672712 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a6f167-83d1-4ce9-a574-b5ed61191590 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:37:53.674246 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-51a6f167-83d1-4ce9-a574-b5ed61191590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:37:53.688756 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a6f167-83d1-4ce9-a574-b5ed61191590 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:37:53.693395 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64bffbb-2657-4e08-912c-4200adf53965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:37:53.694027 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64bffbb-2657-4e08-912c-4200adf53965 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:53.695120 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64bffbb-2657-4e08-912c-4200adf53965 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:53.695410 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64bffbb-2657-4e08-912c-4200adf53965 admin admin] PATH_INFO: `/v3/projects/eb41b9a5d0b44280a80b3a75c9ea80e9` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:53.696900 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64bffbb-2657-4e08-912c-4200adf53965 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb41b9a5d0b44280a80b3a75c9ea80e9)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:37:53.699463 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64bffbb-2657-4e08-912c-4200adf53965 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:37:53.748730 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-d64bffbb-2657-4e08-912c-4200adf53965 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb41b9a5d0b44280a80b3a75c9ea80e9', 'request_id': 'req-d64bffbb-2657-4e08-912c-4200adf53965'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:37:53.754497 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-d64bffbb-2657-4e08-912c-4200adf53965 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb41b9a5d0b44280a80b3a75c9ea80e9', 'request_id': 'req-d64bffbb-2657-4e08-912c-4200adf53965'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:37:53.761366 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-d64bffbb-2657-4e08-912c-4200adf53965 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb41b9a5d0b44280a80b3a75c9ea80e9', 'request_id': 'req-d64bffbb-2657-4e08-912c-4200adf53965'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:37:53.775195 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-d64bffbb-2657-4e08-912c-4200adf53965 admin admin] The token cache is being invalidate because project eb41b9a5d0b44280a80b3a75c9ea80e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:37:53.775474 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-d64bffbb-2657-4e08-912c-4200adf53965 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:37:53.776388 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-d64bffbb-2657-4e08-912c-4200adf53965 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:37:53.778126 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1449/2886] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:37:53 2022] DELETE /identity/v3/projects/eb41b9a5d0b44280a80b3a75c9ea80e9 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 03:37:53.783395 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbede353-858e-4165-8192-459c6bc42ffc None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:53.783725 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbede353-858e-4165-8192-459c6bc42ffc None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:53.784000 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbede353-858e-4165-8192-459c6bc42ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:53.804032 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-dbede353-858e-4165-8192-459c6bc42ffc None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:37:53.805219 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-dbede353-858e-4165-8192-459c6bc42ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:37:53.863038 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1438/2887] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:37:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:37:53.872539 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa99d7-16fb-4508-8b1f-6c3578e6a9fa None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:53.872832 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa99d7-16fb-4508-8b1f-6c3578e6a9fa None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:53.873111 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa99d7-16fb-4508-8b1f-6c3578e6a9fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:53.893033 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-78aa99d7-16fb-4508-8b1f-6c3578e6a9fa None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:37:53.894235 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-78aa99d7-16fb-4508-8b1f-6c3578e6a9fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:37:53.902999 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1450/2888] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:37:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:37:53.907199 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbede353-858e-4165-8192-459c6bc42ffc None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:37:53.917574 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbede353-858e-4165-8192-459c6bc42ffc None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:37:53.922099 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d9926-cd03-40ff-97f8-9246d60478bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:37:53.922684 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d9926-cd03-40ff-97f8-9246d60478bf admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:53.922970 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d9926-cd03-40ff-97f8-9246d60478bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:53.923247 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d9926-cd03-40ff-97f8-9246d60478bf admin admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:53.923923 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747d9926-cd03-40ff-97f8-9246d60478bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:37:53.924229 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747d9926-cd03-40ff-97f8-9246d60478bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:37:53.925813 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747d9926-cd03-40ff-97f8-9246d60478bf admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:37:53.937082 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1439/2889] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 03:37:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:37:53.941423 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aa99d7-16fb-4508-8b1f-6c3578e6a9fa None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:37:53.951058 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aa99d7-16fb-4508-8b1f-6c3578e6a9fa None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:37:53.955665 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9701cb5f-a950-4044-bc4c-9be3b35a5573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:37:53.956244 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701cb5f-a950-4044-bc4c-9be3b35a5573 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:53.956522 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701cb5f-a950-4044-bc4c-9be3b35a5573 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:53.956793 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701cb5f-a950-4044-bc4c-9be3b35a5573 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:53.957410 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9701cb5f-a950-4044-bc4c-9be3b35a5573 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:37:53.959276 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9701cb5f-a950-4044-bc4c-9be3b35a5573 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:37:53.986555 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1451/2890] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:37:53 2022] POST /identity/v3/projects => generated 391 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:37:53.990698 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d9926-cd03-40ff-97f8-9246d60478bf admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:37:54.000641 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d9926-cd03-40ff-97f8-9246d60478bf admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:37:54.055938 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d93036f-7912-46d6-a94e-2c8540141470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:37:54.056540 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d93036f-7912-46d6-a94e-2c8540141470 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:54.056820 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d93036f-7912-46d6-a94e-2c8540141470 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:54.057093 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d93036f-7912-46d6-a94e-2c8540141470 admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:54.057752 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d93036f-7912-46d6-a94e-2c8540141470 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:37:54.059685 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d93036f-7912-46d6-a94e-2c8540141470 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:37:54.067538 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:37:54.081493 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1440/2891] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:37:53 2022] POST /identity/v3/users => generated 296 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 03:37:54.085785 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9701cb5f-a950-4044-bc4c-9be3b35a5573 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:37:54.096707 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9701cb5f-a950-4044-bc4c-9be3b35a5573 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:37:54.101280 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08c2060-2ce3-4de9-8e36-b98ee81df0a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:37:54.101868 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c2060-2ce3-4de9-8e36-b98ee81df0a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:54.102149 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c2060-2ce3-4de9-8e36-b98ee81df0a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:54.102422 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c2060-2ce3-4de9-8e36-b98ee81df0a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:54.103085 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08c2060-2ce3-4de9-8e36-b98ee81df0a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:37:54.105828 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08c2060-2ce3-4de9-8e36-b98ee81df0a0 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:37:54.115652 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1452/2892] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:37:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:37:54.119624 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d93036f-7912-46d6-a94e-2c8540141470 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:37:54.129418 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d93036f-7912-46d6-a94e-2c8540141470 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:37:54.133957 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e96756-46b9-4757-bdf3-a96bee635a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:37:54.134541 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e96756-46b9-4757-bdf3-a96bee635a40 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:54.134818 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e96756-46b9-4757-bdf3-a96bee635a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:54.135091 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e96756-46b9-4757-bdf3-a96bee635a40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:54.135796 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e96756-46b9-4757-bdf3-a96bee635a40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:37:54.137394 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e96756-46b9-4757-bdf3-a96bee635a40 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:37:54.147743 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1441/2893] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:37:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:37:54.152506 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08c2060-2ce3-4de9-8e36-b98ee81df0a0 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:37:54.162342 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08c2060-2ce3-4de9-8e36-b98ee81df0a0 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:37:54.167857 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b014e5b0-e1ce-45dc-b9ca-0ab63bdaabbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:37:54.168546 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014e5b0-e1ce-45dc-b9ca-0ab63bdaabbe admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:54.168875 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014e5b0-e1ce-45dc-b9ca-0ab63bdaabbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:54.169244 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014e5b0-e1ce-45dc-b9ca-0ab63bdaabbe admin admin] PATH_INFO: `/v3/projects/6b707504ab524dd6819136a8d51e5716/users/6f5bb55164ba4c0e8815c693c17f8a61/roles/04d0e4575a28440eb4349b4a6565e8b8` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:54.184114 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b014e5b0-e1ce-45dc-b9ca-0ab63bdaabbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b707504ab524dd6819136a8d51e5716, user_id=6f5bb55164ba4c0e8815c693c17f8a61, role_id=04d0e4575a28440eb4349b4a6565e8b8)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:37:54.186721 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b014e5b0-e1ce-45dc-b9ca-0ab63bdaabbe admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:37:54.199692 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1453/2894] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:37:54 2022] PUT /identity/v3/projects/6b707504ab524dd6819136a8d51e5716/users/6f5bb55164ba4c0e8815c693c17f8a61/roles/04d0e4575a28440eb4349b4a6565e8b8 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:37:54.209864 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f35ce85-2b31-4522-97a7-b6fc4555246a None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:54.210325 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f35ce85-2b31-4522-97a7-b6fc4555246a None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:54.210421 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f35ce85-2b31-4522-97a7-b6fc4555246a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:54.239560 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-4f35ce85-2b31-4522-97a7-b6fc4555246a None None] MFA Rules not processed for user `6f5bb55164ba4c0e8815c693c17f8a61`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:37:54.240759 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-4f35ce85-2b31-4522-97a7-b6fc4555246a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:37:54.306730 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1442/2895] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:37:54 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:37:54.319728 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b014e5b0-e1ce-45dc-b9ca-0ab63bdaabbe admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:37:54.321508 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-b014e5b0-e1ce-45dc-b9ca-0ab63bdaabbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:37:54.366633 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:37:54.403471 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b014e5b0-e1ce-45dc-b9ca-0ab63bdaabbe admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:37:54.407122 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2959a66f-b0ef-4c9c-b93a-aacf5ff657a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f537aabf3d1040ff840b02616f839975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:37:54.407761 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2959a66f-b0ef-4c9c-b93a-aacf5ff657a3 service cinder] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:37:54.408040 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2959a66f-b0ef-4c9c-b93a-aacf5ff657a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:37:54.408315 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2959a66f-b0ef-4c9c-b93a-aacf5ff657a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:37:54.416391 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2959a66f-b0ef-4c9c-b93a-aacf5ff657a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:37:54.417920 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2959a66f-b0ef-4c9c-b93a-aacf5ff657a3 service cinder] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:37:54.426478 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1454/2896] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:37:54 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:38:04.303378 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:INSERT=3,keystone:SELECT=39 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:38:04.422551 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=17 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:38:04.676982 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f35ce85-2b31-4522-97a7-b6fc4555246a None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:38:04.739864 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f35ce85-2b31-4522-97a7-b6fc4555246a None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:38:04.744417 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829d82f9-1a98-43c4-b03d-27b42eec9e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:38:04.745034 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d82f9-1a98-43c4-b03d-27b42eec9e86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:38:04.745318 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d82f9-1a98-43c4-b03d-27b42eec9e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:38:04.745597 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d82f9-1a98-43c4-b03d-27b42eec9e86 admin admin] PATH_INFO: `/v3/users/6f5bb55164ba4c0e8815c693c17f8a61` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:38:04.746807 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829d82f9-1a98-43c4-b03d-27b42eec9e86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f5bb55164ba4c0e8815c693c17f8a61)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:38:04.748751 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829d82f9-1a98-43c4-b03d-27b42eec9e86 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:38:04.794671 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-829d82f9-1a98-43c4-b03d-27b42eec9e86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f5bb55164ba4c0e8815c693c17f8a61'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:38:04.801384 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-829d82f9-1a98-43c4-b03d-27b42eec9e86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f5bb55164ba4c0e8815c693c17f8a61'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:38:04.808136 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-829d82f9-1a98-43c4-b03d-27b42eec9e86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f5bb55164ba4c0e8815c693c17f8a61'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:38:04.808839 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-829d82f9-1a98-43c4-b03d-27b42eec9e86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f5bb55164ba4c0e8815c693c17f8a61'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:38:04.820738 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-829d82f9-1a98-43c4-b03d-27b42eec9e86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f5bb55164ba4c0e8815c693c17f8a61'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:38:04.827298 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1443/2897] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:38:04 2022] DELETE /identity/v3/users/6f5bb55164ba4c0e8815c693c17f8a61 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:38:04.831750 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead240a1-2bf3-47cf-8fe2-d95d6b1f0dad None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:38:04.832185 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead240a1-2bf3-47cf-8fe2-d95d6b1f0dad None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:38:04.832531 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead240a1-2bf3-47cf-8fe2-d95d6b1f0dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:38:04.852959 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-ead240a1-2bf3-47cf-8fe2-d95d6b1f0dad None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:38:04.854172 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-ead240a1-2bf3-47cf-8fe2-d95d6b1f0dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:38:04.912388 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1455/2898] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:38:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:38:04.922082 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829d82f9-1a98-43c4-b03d-27b42eec9e86 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:38:04.923547 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-829d82f9-1a98-43c4-b03d-27b42eec9e86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:38:04.982490 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829d82f9-1a98-43c4-b03d-27b42eec9e86 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:38:04.986095 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351af464-0ff8-4372-8078-6d8f93f227d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:38:04.986692 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351af464-0ff8-4372-8078-6d8f93f227d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:38:04.986978 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351af464-0ff8-4372-8078-6d8f93f227d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:38:04.987254 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351af464-0ff8-4372-8078-6d8f93f227d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:38:04.996203 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351af464-0ff8-4372-8078-6d8f93f227d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:38:04.997948 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351af464-0ff8-4372-8078-6d8f93f227d1 service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:38:05.007268 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1444/2899] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:38:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:38:05.271898 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead240a1-2bf3-47cf-8fe2-d95d6b1f0dad None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:38:05.273334 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-ead240a1-2bf3-47cf-8fe2-d95d6b1f0dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:38:05.285284 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead240a1-2bf3-47cf-8fe2-d95d6b1f0dad None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:38:05.291269 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05945b03-4106-478b-bb12-6c1b15d8bc83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:38:05.292104 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05945b03-4106-478b-bb12-6c1b15d8bc83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:38:05.292391 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05945b03-4106-478b-bb12-6c1b15d8bc83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:38:05.292667 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05945b03-4106-478b-bb12-6c1b15d8bc83 admin admin] PATH_INFO: `/v3/projects/6b707504ab524dd6819136a8d51e5716` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:38:05.293941 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05945b03-4106-478b-bb12-6c1b15d8bc83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b707504ab524dd6819136a8d51e5716)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:38:05.296496 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05945b03-4106-478b-bb12-6c1b15d8bc83 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:38:05.345151 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-05945b03-4106-478b-bb12-6c1b15d8bc83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b707504ab524dd6819136a8d51e5716', 'request_id': 'req-05945b03-4106-478b-bb12-6c1b15d8bc83'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:38:05.350512 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-05945b03-4106-478b-bb12-6c1b15d8bc83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b707504ab524dd6819136a8d51e5716', 'request_id': 'req-05945b03-4106-478b-bb12-6c1b15d8bc83'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:38:05.356807 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-05945b03-4106-478b-bb12-6c1b15d8bc83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b707504ab524dd6819136a8d51e5716', 'request_id': 'req-05945b03-4106-478b-bb12-6c1b15d8bc83'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:38:05.369850 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-05945b03-4106-478b-bb12-6c1b15d8bc83 admin admin] The token cache is being invalidate because project 6b707504ab524dd6819136a8d51e5716 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:38:05.370143 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-05945b03-4106-478b-bb12-6c1b15d8bc83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:38:05.370811 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-05945b03-4106-478b-bb12-6c1b15d8bc83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:38:05.373112 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1456/2900] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:38:05 2022] DELETE /identity/v3/projects/6b707504ab524dd6819136a8d51e5716 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:38:05.378049 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355fb5b7-3a8b-40a4-96fa-d0115ad8fe96 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:38:05.378508 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355fb5b7-3a8b-40a4-96fa-d0115ad8fe96 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:38:05.378639 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355fb5b7-3a8b-40a4-96fa-d0115ad8fe96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:38:05.398955 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-355fb5b7-3a8b-40a4-96fa-d0115ad8fe96 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:38:05.400192 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-355fb5b7-3a8b-40a4-96fa-d0115ad8fe96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:38:05.416937 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:38:05.459863 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1445/2901] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:38:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:38:05.468019 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d704b0a-1694-43e7-a4d4-64dd1fc8ecaf None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:38:05.468513 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d704b0a-1694-43e7-a4d4-64dd1fc8ecaf None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:38:05.468624 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d704b0a-1694-43e7-a4d4-64dd1fc8ecaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:38:05.488556 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-8d704b0a-1694-43e7-a4d4-64dd1fc8ecaf None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:38:05.489744 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-8d704b0a-1694-43e7-a4d4-64dd1fc8ecaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:38:05.497760 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1457/2902] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:38:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:38:05.501820 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355fb5b7-3a8b-40a4-96fa-d0115ad8fe96 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:38:05.511401 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355fb5b7-3a8b-40a4-96fa-d0115ad8fe96 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:38:05.516616 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1d25cf-6a21-4f2d-bb50-e227eff607d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:38:05.517205 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d25cf-6a21-4f2d-bb50-e227eff607d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:38:05.517490 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d25cf-6a21-4f2d-bb50-e227eff607d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:38:05.517766 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d25cf-6a21-4f2d-bb50-e227eff607d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:38:05.518416 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1d25cf-6a21-4f2d-bb50-e227eff607d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81380) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 03:38:05.518727 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1d25cf-6a21-4f2d-bb50-e227eff607d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:38:05.520346 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1d25cf-6a21-4f2d-bb50-e227eff607d9 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:38:05.532598 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1446/2903] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 03:38:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 03:38:05.536894 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d704b0a-1694-43e7-a4d4-64dd1fc8ecaf None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:38:05.546143 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d704b0a-1694-43e7-a4d4-64dd1fc8ecaf None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:38:05.550799 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c840e2-d733-4f08-aa8e-d7fbccc6e669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:38:05.551384 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c840e2-d733-4f08-aa8e-d7fbccc6e669 admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:38:05.551708 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c840e2-d733-4f08-aa8e-d7fbccc6e669 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:38:05.551989 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c840e2-d733-4f08-aa8e-d7fbccc6e669 admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:38:05.552651 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c840e2-d733-4f08-aa8e-d7fbccc6e669 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:38:05.554530 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c840e2-d733-4f08-aa8e-d7fbccc6e669 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:38:05.583285 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1458/2904] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:38:05 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:38:05.589091 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1d25cf-6a21-4f2d-bb50-e227eff607d9 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:38:05.599530 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1d25cf-6a21-4f2d-bb50-e227eff607d9 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:38:05.655348 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0fce1c-4a59-47a0-82c9-683d9f4cbdc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:38:05.655978 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0fce1c-4a59-47a0-82c9-683d9f4cbdc0 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:38:05.656258 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0fce1c-4a59-47a0-82c9-683d9f4cbdc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:38:05.656528 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0fce1c-4a59-47a0-82c9-683d9f4cbdc0 admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:38:05.657156 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0fce1c-4a59-47a0-82c9-683d9f4cbdc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:38:05.659048 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0fce1c-4a59-47a0-82c9-683d9f4cbdc0 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:38:05.679665 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1447/2905] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:38:05 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:38:05.683878 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c840e2-d733-4f08-aa8e-d7fbccc6e669 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:38:05.694263 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c840e2-d733-4f08-aa8e-d7fbccc6e669 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:38:05.699659 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97337ce-1b22-4dfa-bc4c-c7569d269284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:38:05.700534 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97337ce-1b22-4dfa-bc4c-c7569d269284 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:38:05.700823 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97337ce-1b22-4dfa-bc4c-c7569d269284 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:38:05.701102 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97337ce-1b22-4dfa-bc4c-c7569d269284 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:38:05.701743 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97337ce-1b22-4dfa-bc4c-c7569d269284 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:38:05.703320 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97337ce-1b22-4dfa-bc4c-c7569d269284 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:38:05.713117 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1459/2906] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:38:05.717375 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0fce1c-4a59-47a0-82c9-683d9f4cbdc0 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:38:05.727031 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0fce1c-4a59-47a0-82c9-683d9f4cbdc0 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:38:05.732432 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d214bf2-2643-46f2-83c3-7df299d520dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:38:05.733380 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d214bf2-2643-46f2-83c3-7df299d520dc admin admin] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:38:05.733753 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d214bf2-2643-46f2-83c3-7df299d520dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:38:05.734239 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d214bf2-2643-46f2-83c3-7df299d520dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:38:05.735176 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d214bf2-2643-46f2-83c3-7df299d520dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:38:05.737379 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d214bf2-2643-46f2-83c3-7df299d520dc admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:38:05.748628 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1448/2907] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:38:05.752875 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97337ce-1b22-4dfa-bc4c-c7569d269284 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:38:05.763457 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97337ce-1b22-4dfa-bc4c-c7569d269284 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:38:05.768375 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d44c15a-26c4-4197-9229-4a784b242d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:38:05.769008 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d44c15a-26c4-4197-9229-4a784b242d2b admin admin] REQUEST_METHOD: `PUT` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:38:05.769288 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d44c15a-26c4-4197-9229-4a784b242d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:38:05.769562 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d44c15a-26c4-4197-9229-4a784b242d2b admin admin] PATH_INFO: `/v3/projects/e63ef3dd6cce4b31a35d5ec95b6d22dd/users/8efde9a6b5f044159cca51138d05e7e9/roles/04d0e4575a28440eb4349b4a6565e8b8` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:38:05.784481 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d44c15a-26c4-4197-9229-4a784b242d2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e63ef3dd6cce4b31a35d5ec95b6d22dd, user_id=8efde9a6b5f044159cca51138d05e7e9, role_id=04d0e4575a28440eb4349b4a6565e8b8)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:38:05.787084 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d44c15a-26c4-4197-9229-4a784b242d2b admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:38:05.799349 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1460/2908] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:38:05 2022] PUT /identity/v3/projects/e63ef3dd6cce4b31a35d5ec95b6d22dd/users/8efde9a6b5f044159cca51138d05e7e9/roles/04d0e4575a28440eb4349b4a6565e8b8 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 03:38:05.804340 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e7dd3-e509-457f-8a3e-6b1ca7dc7615 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:38:05.804629 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e7dd3-e509-457f-8a3e-6b1ca7dc7615 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:38:05.804904 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e7dd3-e509-457f-8a3e-6b1ca7dc7615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:38:05.823959 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-6e9e7dd3-e509-457f-8a3e-6b1ca7dc7615 None None] MFA Rules not processed for user `7c1281e81e9c4e3da30715cc2f1b3156`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:38:05.825677 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-6e9e7dd3-e509-457f-8a3e-6b1ca7dc7615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:38:05.884602 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1449/2909] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:38:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:38:05.895067 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d44c15a-26c4-4197-9229-4a784b242d2b admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:38:05.896783 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-5d44c15a-26c4-4197-9229-4a784b242d2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:38:05.917868 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:38:05.955737 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d44c15a-26c4-4197-9229-4a784b242d2b admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:38:05.959353 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af844e-1ec9-4965-ad16-9e3191633f8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:38:05.959991 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af844e-1ec9-4965-ad16-9e3191633f8a service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:38:05.960276 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af844e-1ec9-4965-ad16-9e3191633f8a service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:38:05.960552 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af844e-1ec9-4965-ad16-9e3191633f8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:38:05.969459 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03af844e-1ec9-4965-ad16-9e3191633f8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:38:05.970886 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03af844e-1ec9-4965-ad16-9e3191633f8a service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:38:05.982625 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1461/2910] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:38:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:38:09.933110 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a4eb5-18a4-402a-a24d-5da22b2c004a None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:38:09.934759 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a4eb5-18a4-402a-a24d-5da22b2c004a None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:38:09.935419 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a4eb5-18a4-402a-a24d-5da22b2c004a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:38:09.967667 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-505a4eb5-18a4-402a-a24d-5da22b2c004a None None] MFA Rules not processed for user `8efde9a6b5f044159cca51138d05e7e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:38:09.969037 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-505a4eb5-18a4-402a-a24d-5da22b2c004a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:38:09.991508 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:38:10.051873 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1450/2911] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:38:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:38:10.055753 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af844e-1ec9-4965-ad16-9e3191633f8a service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:38:10.066150 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af844e-1ec9-4965-ad16-9e3191633f8a service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:38:10.071932 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f611aa3-0b77-47a8-9ceb-ee46103a413a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:38:10.072608 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f611aa3-0b77-47a8-9ceb-ee46103a413a admin admin] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:38:10.072883 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f611aa3-0b77-47a8-9ceb-ee46103a413a admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:38:10.073862 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f611aa3-0b77-47a8-9ceb-ee46103a413a admin admin] PATH_INFO: `/v3/projects` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:38:10.075183 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f611aa3-0b77-47a8-9ceb-ee46103a413a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:38:10.077654 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f611aa3-0b77-47a8-9ceb-ee46103a413a admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:38:10.110590 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1462/2912] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 03:38:10 2022] POST /identity/v3/projects => generated 371 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 03:38:10.114706 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505a4eb5-18a4-402a-a24d-5da22b2c004a None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:38:10.126204 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505a4eb5-18a4-402a-a24d-5da22b2c004a None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:38:10.196656 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63713fe2-44aa-4a5d-abfe-9317cad8b5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:38:10.197196 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63713fe2-44aa-4a5d-abfe-9317cad8b5c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:38:10.197475 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63713fe2-44aa-4a5d-abfe-9317cad8b5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:38:10.197744 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63713fe2-44aa-4a5d-abfe-9317cad8b5c0 admin admin] PATH_INFO: `/v3/users` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:38:10.198427 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63713fe2-44aa-4a5d-abfe-9317cad8b5c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:38:10.201358 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63713fe2-44aa-4a5d-abfe-9317cad8b5c0 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:38:10.226266 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1451/2913] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 03:38:10 2022] POST /identity/v3/users => generated 292 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 03:38:10.230893 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f611aa3-0b77-47a8-9ceb-ee46103a413a admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:38:10.242451 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f611aa3-0b77-47a8-9ceb-ee46103a413a admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:38:10.248552 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b97bc38-373b-435f-b761-8a0c5f3e68b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:38:10.249981 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b97bc38-373b-435f-b761-8a0c5f3e68b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:38:10.250275 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b97bc38-373b-435f-b761-8a0c5f3e68b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:38:10.250799 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b97bc38-373b-435f-b761-8a0c5f3e68b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:38:10.251476 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b97bc38-373b-435f-b761-8a0c5f3e68b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:38:10.253340 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b97bc38-373b-435f-b761-8a0c5f3e68b9 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:38:10.271447 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1463/2914] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:38:10.273077 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63713fe2-44aa-4a5d-abfe-9317cad8b5c0 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:38:10.285730 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63713fe2-44aa-4a5d-abfe-9317cad8b5c0 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:38:10.295575 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0738a107-5547-4348-b04f-a45e6693d58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:38:10.296251 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0738a107-5547-4348-b04f-a45e6693d58b admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:38:10.296529 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0738a107-5547-4348-b04f-a45e6693d58b admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:38:10.296806 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0738a107-5547-4348-b04f-a45e6693d58b admin admin] PATH_INFO: `/v3/projects/847ab6af0e6c4d3b9b98ecefe60e662b/users/2985174f0bbf4538bfe4e1aa9390edbc/roles/fe9379cda35c4ff78576fe48b60bea3c` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:38:10.318498 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0738a107-5547-4348-b04f-a45e6693d58b admin admin] RBAC: Authorizing `identity:create_grant(project_id=847ab6af0e6c4d3b9b98ecefe60e662b, user_id=2985174f0bbf4538bfe4e1aa9390edbc, role_id=fe9379cda35c4ff78576fe48b60bea3c)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:38:10.323020 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0738a107-5547-4348-b04f-a45e6693d58b admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:38:10.343195 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1452/2915] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:38:10 2022] PUT /identity/v3/projects/847ab6af0e6c4d3b9b98ecefe60e662b/users/2985174f0bbf4538bfe4e1aa9390edbc/roles/fe9379cda35c4ff78576fe48b60bea3c => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 03:38:10.347307 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b97bc38-373b-435f-b761-8a0c5f3e68b9 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:38:10.358744 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b97bc38-373b-435f-b761-8a0c5f3e68b9 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:38:10.450320 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4416eb2-2b55-4934-acde-be04cbe86fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:38:10.450868 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4416eb2-2b55-4934-acde-be04cbe86fe3 admin admin] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:38:10.451744 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4416eb2-2b55-4934-acde-be04cbe86fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:38:10.451744 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4416eb2-2b55-4934-acde-be04cbe86fe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:38:10.452075 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4416eb2-2b55-4934-acde-be04cbe86fe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:38:10.453731 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4416eb2-2b55-4934-acde-be04cbe86fe3 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:38:10.464205 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1464/2916] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 03:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 03:38:10.469073 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0738a107-5547-4348-b04f-a45e6693d58b admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:38:10.480393 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0738a107-5547-4348-b04f-a45e6693d58b admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:38:10.487564 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e02124-7623-401e-b921-f6edae73f461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:38:10.488247 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e02124-7623-401e-b921-f6edae73f461 admin admin] REQUEST_METHOD: `PUT` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:38:10.488667 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e02124-7623-401e-b921-f6edae73f461 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:38:10.488963 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e02124-7623-401e-b921-f6edae73f461 admin admin] PATH_INFO: `/v3/projects/847ab6af0e6c4d3b9b98ecefe60e662b/users/2985174f0bbf4538bfe4e1aa9390edbc/roles/fe9379cda35c4ff78576fe48b60bea3c` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:38:10.490929 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e02124-7623-401e-b921-f6edae73f461 admin admin] RBAC: Authorizing `identity:create_grant(project_id=847ab6af0e6c4d3b9b98ecefe60e662b, user_id=2985174f0bbf4538bfe4e1aa9390edbc, role_id=fe9379cda35c4ff78576fe48b60bea3c)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:38:10.494117 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e02124-7623-401e-b921-f6edae73f461 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:38:10.508030 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1453/2917] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 03:38:10 2022] PUT /identity/v3/projects/847ab6af0e6c4d3b9b98ecefe60e662b/users/2985174f0bbf4538bfe4e1aa9390edbc/roles/fe9379cda35c4ff78576fe48b60bea3c => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:38:16.280350 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3acfe3-0dc8-4b13-9fc7-93541f204623 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:38:16.280879 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3acfe3-0dc8-4b13-9fc7-93541f204623 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:38:16.280879 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3acfe3-0dc8-4b13-9fc7-93541f204623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:38:16.328554 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-de3acfe3-0dc8-4b13-9fc7-93541f204623 None None] MFA Rules not processed for user `2985174f0bbf4538bfe4e1aa9390edbc`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:38:16.331006 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-de3acfe3-0dc8-4b13-9fc7-93541f204623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:38:16.427763 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1465/2918] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:38:16 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:38:16.443085 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e02124-7623-401e-b921-f6edae73f461 admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:38:16.445315 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-07e02124-7623-401e-b921-f6edae73f461 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:38:16.533160 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:38:16.564885 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e02124-7623-401e-b921-f6edae73f461 admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:38:16.571930 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765ed39c-d331-4694-be7a-54cf407a404f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1f412befb9418fa66a2aabf475aa90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:38:16.572708 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ed39c-d331-4694-be7a-54cf407a404f service nova] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:38:16.573092 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ed39c-d331-4694-be7a-54cf407a404f service nova] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:38:16.574486 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ed39c-d331-4694-be7a-54cf407a404f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:38:16.644617 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765ed39c-d331-4694-be7a-54cf407a404f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:38:16.646318 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765ed39c-d331-4694-be7a-54cf407a404f service nova] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:38:16.656061 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1454/2919] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:38:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:38:17.825615 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b50c2-83a5-4229-ae39-4b502b5bf1a3 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:38:17.826112 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b50c2-83a5-4229-ae39-4b502b5bf1a3 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:38:17.826112 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b50c2-83a5-4229-ae39-4b502b5bf1a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:38:17.853347 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-0c9b50c2-83a5-4229-ae39-4b502b5bf1a3 None None] MFA Rules not processed for user `8efde9a6b5f044159cca51138d05e7e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:38:17.855955 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-0c9b50c2-83a5-4229-ae39-4b502b5bf1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:38:17.867511 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1466/2920] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 03:38:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:38:18.813403 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fdde9a-4773-4acc-88c3-16750c8d2a21 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:38:18.813910 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fdde9a-4773-4acc-88c3-16750c8d2a21 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:38:18.813910 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fdde9a-4773-4acc-88c3-16750c8d2a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:38:18.833339 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-03fdde9a-4773-4acc-88c3-16750c8d2a21 None None] MFA Rules not processed for user `bef61ef12079495ba72b7fcd2717aca2`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:38:18.834560 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-03fdde9a-4773-4acc-88c3-16750c8d2a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:38:18.899029 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1455/2921] 10.222.0.25 () {58 vars in 967 bytes} [Tue Oct 4 03:38:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:38:18.911773 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9b50c2-83a5-4229-ae39-4b502b5bf1a3 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:38:18.913251 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-0c9b50c2-83a5-4229-ae39-4b502b5bf1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:38:18.919789 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:38:19.001146 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9b50c2-83a5-4229-ae39-4b502b5bf1a3 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:38:19.006279 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d95a6e-2261-4b42-a938-c9e6ad5a77b4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d8da6bacc8f432e8f48bb99c7aede11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:38:19.006891 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d95a6e-2261-4b42-a938-c9e6ad5a77b4 service swift] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:38:19.007180 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d95a6e-2261-4b42-a938-c9e6ad5a77b4 service swift] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:38:19.007457 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d95a6e-2261-4b42-a938-c9e6ad5a77b4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:38:19.016207 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d95a6e-2261-4b42-a938-c9e6ad5a77b4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:38:19.017897 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d95a6e-2261-4b42-a938-c9e6ad5a77b4 service swift] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:38:19.030606 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1467/2922] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Oct 4 03:38:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 03:38:25.946884 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fdde9a-4773-4acc-88c3-16750c8d2a21 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:38:25.948341 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-03fdde9a-4773-4acc-88c3-16750c8d2a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:38:26.029040 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fdde9a-4773-4acc-88c3-16750c8d2a21 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:38:26.033655 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f85dfdd-3ed2-4742-b255-1c8de7fc014c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:38:26.034311 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f85dfdd-3ed2-4742-b255-1c8de7fc014c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:38:26.034591 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f85dfdd-3ed2-4742-b255-1c8de7fc014c admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:38:26.034863 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f85dfdd-3ed2-4742-b255-1c8de7fc014c admin admin] PATH_INFO: `/v3/users/926111af89d943a597ec28264b1ef026` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:38:26.036050 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f85dfdd-3ed2-4742-b255-1c8de7fc014c admin admin] RBAC: Authorizing `identity:delete_user(user_id=926111af89d943a597ec28264b1ef026)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:38:26.037959 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f85dfdd-3ed2-4742-b255-1c8de7fc014c admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:38:26.083855 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:38:26.098748 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-7f85dfdd-3ed2-4742-b255-1c8de7fc014c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '926111af89d943a597ec28264b1ef026'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:38:26.108626 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-7f85dfdd-3ed2-4742-b255-1c8de7fc014c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '926111af89d943a597ec28264b1ef026'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:38:26.116646 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-7f85dfdd-3ed2-4742-b255-1c8de7fc014c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '926111af89d943a597ec28264b1ef026'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:38:26.117520 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-7f85dfdd-3ed2-4742-b255-1c8de7fc014c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '926111af89d943a597ec28264b1ef026'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:38:26.130476 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-7f85dfdd-3ed2-4742-b255-1c8de7fc014c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '926111af89d943a597ec28264b1ef026'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:38:26.136571 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1456/2923] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:38:25 2022] DELETE /identity/v3/users/926111af89d943a597ec28264b1ef026 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:38:26.315235 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d95a6e-2261-4b42-a938-c9e6ad5a77b4 service swift] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:38:26.329351 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d95a6e-2261-4b42-a938-c9e6ad5a77b4 service swift] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:38:26.391463 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81691dd7-e803-4a3d-acdb-b37e93d563b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:38:26.392010 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81691dd7-e803-4a3d-acdb-b37e93d563b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:38:26.392290 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81691dd7-e803-4a3d-acdb-b37e93d563b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:38:26.392561 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81691dd7-e803-4a3d-acdb-b37e93d563b1 admin admin] PATH_INFO: `/v3/projects/b3442e6424b9446c90d15225faa9553f` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:38:26.393671 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81691dd7-e803-4a3d-acdb-b37e93d563b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3442e6424b9446c90d15225faa9553f)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:38:26.395592 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81691dd7-e803-4a3d-acdb-b37e93d563b1 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:38:26.447706 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-81691dd7-e803-4a3d-acdb-b37e93d563b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3442e6424b9446c90d15225faa9553f', 'request_id': 'req-81691dd7-e803-4a3d-acdb-b37e93d563b1'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:38:26.453436 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-81691dd7-e803-4a3d-acdb-b37e93d563b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3442e6424b9446c90d15225faa9553f', 'request_id': 'req-81691dd7-e803-4a3d-acdb-b37e93d563b1'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:38:26.459798 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-81691dd7-e803-4a3d-acdb-b37e93d563b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3442e6424b9446c90d15225faa9553f', 'request_id': 'req-81691dd7-e803-4a3d-acdb-b37e93d563b1'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:38:26.473015 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-81691dd7-e803-4a3d-acdb-b37e93d563b1 admin admin] The token cache is being invalidate because project b3442e6424b9446c90d15225faa9553f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:38:26.473330 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-81691dd7-e803-4a3d-acdb-b37e93d563b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:38:26.473986 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-81691dd7-e803-4a3d-acdb-b37e93d563b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:38:26.475566 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1468/2924] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:38:26 2022] DELETE /identity/v3/projects/b3442e6424b9446c90d15225faa9553f => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:38:26.479576 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f85dfdd-3ed2-4742-b255-1c8de7fc014c admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:38:26.481748 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-7f85dfdd-3ed2-4742-b255-1c8de7fc014c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:38:26.494704 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f85dfdd-3ed2-4742-b255-1c8de7fc014c admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:38:26.553296 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7827ac9b-bf6e-4791-a9c5-f3bef42d153c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:38:26.553947 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7827ac9b-bf6e-4791-a9c5-f3bef42d153c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:38:26.554227 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7827ac9b-bf6e-4791-a9c5-f3bef42d153c admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:38:26.554503 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7827ac9b-bf6e-4791-a9c5-f3bef42d153c admin admin] PATH_INFO: `/v3/users/f182e20d1a9141b7951d20e007412be4` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:38:26.555648 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7827ac9b-bf6e-4791-a9c5-f3bef42d153c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f182e20d1a9141b7951d20e007412be4)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:38:26.557543 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7827ac9b-bf6e-4791-a9c5-f3bef42d153c admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:38:26.604376 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-7827ac9b-bf6e-4791-a9c5-f3bef42d153c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f182e20d1a9141b7951d20e007412be4'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:38:26.611284 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-7827ac9b-bf6e-4791-a9c5-f3bef42d153c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f182e20d1a9141b7951d20e007412be4'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:38:26.621501 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-7827ac9b-bf6e-4791-a9c5-f3bef42d153c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f182e20d1a9141b7951d20e007412be4'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:38:26.622255 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-7827ac9b-bf6e-4791-a9c5-f3bef42d153c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f182e20d1a9141b7951d20e007412be4'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:38:26.634530 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-7827ac9b-bf6e-4791-a9c5-f3bef42d153c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f182e20d1a9141b7951d20e007412be4'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:38:26.641615 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1457/2925] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:38:26 2022] DELETE /identity/v3/users/f182e20d1a9141b7951d20e007412be4 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:38:26.824775 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81691dd7-e803-4a3d-acdb-b37e93d563b1 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:38:26.826298 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-81691dd7-e803-4a3d-acdb-b37e93d563b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:38:26.839365 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81691dd7-e803-4a3d-acdb-b37e93d563b1 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:38:26.869756 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:38:26.914371 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11695792-b6fe-4b29-a169-97d1a7d32990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:38:26.915028 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11695792-b6fe-4b29-a169-97d1a7d32990 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:38:26.915314 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11695792-b6fe-4b29-a169-97d1a7d32990 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:38:26.915611 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11695792-b6fe-4b29-a169-97d1a7d32990 admin admin] PATH_INFO: `/v3/projects/b6759b706a55486eb05f5a75fa01b070` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:38:26.916734 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11695792-b6fe-4b29-a169-97d1a7d32990 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6759b706a55486eb05f5a75fa01b070)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:38:26.919399 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11695792-b6fe-4b29-a169-97d1a7d32990 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:38:26.967888 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-11695792-b6fe-4b29-a169-97d1a7d32990 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6759b706a55486eb05f5a75fa01b070', 'request_id': 'req-11695792-b6fe-4b29-a169-97d1a7d32990'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:38:26.974871 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-11695792-b6fe-4b29-a169-97d1a7d32990 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6759b706a55486eb05f5a75fa01b070', 'request_id': 'req-11695792-b6fe-4b29-a169-97d1a7d32990'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:38:26.982958 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-11695792-b6fe-4b29-a169-97d1a7d32990 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6759b706a55486eb05f5a75fa01b070', 'request_id': 'req-11695792-b6fe-4b29-a169-97d1a7d32990'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:38:26.999334 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-11695792-b6fe-4b29-a169-97d1a7d32990 admin admin] The token cache is being invalidate because project b6759b706a55486eb05f5a75fa01b070 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81379) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:38:26.999660 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-11695792-b6fe-4b29-a169-97d1a7d32990 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:38:27.000317 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-11695792-b6fe-4b29-a169-97d1a7d32990 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:38:27.001809 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1469/2926] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:38:26 2022] DELETE /identity/v3/projects/b6759b706a55486eb05f5a75fa01b070 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:38:36.637986 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=69,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:38:36.994694 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=40,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:38:41.753361 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7827ac9b-bf6e-4791-a9c5-f3bef42d153c admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:38:41.754776 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-7827ac9b-bf6e-4791-a9c5-f3bef42d153c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:38:41.813470 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7827ac9b-bf6e-4791-a9c5-f3bef42d153c admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:38:41.863035 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbc2a8b-5fe2-4464-975d-8f5bda7b8b33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:38:41.863678 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc2a8b-5fe2-4464-975d-8f5bda7b8b33 service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:38:41.863962 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc2a8b-5fe2-4464-975d-8f5bda7b8b33 service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:38:41.864235 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc2a8b-5fe2-4464-975d-8f5bda7b8b33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:38:41.865968 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-bcbc2a8b-5fe2-4464-975d-8f5bda7b8b33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:38:41.932151 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbc2a8b-5fe2-4464-975d-8f5bda7b8b33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:38:41.933546 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbc2a8b-5fe2-4464-975d-8f5bda7b8b33 service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:38:41.943295 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1458/2927] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:38:41 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:38:51.939005 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=70 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:40:34.458181 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11695792-b6fe-4b29-a169-97d1a7d32990 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:40:34.459619 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-11695792-b6fe-4b29-a169-97d1a7d32990 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:40:34.471808 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11695792-b6fe-4b29-a169-97d1a7d32990 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:40:34.475358 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28bfc1a-b933-42b1-8f7b-a575dbe06b26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:40:34.475975 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28bfc1a-b933-42b1-8f7b-a575dbe06b26 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:40:34.476252 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28bfc1a-b933-42b1-8f7b-a575dbe06b26 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:40:34.476524 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28bfc1a-b933-42b1-8f7b-a575dbe06b26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:40:34.478181 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-e28bfc1a-b933-42b1-8f7b-a575dbe06b26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:40:34.550206 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28bfc1a-b933-42b1-8f7b-a575dbe06b26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:40:34.551611 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28bfc1a-b933-42b1-8f7b-a575dbe06b26 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:40:34.563273 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1470/2928] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:40:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:40:35.751690 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbc2a8b-5fe2-4464-975d-8f5bda7b8b33 service neutron] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:40:35.760122 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbc2a8b-5fe2-4464-975d-8f5bda7b8b33 service neutron] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:40:35.764417 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea85de2-a568-41a8-a628-abee2a1a8711 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:40:35.764999 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea85de2-a568-41a8-a628-abee2a1a8711 service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:40:35.765276 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea85de2-a568-41a8-a628-abee2a1a8711 service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:40:35.765546 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea85de2-a568-41a8-a628-abee2a1a8711 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:40:35.767236 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-dea85de2-a568-41a8-a628-abee2a1a8711 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:40:35.780120 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea85de2-a568-41a8-a628-abee2a1a8711 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:40:35.781506 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea85de2-a568-41a8-a628-abee2a1a8711 service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:40:35.792059 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1459/2929] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:40:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:40:42.987960 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28bfc1a-b933-42b1-8f7b-a575dbe06b26 service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:40:42.996634 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28bfc1a-b933-42b1-8f7b-a575dbe06b26 service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:40:43.000234 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94a86f5-ad0d-4731-9abc-93c49ebd6f96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:40:43.000820 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a86f5-ad0d-4731-9abc-93c49ebd6f96 service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:40:43.001100 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a86f5-ad0d-4731-9abc-93c49ebd6f96 service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:40:43.001370 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a86f5-ad0d-4731-9abc-93c49ebd6f96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:40:43.003057 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-f94a86f5-ad0d-4731-9abc-93c49ebd6f96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:40:43.012829 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94a86f5-ad0d-4731-9abc-93c49ebd6f96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:40:43.014219 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94a86f5-ad0d-4731-9abc-93c49ebd6f96 service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:40:43.022242 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1471/2930] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:40:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:40:45.787314 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=6 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:40:47.812920 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a302a-1c05-41da-a022-802880c3ee3b None None] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:40:47.813590 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a302a-1c05-41da-a022-802880c3ee3b None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:40:47.813590 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a302a-1c05-41da-a022-802880c3ee3b None None] PATH_INFO: `/` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:40:47.814882 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1460/2931] 10.222.0.25 () {54 vars in 921 bytes} [Tue Oct 4 03:40:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:40:47.821246 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc225060-3fbd-4cc0-af3f-7adedd0195b4 None None] REQUEST_METHOD: `POST` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:40:47.821716 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc225060-3fbd-4cc0-af3f-7adedd0195b4 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:40:47.821921 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc225060-3fbd-4cc0-af3f-7adedd0195b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:40:47.861440 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.auth.core [None req-cc225060-3fbd-4cc0-af3f-7adedd0195b4 None None] MFA Rules not processed for user `5e43cc9523d949a1bfa3dec882f2824f`. Rule list: `[]` (Enabled: `True`). {{(pid=81379) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:40:47.862672 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-cc225060-3fbd-4cc0-af3f-7adedd0195b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:40:47.869245 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1472/2932] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Oct 4 03:40:47 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 03:40:47.883472 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a302a-1c05-41da-a022-802880c3ee3b None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:40:47.885250 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-c54a302a-1c05-41da-a022-802880c3ee3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:40:47.900609 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a302a-1c05-41da-a022-802880c3ee3b None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:40:47.904569 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab34f78e-de80-4887-8533-5746c8b40022 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:40:47.905169 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab34f78e-de80-4887-8533-5746c8b40022 service neutron] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:40:47.905452 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab34f78e-de80-4887-8533-5746c8b40022 service neutron] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:40:47.905730 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab34f78e-de80-4887-8533-5746c8b40022 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:40:47.913450 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab34f78e-de80-4887-8533-5746c8b40022 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:40:47.914858 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab34f78e-de80-4887-8533-5746c8b40022 service neutron] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:40:47.923581 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1461/2933] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:40:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:40:48.009977 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afbfc2d-414a-437d-8d00-aafbad2202b7 None None] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:40:48.010270 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afbfc2d-414a-437d-8d00-aafbad2202b7 None None] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:40:48.010552 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afbfc2d-414a-437d-8d00-aafbad2202b7 None None] PATH_INFO: `/` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:40:48.012512 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1473/2934] 10.222.0.25 () {54 vars in 921 bytes} [Tue Oct 4 03:40:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 03:40:48.017240 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa551b6-d161-4c7e-9918-ea546efd7c77 None None] REQUEST_METHOD: `POST` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:40:48.017527 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa551b6-d161-4c7e-9918-ea546efd7c77 None None] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:40:48.017801 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa551b6-d161-4c7e-9918-ea546efd7c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:40:48.055552 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.auth.core [None req-aaa551b6-d161-4c7e-9918-ea546efd7c77 None None] MFA Rules not processed for user `2c1f412befb9418fa66a2aabf475aa90`. Rule list: `[]` (Enabled: `True`). {{(pid=81380) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 03:40:48.056976 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-aaa551b6-d161-4c7e-9918-ea546efd7c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:40:48.066168 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1462/2935] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Oct 4 03:40:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 03:40:48.077612 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afbfc2d-414a-437d-8d00-aafbad2202b7 None None] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:40:48.088594 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afbfc2d-414a-437d-8d00-aafbad2202b7 None None] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:40:48.093081 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89983be3-f33e-48b5-969b-b128dff2211d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e43cc9523d949a1bfa3dec882f2824f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:40:48.093672 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89983be3-f33e-48b5-969b-b128dff2211d service neutron] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:40:48.093985 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89983be3-f33e-48b5-969b-b128dff2211d service neutron] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:40:48.094259 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89983be3-f33e-48b5-969b-b128dff2211d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:40:48.104315 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89983be3-f33e-48b5-969b-b128dff2211d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:40:48.105994 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89983be3-f33e-48b5-969b-b128dff2211d service neutron] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:40:48.116631 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1474/2936] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:40:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:40:48.179156 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa551b6-d161-4c7e-9918-ea546efd7c77 None None] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:40:48.180604 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-aaa551b6-d161-4c7e-9918-ea546efd7c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:40:48.253430 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa551b6-d161-4c7e-9918-ea546efd7c77 None None] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:40:48.258462 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cfb13b-38f5-4052-b809-980a877dca56 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94513f6cd19f495e842deb3c13c3e4d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:40:48.259057 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cfb13b-38f5-4052-b809-980a877dca56 service placement] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:40:48.259337 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cfb13b-38f5-4052-b809-980a877dca56 service placement] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:40:48.259644 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cfb13b-38f5-4052-b809-980a877dca56 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:40:48.262033 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-f2cfb13b-38f5-4052-b809-980a877dca56 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:40:48.273202 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cfb13b-38f5-4052-b809-980a877dca56 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:40:48.274745 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cfb13b-38f5-4052-b809-980a877dca56 service placement] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:40:48.284453 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1463/2937] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:40:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:40:50.280802 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89983be3-f33e-48b5-969b-b128dff2211d service neutron] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:40:50.282902 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-89983be3-f33e-48b5-969b-b128dff2211d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:40:50.301632 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89983be3-f33e-48b5-969b-b128dff2211d service neutron] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:40:50.321025 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2675f29e-f4f8-4234-8a0a-5bc2c8b29dcf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1f412befb9418fa66a2aabf475aa90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:40:50.321845 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2675f29e-f4f8-4234-8a0a-5bc2c8b29dcf service nova] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:40:50.322156 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2675f29e-f4f8-4234-8a0a-5bc2c8b29dcf service nova] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:40:50.322434 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2675f29e-f4f8-4234-8a0a-5bc2c8b29dcf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:40:50.324704 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-2675f29e-f4f8-4234-8a0a-5bc2c8b29dcf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:40:50.337913 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2675f29e-f4f8-4234-8a0a-5bc2c8b29dcf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:40:50.339813 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2675f29e-f4f8-4234-8a0a-5bc2c8b29dcf service nova] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:40:50.352475 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1475/2938] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:40:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:40:58.280337 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=47 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:41:00.346957 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=61 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:42:05.512006 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cfb13b-38f5-4052-b809-980a877dca56 service placement] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:42:05.513878 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-f2cfb13b-38f5-4052-b809-980a877dca56 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:42:05.530913 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cfb13b-38f5-4052-b809-980a877dca56 service placement] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:42:05.537118 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c49ab3d-58a2-4b95-b9f3-dd994cf533be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1f412befb9418fa66a2aabf475aa90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:42:05.537737 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c49ab3d-58a2-4b95-b9f3-dd994cf533be service nova] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:42:05.538089 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c49ab3d-58a2-4b95-b9f3-dd994cf533be service nova] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:42:05.538610 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c49ab3d-58a2-4b95-b9f3-dd994cf533be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:42:05.540480 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-1c49ab3d-58a2-4b95-b9f3-dd994cf533be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:42:05.554278 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c49ab3d-58a2-4b95-b9f3-dd994cf533be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:42:05.555992 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c49ab3d-58a2-4b95-b9f3-dd994cf533be service nova] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:42:05.567620 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1464/2939] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:42:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 03:42:13.211908 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2675f29e-f4f8-4234-8a0a-5bc2c8b29dcf service nova] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:42:13.224769 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2675f29e-f4f8-4234-8a0a-5bc2c8b29dcf service nova] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:42:13.229788 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de73289-dff0-4780-b366-b007a5d12571 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94513f6cd19f495e842deb3c13c3e4d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:42:13.230421 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de73289-dff0-4780-b366-b007a5d12571 service placement] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:42:13.230836 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de73289-dff0-4780-b366-b007a5d12571 service placement] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:42:13.231112 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de73289-dff0-4780-b366-b007a5d12571 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:42:13.232877 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-1de73289-dff0-4780-b366-b007a5d12571 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:42:13.245264 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de73289-dff0-4780-b366-b007a5d12571 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:42:13.246825 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de73289-dff0-4780-b366-b007a5d12571 service placement] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:42:13.258035 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1476/2940] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:42:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:42:15.562237 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=6 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:42:16.338549 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c49ab3d-58a2-4b95-b9f3-dd994cf533be service nova] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:42:16.354786 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c49ab3d-58a2-4b95-b9f3-dd994cf533be service nova] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:42:16.378823 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d6465e-2d5c-4dd9-a6b7-4238f0c8d531 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94513f6cd19f495e842deb3c13c3e4d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:42:16.379443 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6465e-2d5c-4dd9-a6b7-4238f0c8d531 service placement] REQUEST_METHOD: `GET` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:42:16.379922 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6465e-2d5c-4dd9-a6b7-4238f0c8d531 service placement] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:42:16.380449 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6465e-2d5c-4dd9-a6b7-4238f0c8d531 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:42:16.382250 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-f5d6465e-2d5c-4dd9-a6b7-4238f0c8d531 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:42:16.395418 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d6465e-2d5c-4dd9-a6b7-4238f0c8d531 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:42:16.397087 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d6465e-2d5c-4dd9-a6b7-4238f0c8d531 service placement] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:42:16.411957 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1465/2941] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:42:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:42:16.415936 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de73289-dff0-4780-b366-b007a5d12571 service placement] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:42:16.417555 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-1de73289-dff0-4780-b366-b007a5d12571 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:42:16.496916 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de73289-dff0-4780-b366-b007a5d12571 service placement] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:42:16.502239 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5459c71e-498a-4cf6-85a1-39bce3feb7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:42:16.502857 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459c71e-498a-4cf6-85a1-39bce3feb7a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:42:16.503169 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459c71e-498a-4cf6-85a1-39bce3feb7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:42:16.503447 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459c71e-498a-4cf6-85a1-39bce3feb7a0 admin admin] PATH_INFO: `/v3/users/8efde9a6b5f044159cca51138d05e7e9` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:42:16.504612 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5459c71e-498a-4cf6-85a1-39bce3feb7a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8efde9a6b5f044159cca51138d05e7e9)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:42:16.506530 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5459c71e-498a-4cf6-85a1-39bce3feb7a0 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:42:16.551481 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-5459c71e-498a-4cf6-85a1-39bce3feb7a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8efde9a6b5f044159cca51138d05e7e9'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:42:16.552158 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-5459c71e-498a-4cf6-85a1-39bce3feb7a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8efde9a6b5f044159cca51138d05e7e9'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:42:16.559434 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-5459c71e-498a-4cf6-85a1-39bce3feb7a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8efde9a6b5f044159cca51138d05e7e9'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:42:16.560179 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-5459c71e-498a-4cf6-85a1-39bce3feb7a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8efde9a6b5f044159cca51138d05e7e9'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:42:16.576616 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-5459c71e-498a-4cf6-85a1-39bce3feb7a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8efde9a6b5f044159cca51138d05e7e9'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:42:16.588466 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1477/2942] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:42:16 2022] DELETE /identity/v3/users/8efde9a6b5f044159cca51138d05e7e9 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:42:16.756838 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d6465e-2d5c-4dd9-a6b7-4238f0c8d531 service placement] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:42:16.772179 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d6465e-2d5c-4dd9-a6b7-4238f0c8d531 service placement] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:42:16.829546 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7469deac-5fa1-4fb7-ade4-fa122e06b86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:42:16.830174 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469deac-5fa1-4fb7-ade4-fa122e06b86b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:42:16.830565 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469deac-5fa1-4fb7-ade4-fa122e06b86b admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:42:16.830845 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469deac-5fa1-4fb7-ade4-fa122e06b86b admin admin] PATH_INFO: `/v3/projects/e63ef3dd6cce4b31a35d5ec95b6d22dd` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:42:16.832008 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7469deac-5fa1-4fb7-ade4-fa122e06b86b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e63ef3dd6cce4b31a35d5ec95b6d22dd)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:42:16.833938 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7469deac-5fa1-4fb7-ade4-fa122e06b86b admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:42:16.878351 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-7469deac-5fa1-4fb7-ade4-fa122e06b86b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e63ef3dd6cce4b31a35d5ec95b6d22dd', 'request_id': 'req-7469deac-5fa1-4fb7-ade4-fa122e06b86b'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:42:16.883635 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-7469deac-5fa1-4fb7-ade4-fa122e06b86b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e63ef3dd6cce4b31a35d5ec95b6d22dd', 'request_id': 'req-7469deac-5fa1-4fb7-ade4-fa122e06b86b'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:42:16.889565 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-7469deac-5fa1-4fb7-ade4-fa122e06b86b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e63ef3dd6cce4b31a35d5ec95b6d22dd', 'request_id': 'req-7469deac-5fa1-4fb7-ade4-fa122e06b86b'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:42:16.901748 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-7469deac-5fa1-4fb7-ade4-fa122e06b86b admin admin] The token cache is being invalidate because project e63ef3dd6cce4b31a35d5ec95b6d22dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:42:16.902039 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-7469deac-5fa1-4fb7-ade4-fa122e06b86b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:42:16.902677 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-7469deac-5fa1-4fb7-ade4-fa122e06b86b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:42:16.904212 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1466/2943] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:42:16 2022] DELETE /identity/v3/projects/e63ef3dd6cce4b31a35d5ec95b6d22dd => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:42:16.908348 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5459c71e-498a-4cf6-85a1-39bce3feb7a0 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:42:16.909736 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-5459c71e-498a-4cf6-85a1-39bce3feb7a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:42:16.922542 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5459c71e-498a-4cf6-85a1-39bce3feb7a0 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:42:16.978051 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1edf1ab-1596-4a03-b523-bbfc5c22bca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:42:16.978674 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1edf1ab-1596-4a03-b523-bbfc5c22bca9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:42:16.978961 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1edf1ab-1596-4a03-b523-bbfc5c22bca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:42:16.979237 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1edf1ab-1596-4a03-b523-bbfc5c22bca9 admin admin] PATH_INFO: `/v3/users/2985174f0bbf4538bfe4e1aa9390edbc` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:42:16.980387 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1edf1ab-1596-4a03-b523-bbfc5c22bca9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2985174f0bbf4538bfe4e1aa9390edbc)` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:42:16.982290 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1edf1ab-1596-4a03-b523-bbfc5c22bca9 admin admin] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:42:16.987462 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:42:17.036321 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-d1edf1ab-1596-4a03-b523-bbfc5c22bca9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2985174f0bbf4538bfe4e1aa9390edbc'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:42:17.036989 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-d1edf1ab-1596-4a03-b523-bbfc5c22bca9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2985174f0bbf4538bfe4e1aa9390edbc'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:42:17.045322 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-d1edf1ab-1596-4a03-b523-bbfc5c22bca9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2985174f0bbf4538bfe4e1aa9390edbc'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:42:17.046047 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-d1edf1ab-1596-4a03-b523-bbfc5c22bca9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2985174f0bbf4538bfe4e1aa9390edbc'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:42:17.058672 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.notifications [None req-d1edf1ab-1596-4a03-b523-bbfc5c22bca9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2985174f0bbf4538bfe4e1aa9390edbc'} {{(pid=81379) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:42:17.071444 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1478/2944] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 03:42:16 2022] DELETE /identity/v3/users/2985174f0bbf4538bfe4e1aa9390edbc => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 03:42:17.244085 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7469deac-5fa1-4fb7-ade4-fa122e06b86b admin admin] Authenticating user token {{(pid=81380) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:42:17.245595 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.fernet_utils [None req-7469deac-5fa1-4fb7-ade4-fa122e06b86b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81380) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:42:17.259640 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7469deac-5fa1-4fb7-ade4-fa122e06b86b admin admin] Validating token access rules against request {{(pid=81380) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:42:17.317388 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb56d3a-2ea3-4650-8ff3-cfac4511a227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1281e81e9c4e3da30715cc2f1b3156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f0f8d5c867d4d0e8de6fcf13db59693', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81380) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:42:17.318100 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb56d3a-2ea3-4650-8ff3-cfac4511a227 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:42:17.318703 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb56d3a-2ea3-4650-8ff3-cfac4511a227 admin admin] SCRIPT_NAME: `/identity` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:42:17.318977 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb56d3a-2ea3-4650-8ff3-cfac4511a227 admin admin] PATH_INFO: `/v3/projects/847ab6af0e6c4d3b9b98ecefe60e662b` {{(pid=81380) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:42:17.320113 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb56d3a-2ea3-4650-8ff3-cfac4511a227 admin admin] RBAC: Authorizing `identity:delete_project(project_id=847ab6af0e6c4d3b9b98ecefe60e662b)` {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:42:17.322047 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb56d3a-2ea3-4650-8ff3-cfac4511a227 admin admin] RBAC: Authorization granted {{(pid=81380) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:42:17.342728 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:42:17.368152 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-beb56d3a-2ea3-4650-8ff3-cfac4511a227 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '847ab6af0e6c4d3b9b98ecefe60e662b', 'request_id': 'req-beb56d3a-2ea3-4650-8ff3-cfac4511a227'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:42:17.373580 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-beb56d3a-2ea3-4650-8ff3-cfac4511a227 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '847ab6af0e6c4d3b9b98ecefe60e662b', 'request_id': 'req-beb56d3a-2ea3-4650-8ff3-cfac4511a227'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:42:17.380096 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-beb56d3a-2ea3-4650-8ff3-cfac4511a227 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '847ab6af0e6c4d3b9b98ecefe60e662b', 'request_id': 'req-beb56d3a-2ea3-4650-8ff3-cfac4511a227'} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:42:17.392758 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-beb56d3a-2ea3-4650-8ff3-cfac4511a227 admin admin] The token cache is being invalidate because project 847ab6af0e6c4d3b9b98ecefe60e662b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81380) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 03:42:17.393057 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-beb56d3a-2ea3-4650-8ff3-cfac4511a227 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:42:17.393692 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG keystone.notifications [None req-beb56d3a-2ea3-4650-8ff3-cfac4511a227 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81380) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 03:42:17.395163 dv-cinder-849143-9-smb devstack@keystone.service[81380]: [pid: 81380|app: 0|req: 1467/2945] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 03:42:17 2022] DELETE /identity/v3/projects/847ab6af0e6c4d3b9b98ecefe60e662b => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 03:42:27.067725 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:42:27.389319 dv-cinder-849143-9-smb devstack@keystone.service[81380]: DEBUG dbcounter [-] [81380] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81380) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 03:43:44.199181 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1edf1ab-1596-4a03-b523-bbfc5c22bca9 admin admin] Authenticating user token {{(pid=81379) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 03:43:44.200658 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-d1edf1ab-1596-4a03-b523-bbfc5c22bca9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:43:44.269909 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1edf1ab-1596-4a03-b523-bbfc5c22bca9 admin admin] Validating token access rules against request {{(pid=81379) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 03:43:44.330006 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc47ba5-191f-4e7d-9e8b-207dbcc5cb76 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94513f6cd19f495e842deb3c13c3e4d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80ae15e46620470b9c55fb7fe300fcb6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81379) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 03:43:44.330600 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc47ba5-191f-4e7d-9e8b-207dbcc5cb76 service placement] REQUEST_METHOD: `GET` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 03:43:44.330879 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc47ba5-191f-4e7d-9e8b-207dbcc5cb76 service placement] SCRIPT_NAME: `/identity` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 03:43:44.331150 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc47ba5-191f-4e7d-9e8b-207dbcc5cb76 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81379) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 03:43:44.332914 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.fernet_utils [None req-fbc47ba5-191f-4e7d-9e8b-207dbcc5cb76 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81379) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 03:43:44.343858 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc47ba5-191f-4e7d-9e8b-207dbcc5cb76 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 03:43:44.345970 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc47ba5-191f-4e7d-9e8b-207dbcc5cb76 service placement] RBAC: Authorization granted {{(pid=81379) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 03:43:44.356076 dv-cinder-849143-9-smb devstack@keystone.service[81379]: [pid: 81379|app: 0|req: 1479/2946] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 03:43:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 03:43:54.351622 dv-cinder-849143-9-smb devstack@keystone.service[81379]: DEBUG dbcounter [-] [81379] Writing DB stats keystone:SELECT=58 {{(pid=81379) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}